Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 339275

Summary: BIRT leaving files open
Product: z_Archived Reporter: Logan <logan.buchanan>
Component: BIRTAssignee: xiaofeng zhang <xiaofeng.zhang>
Status: RESOLVED FIXED QA Contact:
Severity: major    
Priority: P3 CC: bluesoldier, lzhu, wyan
Version: 2.6.1   
Target Milestone: 2.6.2   
Hardware: PC   
OS: Linux   
Whiteboard:

Description Logan CLA 2011-03-08 14:51:25 EST 
Info:

Java 1.6.23, RHEL 5.5, Tomcat 5.5.31, Viewer & Engine 2.6.1

After viewing a report, one can do the following:

lsof | egrep java

java       2845      root  607u      REG      253,0    320236     131082 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList21442230 (deleted)
java       2845      root  608u      REG      253,0    297006     131083 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList4964562 (deleted)
java       2845      root  609u      REG      253,0    349949     131084 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList23078509 (deleted)
java       2845      root  610u      REG      253,0    536841     131087 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList24830646 (deleted)
java       2845      root  611u      REG      253,0    314214     131088 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList12212488 (deleted)
java       2845      root  612u      REG      253,0    335442     131104 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList23130122 (deleted)
java       2845      root  613u      REG      253,0    320236     131105 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList19872742 (deleted)
java       2845      root  614u      REG      253,0    297006     131106 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList373265 (deleted)
java       2845      root  615u      REG      253,0    349949     131123 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList32341293 (deleted)
java       2845      root  616u      REG      253,0    536841     131124 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList11880078 (deleted)
java       2845      root  617u      REG      253,0    314214     131125 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList19613244 (deleted)
java       2845      root  618u      REG      253,0    313797     131126 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList30222539 (deleted)
java       2845      root  620u      REG      253,0    252000     131127 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList23658015 (deleted)
java       2845      root  621u      REG      253,0    313797     131128 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList251432 (deleted)
java       2845      root  622u      REG      253,0    252000     131129 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList31527019 (deleted)
java       2845      root  623u      REG      253,0    239071     131130 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList16573392 (deleted)
java       2845      root  624u      REG      253,0    240416     131131 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList13675460 (deleted)
java       2845      root  625u      REG      253,0    252000     131143 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList33448450 (deleted)
java       2845      root  626u      REG      253,0    252000     131136 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList24793977 (deleted)
java       2845      root  627u      REG      253,0    404214     131199 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList28869360 (deleted)
java       2845      root  628u      REG      253,0    223766     131151 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList7686347 (deleted)
java       2845      root  629u      REG      253,0    223631     131154 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList33433724 (deleted)
java       2845      root  630u      REG      253,0    265377     131158 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList30043153 (deleted)
java       2845      root  631u      REG      253,0    239071     131159 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList8181808 (deleted)
java       2845      root  632u      REG      253,0    263750     131162 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList5591349 (deleted)
java       2845      root  633u      REG      253,0    240416     131163 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList21397551 (deleted)
java       2845      root  634u      REG      253,0    223766     131164 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList28685099 (deleted)
java       2845      root  635u      REG      253,0    223631     131165 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList395110 (deleted)
java       2845      root  636u      REG      253,0    404214     131166 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList30394608 (deleted)
java       2845      root  637u      REG      253,0    403797     131168 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList9507802 (deleted)
java       2845      root  638u      REG      253,0    265377     131169 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList11429932 (deleted)
java       2845      root  639u      REG      253,0    263750     131171 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList3748215 (deleted)
java       2845      root  641u      REG      253,0    536841     131197 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList13765283 (deleted)
java       2845      root  642u      REG      253,0    536841     131203 /opt/birt/temp/DataEngine_5033323_2675/BasicDiskList13031781 (deleted)

etc.

Eventually, these DO get cleaned up by the GC.  However, we are running two servers behind a load balancer, and even then on peak times these open files cause the servers to hit the open file limit.  This (usually) causes some undesirable events in Tomcat, and leads to the server needing a reboot.  

As of this writing, there are 438 BasicDiskList files open on server #1, and 527 on server #2.  

Are the files supposed to be left open like that, and we just have a large volume, or are these supposed to be getting closed out?
Comment 1 Logan CLA 2011-03-10 12:07:51 EST 
I might have lied about the GC cleaning up some of these.  We have had a server sitting at the same amount of files for over 24 hours, and another one didn't drop any over night (and exceeded the 4k limit we gave it the following day)
Comment 2 Lin Zhu CLA 2011-03-10 13:12:36 EST 
Hi There,

This bug is already fixed in BIRT 2.6.2 in build 10/21/2010. Could you please have a try of recent 2.6.2 build?

Thanks.
Lin
Comment 3 Lin Zhu CLA 2011-03-10 13:12:47 EST 
Mark as fixed.