Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 339380

Summary: Under Linux, building a Lucene index runs into "Too many open files" errors soon
Product: z_Archived Reporter: Juergen Schumacher <juergen.schumacher>
Component: SmilaAssignee: Project Inbox <smila.processing-inbox>
Status: CLOSED WONTFIX QA Contact:
Severity: normal    
Priority: P4 CC: tmenzel
Version: unspecified   
Target Milestone: ---   
Hardware: PC   
OS: Linux   
Whiteboard:

Description Juergen Schumacher CLA 2011-03-09 10:53:48 EST
With Linux (Ubuntu 10.04, 64bit) we get IOExceptions quite soon (after a few thousand records) because of "too many open files" (ulimit -n is 16384). It seems that Lucene uses 1000s of file handles. The situation is a bit better when ForceFlush="false" in the DataDictionary: I can add my 16000 test documents then, but there are still about 8000 open file handles on Lucene files. It seems to be better on Windows machines.
Comment 1 Igor Novakovic CLA 2012-02-14 12:01:28 EST
Is this issue still relevant since we now use Solr?
Comment 2 thomas menzel CLA 2012-02-14 12:06:26 EST
guess not
Comment 3 Igor Novakovic CLA 2012-02-14 12:15:01 EST
Ok. Closing this one.
Comment 4 Andreas Weber CLA 2013-04-15 11:51:46 EDT
Closing this