Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 339380 - Under Linux, building a Lucene index runs into "Too many open files" errors soon
Summary: Under Linux, building a Lucene index runs into "Too many open files" errors soon
Status: CLOSED WONTFIX
Alias: None
Product: z_Archived
Classification: Eclipse Foundation
Component: Smila (show other bugs)
Version: unspecified   Edit
Hardware: PC Linux
: P4 normal (vote)
Target Milestone: ---   Edit
Assignee: Project Inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-03-09 10:53 EST by Juergen Schumacher CLA
Modified: 2022-07-07 11:31 EDT (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Juergen Schumacher CLA 2011-03-09 10:53:48 EST 
With Linux (Ubuntu 10.04, 64bit) we get IOExceptions quite soon (after a few thousand records) because of "too many open files" (ulimit -n is 16384). It seems that Lucene uses 1000s of file handles. The situation is a bit better when ForceFlush="false" in the DataDictionary: I can add my 16000 test documents then, but there are still about 8000 open file handles on Lucene files. It seems to be better on Windows machines.
Comment 1 Igor Novakovic CLA 2012-02-14 12:01:28 EST 
Is this issue still relevant since we now use Solr?
Comment 2 thomas menzel CLA 2012-02-14 12:06:26 EST 
guess not
Comment 3 Igor Novakovic CLA 2012-02-14 12:15:01 EST 
Ok. Closing this one.
Comment 4 Andreas Weber CLA 2013-04-15 11:51:46 EDT 
Closing this