Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 357446

Summary: Eclipse Usage Data Collector saves too many files.
Product: [Technology] EPP Reporter: Niels de Feijter <niels.de.feijter>
Component: Usage Data CollectorAssignee: Wayne Beaton <wayne.beaton>
Status: RESOLVED WONTFIX QA Contact:
Severity: normal    
Priority: P3 CC: daniel_megert, jonah, mknauer
Version: unspecified   
Target Milestone: ---   
Hardware: PC   
OS: Windows XP   
Whiteboard:
Attachments:
Description Flags
Screenshot of the directory. none

Description Niels de Feijter CLA 2011-09-13 03:20:21 EDT 
Build Identifier: 

The data collector saved more than 28000 files in 9 months. I've found out by copying a workspace which took more than half an hour. 

I have a screenshot but I do not see an upload button.

That many files in a single directory slows the system down. Please fix (e.g. store the files in an archive).

Oldest file: 201-07-12
Youngest file: 2011-04-18 (I've turned of the feature so no younger files are not available)
# of files: 28128

Reproducible: Always

Steps to Reproduce:
Just use Eclipse for some days having the UDC feature enabled and watch the number of files grow like weeds in the back of your garden.
Comment 1 Niels de Feijter CLA 2011-09-13 03:21:59 EDT 
Created attachment 203212 [details]
Screenshot of the directory.
Comment 2 Niels de Feijter CLA 2011-09-13 03:22:28 EDT 
Added screenshot.
Comment 3 Wayne Beaton CLA 2011-09-13 09:50:04 EDT 
Is there anything useful in the log? Are the uploads failing?

i.e. do you see messages like this in the log:

Usage data uploaded to http://udc.eclipse.org/upload.php in 5050 milliseconds.

or something along these lines:

"Usage data upload to %1$s failed with error code %2$s."
"The URL provided for usage data upload, %1$s, is invalid."
"The usage data upload server at %1$s could not be found."
"Could not connect to the usage data upload server at %1$s."
"A socket timeout occurred while trying to upload usage data."
"An exception occurred while trying to upload usage data."

The simple workaround is to just delete the files.

FWIW, we have decided to pull the UDC out of the Juno releases.
Comment 4 Niels de Feijter CLA 2011-09-14 03:20:07 EDT 
The oldest log file is from 2011-03-03.
The youngest udc file is from 2011-04-18.

The relevant log data (.log file in the workspace directory) from 2011-03-03 to 2011-04-18 does not contain any of the lines.

It does also not contain any of the following keywords:
- upload
- udc
- timeout
- server
- usage
Comment 5 Wayne Beaton CLA 2011-09-14 11:03:47 EDT 
Curious. It's collecting data, but (apparently) never attempting to upload it.

On the Usage Data Collector > Uploading page, does it show a "Last Upload:" date?

What is the Upload Period?

On the "Terms of Use" page, is there a tick in the "I accept the Terms of Use" checkbox?
Comment 6 Jonah Graham CLA 2021-05-07 10:23:36 EDT 
The Usage Data Collector was decommissioned a long time ago. Therefore any
remaining bugs are now being closed as WONTFIX. If this bug is still relevant,
please make a comment and we'll move it to the correct project/component for
further investigation.

This change was made as part of a bulk change.