Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 317181

Summary: Usage collector on Portal
Product: Community Reporter: Etienne Juliot <etienne.juliot>
Component: Project Management & PortalAssignee: Portal Bugzilla Dummy Inbox <portal-inbox>
Status: RESOLVED WONTFIX QA Contact:
Severity: normal    
Priority: P3 CC: cedric.brun, wayne.beaton
Version: unspecified   
Target Milestone: ---   
Hardware: All   
OS: All   
Whiteboard:

Description Etienne Juliot CLA 2010-06-17 10:21:05 EDT
It could be very usefull to have the result of Usage Collector (http://www.eclipse.org/org/usagedata/results.php) not as CSV files, but as a web page.
And having this per project in the portal would be very useful to project commiters.
Comment 1 Wayne Beaton CLA 2010-06-17 10:52:10 EDT
Actually, you should be able to do this already [1]; however, it seems that the script that generates the data and pushes to these view pages is broken. I'll take a look.

[1] http://eclipse.org/org/usagedata/results.php?kind=bundle&sort=element
Comment 2 Cedric Brun CLA 2010-06-17 10:59:40 EDT
Ouch, the data looks pretty obscure.
I'm dreaming of an EMF model for this data, it would ease writing those queries and even generate HTML reports... ;)

Is the code generating the csv available on the Eclipse CVS ?
Comment 3 Wayne Beaton CLA 2010-06-17 11:10:07 EDT
What information do you require to make a more concrete proposal? What format would you like the data in? SQL dumps, XML, ...
Comment 4 Cedric Brun CLA 2010-06-17 11:23:47 EDT
I can quite easily come up with some kind of Ecore model for this data, having Users, Bundles, UsageCounts among others, instanciating this model looks like a straightforward task if it is done server-side but a painfull one if I have to parse SQL/CSV or any other format. 

That's why I was wondering if the code receiving the usage data collections was Java based and hosted on the Eclipse CVS so that I could have a look.

Digging through the EPP project I don't see anything just even close to this.
Comment 5 Wayne Beaton CLA 2010-06-17 11:43:12 EDT
The server code is PHP. Data is collected into MySQL tables.

Server side code is attached to Bug 221104. The data is actually aggressively normalized from what you see there, but the essentials are the same.
Comment 6 Wayne Beaton CLA 2010-12-14 10:28:07 EST
I've added some documentation to describe what gets captured and how it's stored. 

http://wiki.eclipse.org/UDC

I can provide you with access to the data in CSV format. Right now, the 2009 data (denormalized) is available; it is filtered to include only "org.eclipse.*" bundles to prevent leakage of any potentially private information.

http://archive.eclipse.org/technology/phoenix/usagedata/

Given scarce resources, I'm going to close this bug as WONTFIX. But you can reopen if you think this is worth pursuing. 

I am curious to learn more about what you'd like to do with the data. If you can very specifically describe what you need from us to make this happen, I'll try to make it work.
Comment 7 Etienne Juliot CLA 2010-12-15 10:03:54 EST
Thanks for the new doc.

We will have a look and if we find a good idea to show on simple html page some stats per bundle or project, we will re-open this bug.