Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 224511 - commits_index table is missing data
Summary: commits_index table is missing data
Status: RESOLVED FIXED
Alias: None
Product: Dash
Classification: Technology
Component: Commits Explorer (Retired) (show other bugs)
Version: unspecified   Edit
Hardware: PC Linux
: P3 normal (vote)
Target Milestone: ---   Edit
Assignee: Karl Matthias CLA
QA Contact:
URL: http://dash.eclipse.org/dash/commits/...
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2008-03-27 22:21 EDT by Nick Boldt CLA
Modified: 2008-08-21 12:42 EDT (History)
4 users (show)

See Also:


Attachments
Portal screenshot (58.48 KB, image/png)
2008-04-07 18:15 EDT, Oisin Hurley CLA
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Nick Boldt CLA 2008-03-27 22:21:27 EDT
I set up a simple query the other night to calculate the number of committers per project / topproject (using the `SELECT DISTINCT TOPPROJECT, PROJECT from commits`):

[1]http://dash.eclipse.org/dash/commits/web-api/commit-committers-by-project.php?debug
[2]http://dash.eclipse.org/dash/commits/web-api/commit-committers-by-project.php

Unfortunately, it appears to be missing data, as this query returns only one committer:

# SELECT DISTINCT LOGIN FROM commits_index WHERE PROJECT='stp'
ohurley	

Looking at the filesystem on dev.eclipse for ~/downloads/stp, I see six file owners: 

ndai, askehill, catrielo, ohurley, jma, sdrapeau

Checking their groups:

$ groups ndai askehill catrielo ohurley jma sdrapeau
ndai : common webtools webtools-home stp-dev stpadmin webtoolsadmin webtools.incubator-dev webtools.incubator-home webtools.incubatoradmin stp-svn webtools.all webtools.common-dev webtools.ejbtools-dev webtools.jeetools-dev webtools.releng-dev webtools.servertools-dev webtools.sourceediting-dev webtools.webservices-dev
askehill : common signers stp-dev stpadmin stp-home stp-svn
catrielo : common stp-main stp-dev stpadmin stp-home stp-svn
ohurley : common stp-dev stpadmin stp-home callisto-dev stp-svn
jma : common stp-dev stpadmin stp-home stp-svn
sdrapeau : common stp-dev stp-home stp-svn stp.sca-download

Checking the subversion repo, I see files owned by:

azoppello, dbosschae, amarkevic, amos, atoulme, sdrapeau, amiguel, nbagnard, gpreissle, achen, ashakirin, qhuang, jma, dxu, askehill, ejuliot, hmalphett, ohurley

Checking their groups:

$ groups azoppello dbosschae amarkevic amos atoulme sdrapeau amiguel nbagnard gpreissle achen ashakirin qhuang jma dxu askehill ejuliot hmalphett ohhurley
azoppello : common stp-home stp-svn
dbosschae : common stp-dev stp-home stp-svn
amarkevic : common stp-home stp-svn
amos : common stp-home stp-svn stp.model-download
atoulme : common stp-dev stp-home emft-compare emft-compare-releng stp-svn
sdrapeau : common stp-dev stp-home stp-svn stp.sca-download
id: cannot find name for group ID 8144
nbagnard : common stp-home stp-svn stp.eid-download
gpreissle : common stp-home technology-svn swordfish-dev stp-svn stp.policy-download
achen : common stp-dev stp-svn
ashakirin : common stp-home stp-svn
qhuang : common stp-dev stp-home stp-svn
jma : common stp-dev stpadmin stp-home stp-svn
dxu : common stp-dev stp-home stp-svn
askehill : common signers stp-dev stpadmin stp-home stp-svn
ejuliot : common stp-dev stp-home stp-svn
hmalphett : common stp-dev stp-home stp-svn
ohurley : common stp-dev stpadmin stp-home callisto-dev stp-svn

Overall, that's 20 committers (assuming amiguel is valid, despite the group lookup error). 

---

It would seem this is not strictly an SVN issue.

Overall, the above URL [2] returns 64 committers for Modeling, including two I've never heard of, Brahim Khalil Loukil (modeling.gmt, bloukil) & Daniel Varro (modeling.gmt, dvarro). These two are NOT in my photo database [3], suggesting that either I have people listed who aren't committers or some folks are missing from Dash. 

[3]http://www.eclipse.org/modeling/team/

I suspect it's missing data, given the commit activity this month for bloukil in:

/cvsroot/technology/org.eclipse.gmt/AM3/plugins/org.eclipse.gmt.am3.platform.core/src/org/eclipse/gmt/am3/platform/core/
Comment 1 Oisin Hurley CLA 2008-03-31 12:17:13 EDT
amiguel is valid - and he has been on to me to tell me that he can't currently make commits to his component  (which is org.eclipse.stp.b2j). 

All those 20 committers you have listed are correct. I'll get the committer spreadsheet up to date and send it on to EMO.

Comment 2 Karl Matthias CLA 2008-03-31 12:18:52 EDT
Something completely blew up over the weekend.  Dash failed to communicate to dev.eclipse.org and thus nothing is working properly.  I will have to re-run the batch job before I can look into data issues.
Comment 3 Karl Matthias CLA 2008-04-07 12:56:31 EDT
Closing as resolved.
Comment 4 Nick Boldt CLA 2008-04-07 16:38:17 EDT
The data is back but it's still incorrect. 

Please re-read comment 0 and comment 1. The STP data still shows it's all Oisin, all the time. :) He may be prolific, but he's not the *only* team member.

Oisin: Are you the only *active* committer?

http://www.eclipse.org/projects/project_summary.php?projectid=stp
Comment 5 Nick Boldt CLA 2008-04-07 16:41:22 EDT
Maybe the problem is that there are a number of missing subprojects? 

For example, I see a number of subprojects listed on this page [1]:

[1]http://www.eclipse.org/projects/project_summary.php?projectid=stp

but when I click on a link to that project's summary [2], I see no active committers, and the commits_index table apparently does not contain these records either.

[2] http://www.eclipse.org/projects/project_summary.php?projectid=stp.sca
Comment 6 Karl Matthias CLA 2008-04-07 17:21:15 EDT
One problem is that we're in between standardized groups and not... and the projects page terminology has been re-done for the new setup, where these are called "sub-projects" but in reality they are "components" in this case.  I am going to revisit how we label that.

The "bug" here, however is that STP does not have correct repository information in the meta-data.  All of the CVS repositories are not listed, for example.  Transferring to STP.
Comment 7 Oisin Hurley CLA 2008-04-07 18:12:28 EDT
 
> The "bug" here, however is that STP does not have correct repository
> information in the meta-data.  All of the CVS repositories are not listed, for
> example.  Transferring to STP.

I'll go check the metadata - from the dash page the repo addresses are
incorrect.  
Comment 8 Oisin Hurley CLA 2008-04-07 18:15:15 EDT
Created attachment 95126 [details]
Portal screenshot
Comment 9 Oisin Hurley CLA 2008-04-07 18:16:41 EDT
My portal looks well sick - check the screenshot attached. Where is all the other good stuff gone -  the committer nominations, the project data editing capabilities etc? What am I missing?
Comment 10 Bjorn Freeman-Benson CLA 2008-08-21 12:42:29 EDT
Now (a few months later) I'm seeing lots of commits in the commits explorer for STP. I consider this bug fixed.