Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 322716

Summary: [website] automatically update bug count on contributors page
Product: z_Archived Reporter: Frank Becker <eclipse>
Component: MylynAssignee: Frank Becker <eclipse>
Status: RESOLVED FIXED QA Contact:
Severity: enhancement    
Priority: P3 CC: sam.davis, steffen.pingel, tomasz.zarna
Version: unspecified   
Target Milestone: 3.14   
Hardware: All   
OS: All   
URL: http://www.eclipse.org/mylyn/contributors/
Whiteboard:
Attachments:
Description Flags
patch V1
none
mylyn/context/zip
none
mylyn/context/zip
none
mylyn/context/zip none

Description Frank Becker CLA 2010-08-15 02:35:12 EDT
I ctrate a patch with the following changes:

1) email address  changed from dgreen99@gmail.com to David.Green@tasktop.com
2) company icon changed from  independent.gif to tasktop.png
3) company name change from independent to Tasktop

Should we do an update of the bug counts?
Comment 1 Frank Becker CLA 2010-08-15 02:38:49 EDT
Created attachment 176608 [details]
patch V1

This patch is not commited in HEAD, please verify before commit.
Comment 2 Frank Becker CLA 2010-08-15 02:38:50 EDT
Created attachment 176609 [details]
mylyn/context/zip
Comment 3 Steffen Pingel CLA 2010-08-16 17:05:19 EDT
Makes sense.
Comment 5 Steffen Pingel CLA 2010-09-08 15:14:07 EDT
+1 for removing the bug counts. I'll add that as an item for next weeks meeting to get input from other committers.
Comment 7 Frank Becker CLA 2010-09-11 15:33:31 EDT
I think it is better to use the following

https://bugs.eclipse.org/bugs/report.cgi?bug_file_loc=&bug_file_loc_type=allwordssubstr&bug_id=&bug_status=RESOLVED&bug_status=VERIFIED&bug_status=CLOSED&bugidtype=include&chfieldfrom=&chfieldto=Now&chfieldvalue=&classification=Tools&component=Bugzilla&component=Core&component=Doc&component=Java&component=Jira&component=Monitor&component=Tasks&component=Trac&component=UI&component=Web&component=WikiText&component=XML&component=XPlanner&cumulate=0&email1=&email2=&emailtype1=notregexp&emailtype2=substring&field0-0-0=assigned_to&field0-1-0=assigned_to&field0-2-0=assigned_to&field0-3-0=assigned_to&field0-4-0=assigned_to&field0-5-0=assigned_to&field0-6-0=assigned_to&keywords=&keywords_type=allwords&longdesc=&longdesc_type=allwordssubstr&product=Mylyn&resolution=FIXED&short_desc=&short_desc_type=allwordssubstr&status_whiteboard=&status_whiteboard_type=allwordssubstr&type0-0-0=notequals&type0-1-0=notequals&type0-2-0=notequals&type0-3-0=notequals&type0-4-0=notequals&type0-5-0=notequals&type0-6-0=notequals&value0-0-0=mylyn-inbox%40eclipse.org&value0-1-0=mik.kersten%40tasktop.com&value0-2-0=steffen.pingel%40tasktop.com&value0-3-0=robert.elves%40tasktop.com&value0-4-0=david.green%40tasktop.com&value0-5-0=shawn.minto%40tasktop.com&value0-6-0=Frank%40Frank-Becker.de&votes=&x_axis_field=assigned_to&y_axis_field=&z_axis_field=&width=600&height=350&action=wrap&format=pie

because otherwise Thomas Ehrnhoefer, Leo Dos Santos, David Shepherd and Terry Hon are not shown.
Comment 9 Frank Becker CLA 2014-08-23 14:44:22 EDT
Because I did not know how to test website updates I implement this using the vagrant setup.

Review https://git.eclipse.org/r/32200 show how we can do this.
The source from contributer.php should be part of /contributers/index.php

You can test this using the following url http://localhost:2080/cgi-bin/contributer.php
Comment 10 Frank Becker CLA 2014-08-23 14:44:29 EDT
Created attachment 246282 [details]
mylyn/context/zip
Comment 11 Frank Becker CLA 2014-08-24 03:39:39 EDT
I think we maybe need an updated Query.

if we want to count the contributions of a committer to an other sub level project without committer status we need the following
https://bugs.eclipse.org/bugs/report.cgi?x_axis_field=assigned_to_realname&y_axis_field=&z_axis_field=&no_redirect=1&query_format=report-table&short_desc_type=allwordssubstr&short_desc=&classification=Mylyn&bug_status=RESOLVED&bug_status=VERIFIED&bug_status=CLOSED&longdesc_type=allwordssubstr&longdesc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_id=&bug_id_type=anyexact&votes=&votes_type=greaterthaneq&emailtype1=substring&email1=&emailtype2=substring&email2=&emailtype3=substring&email3=&chfieldvalue=&chfieldfrom=&chfieldto=Now&j_top=AND&n10=1&f10=OP&j10=AND&f11=product&o11=equals&v11=Mylyn+Tasks&f13=OP&j13=OR&f14=assigned_to&o14=equals&v14=Steffen.Pingel%40tasktop.com&f15=assigned_to&o15=equals&v15=Eclipse%40Frank-Becker.de&f16=assigned_to&o16=equals&v16=David.Green%40tasktop.com&f17=assigned_to&o17=equals&v17=Mik.Kersten%40tasktop.com&f18=assigned_to&o18=equals&v18=robert.elves%40tasktop.com&f19=assigned_to&o19=equals&v19=shawn.minto%40tasktop.com&f20=assigned_to&o20=equals&v20=tomasz.zarna%40tasktop.com&f21=assigned_to&o21=equals&v21=sam.davis%40tasktop.com&f23=CP&f25=CP&n26=1&f26=OP&j26=AND&f27=product&o27=equals&v27=Mylyn+Builds&f28=OP&j28=OR&f29=assigned_to&o29=equals&v29=Steffen.Pingel%40tasktop.com&f30=assigned_to&o30=equals&v30=benjamin.muskalla%40tasktop.com&f31=assigned_to&o31=equals&v31=stepper%40esc-net.de&f32=assigned_to&o32=equals&v32=torkildr%40gmail.com&f33=noop&o33=noop&v33=&format=table&action=wrap

this is only for the Build and the Task sub projects as an example

But maybe we should keep this simple and only exclude all committer of any sub level project.

Thoughts?
Comment 12 Sam Davis CLA 2014-08-25 13:29:23 EDT
Frank, the website is hosted in Git: ssh://git.eclipse.org:29418/www.eclipse.org/mylyn. I think if you push changes to the staging branch they will be published at http://staging.eclipse.org/mylyn/ (after several minutes). Changes pushed to master get published to http://eclipse.org/mylyn/
Comment 13 Frank Becker CLA 2014-08-28 17:42:34 EDT
We do actual not have the following sections.
* Committers
* Active Contributors
* Past Contributors

Need to do some more work because the list of the committers is not actual.

Hope that I can do this over the weekend.

Thoughts / Comments?
Comment 14 Sam Davis CLA 2014-08-29 17:09:01 EDT
I don't think we should hardcode the list of committers because it will be too hard to maintain. The committers are listed on pages like https://projects.eclipse.org/projects/mylyn.tasks/who - if there is somewhere that that data is easily available to use we could use it, otherwise I think we should just list all contributors including committers in one list.
Comment 15 Frank Becker CLA 2014-09-02 14:11:55 EDT
Now you can see in http://staging.eclipse.org/mylyn/contributors/index.php how the new page looks. But the time to build the page is very long.

Should I create a copy of the index.php without the list of committer and only the keyword contributed?
Comment 16 Sam Davis CLA 2014-09-02 16:39:05 EDT
I wonder if we could use a hudson job to periodically build the page offline and publish it.
Comment 17 Frank Becker CLA 2014-09-03 01:06:25 EDT
(In reply to Sam Davis from comment #16)
> I wonder if we could use a hudson job to periodically build the page offline
> and publish it.

I try this in the next days with the localhost environment.
Comment 18 Frank Becker CLA 2014-09-10 15:52:47 EDT
I have changed the php (http://localhost:2080/cgi-bin/contributer.php) to use curl to load the content of contributer.inc into a string.

Is the module php5-curl is installed on the eclipse webserver?

Now I try to setup an hudson job to build the contributer.inc file in the workspace.
Comment 19 Frank Becker CLA 2014-09-10 15:52:55 EDT
Created attachment 246931 [details]
mylyn/context/zip
Comment 20 Sam Davis CLA 2014-09-10 16:42:42 EDT
(In reply to comment #18)
> I have changed the php (http://localhost:2080/cgi-bin/contributer.php) to use
> curl to load the content of contributer.inc into a string.
> 
> Is the module php5-curl is installed on the eclipse webserver?

I don't know. You could try pushing something to staging that uses curl and see if it works.

> 
> Now I try to setup an hudson job to build the contributer.inc file in the
> workspace.

Cool!
Comment 21 Frank Becker CLA 2014-09-11 14:04:04 EDT
(In reply to Sam Davis from comment #20)
> (In reply to comment #18)
> > I have changed the php (http://localhost:2080/cgi-bin/contributer.php) to use
> > curl to load the content of contributer.inc into a string.
> > 
> > Is the module php5-curl is installed on the eclipse webserver?
> 
> I don't know. You could try pushing something to staging that uses curl and
> see if it works.

Here is the review: https://git.eclipse.org/r/#/c/33270/1
Comment 22 Sam Davis CLA 2014-09-12 16:30:25 EDT
Maybe instead of keeping the php code to generate the contributors list in Hudson, we could keep it in the website Git repository and have Hudson check it out from git://git.eclipse.org/gitroot/www.eclipse.org/mylyn and run it. That way it will be part of version control.
Comment 23 Frank Becker CLA 2014-09-15 14:29:43 EDT
create a new review https://git.eclipse.org/r/#/c/33392/ because for some reason the code which work in localhost did not work on staging. So I try an other way.
Comment 24 Frank Becker CLA 2014-09-15 15:35:42 EDT
Sam,
Steffen,

I do not see that the changes in the staging branch are in http://staging.eclipse.org/mylyn/contributors.

Do you know how long it takes between merge of staging and access ower the web?
Comment 25 Sam Davis CLA 2014-09-15 16:01:21 EDT
No. It is supposed to take only a few minutes, I think, but it seems to be longer.
Comment 26 Frank Becker CLA 2014-09-27 12:08:24 EDT
(In reply to comment #25)
> No. It is supposed to take only a few minutes, I think, but it seems to be
> longer.

Now it is there (look for the " Test!!!"). So we have the content of the page on https://hudson.eclipse.org/mylyn/job/mylyn-update-contributors/lastSuccessfulBuild/artifact/contributor.inc

Can you give feedback if we should use this in real.
Comment 27 Sam Davis CLA 2014-09-29 13:20:50 EDT
Frank this is really great! I think we should definitely use this! I pushed a few small changes to https://git.eclipse.org/r/#/c/34069/, can you take a look?

To summarize how this is working, "this":https://hudson.eclipse.org/mylyn/job/mylyn-update-contributors/ build job runs a php script from the website Git which parses the https://projects.eclipse.org/projects/*/who pages to find out who the committers are and queries bugzilla to create a page which lists the committers and contributers separately, sorted by number of contributions. The contributors page then loads the content from the latest run of the build job.
Comment 28 Sam Davis CLA 2014-09-30 18:47:47 EDT
Frank, the page at http://staging.eclipse.org/mylyn/contributors/index.php still has "Test!!!" even though I removed that in https://git.eclipse.org/r/#/c/34079/. I guess it is just very slow to update?

Should we merge the staging branch into master?
Comment 29 Frank Becker CLA 2014-10-01 14:59:12 EDT
(In reply to Sam Davis from comment #28)
> Frank, the page at http://staging.eclipse.org/mylyn/contributors/index.php
> still has "Test!!!" even though I removed that in
> https://git.eclipse.org/r/#/c/34079/. I guess it is just very slow to update?
> 
> Should we merge the staging branch into master?

Yes, I think it is save to merge this.
Comment 30 Sam Davis CLA 2014-10-01 16:39:23 EDT
I've merged staging into master: https://www.eclipse.org/mylyn/contributors/index.php. I think we can consider this done. Nice work Frank!