Bugzilla – Full Text Bug Listing
| Summary: | Migrate RelEng infrastructure to use GEF HIPP (hudson instance per project). | ||
|---|---|---|---|
| Product: | [Tools] GEF | Reporter: | Alexander Nyßen <nyssen> |
| Component: | RelEng | Assignee: | gef-inbox <gef-inbox> |
| Status: | RESOLVED FIXED | QA Contact: | |
| Severity: | normal | ||
| Priority: | P3 | CC: | cletavernier, mtlais, psuzzi |
| Version: | 0.1.0 | ||
| Target Milestone: | 3.10.1 (Mars SR1) M2 | ||
| Hardware: | All | ||
| OS: | All | ||
| Whiteboard: | |||
| Bug Depends on: | 471150 | ||
| Bug Blocks: | |||
|
Description
Alexander Nyßen
HIPP instance has been created and gef jobs have been migrated. Currently, gef4-master is still unstable because of bug #471755. I still have to update our promotion scripts and will remove the old jobs on the shared Hudson instance. We will also have to update our project meta-data as well as the already promoted drop-files (build.cfg) to point to the HIPP. In addition, the cron jobs to publish integration builds have to be replaced as well (turned into Hudson jobs). The following things have been done already : - The gef-master, gef4-master, and gef-maintenance builds have been migrated to http://hudson.eclipse.org/gef. - I adjusted our promotion scripts and created respective promotion jobs that invoke them. - I replaced the cron jobs on builds.eclipse.org with time triggers for the promote-gef4-master and promote-gef-master jobs. - I further updated our meta-data w.r.t to builds and update-sites (the CI update sites refer to hudson). - I also adjusted the build.cfg of all non-archived drop files to refer to the new HIPP instance as well and disabled the jobs on the shared instance. What remains to be done: -I will try to setup build promotion directly from the respective gef-master, gef-maintenance, and gef4-master jobs by using the Promoted Builds Plugin. -I will change the promotion scripts to produce a composite update site. -After a composite update site is in place, the maintenance build can also be promoted automatically each Friday (up to now, these mix with the master interim builds). I adjusted the gef4 publish script to create a composite update site and recreated our integration, milestones, and releases sites as composite sites. Hi Alexander, Our build (Papyrus) refers to http://download.eclipse.org/tools/gef/updates/milestones (Which is also the update site referenced in the Simultaneous Release), and it fails on the following error: [ERROR] Internal error: java.lang.RuntimeException: Failed to load p2 repository with ID 'gef' from location http://download.eclipse.org/tools/gef/updates/milestones: Unable to read repository at http://download.eclipse.org/tools/gef/updates/milestones. No repository found at http://download.eclipse.org/tools/gef/updates/milestones/features. -> [Help 1] [...] Caused by: java.lang.RuntimeException: Failed to load p2 repository with ID 'gef' from location http://download.eclipse.org/tools/gef/updates/milestones [...] Caused by: org.eclipse.equinox.p2.core.ProvisionException: Unable to read repository at http://download.eclipse.org/tools/gef/updates/milestones [...] Caused by: org.eclipse.equinox.p2.core.ProvisionException: No repository found at http://download.eclipse.org/tools/gef/updates/milestones/features. [...] See https://hudson.eclipse.org/papyrus/job/Papyrus-Master/1751/console (In reply to Camille Letavernier from comment #5) > Hi Alexander, > > Our build (Papyrus) refers to > http://download.eclipse.org/tools/gef/updates/milestones (Which is also the > update site referenced in the Simultaneous Release), and it fails on the > following error: > > [ERROR] Internal error: java.lang.RuntimeException: Failed to load p2 > repository with ID 'gef' from location > http://download.eclipse.org/tools/gef/updates/milestones: Unable to read > repository at http://download.eclipse.org/tools/gef/updates/milestones. No > repository found at > http://download.eclipse.org/tools/gef/updates/milestones/features. -> [Help > 1] > [...] > Caused by: java.lang.RuntimeException: Failed to load p2 repository with ID > 'gef' from location http://download.eclipse.org/tools/gef/updates/milestones > [...] > Caused by: org.eclipse.equinox.p2.core.ProvisionException: Unable to read > repository at http://download.eclipse.org/tools/gef/updates/milestones > [...] > Caused by: org.eclipse.equinox.p2.core.ProvisionException: No repository > found at http://download.eclipse.org/tools/gef/updates/milestones/features. > [...] > > See https://hudson.eclipse.org/papyrus/job/Papyrus-Master/1751/console I worked on migrating the milestones update site to a composite site this morning. It should be ok now. Could you please try again? I've started a build a minute ago and it failed with the same error https://hudson.eclipse.org/papyrus/job/Papyrus-Master/1753/console Where does the ID "gef" come from, you try to look up? The composite repo I created has the name 'GEF milestones'. (In reply to Alexander Nyßen from comment #8) > Where does the ID "gef" come from, you try to look up? The composite repo I > created has the name 'GEF milestones'. And, could it be that mirrors are involved (I changed the site and it may not be properly propagated yet)? (In reply to Alexander Nyßen from comment #9) > (In reply to Alexander Nyßen from comment #8) > > Where does the ID "gef" come from, you try to look up? The composite repo I > > created has the name 'GEF milestones'. > > And, could it be that mirrors are involved (I changed the site and it may > not be properly propagated yet)? I identified the problem. The contents of the compositeContent.xml is not valid. I will check it. (In reply to Alexander Nyßen from comment #10) > (In reply to Alexander Nyßen from comment #9) > > (In reply to Alexander Nyßen from comment #8) > > > Where does the ID "gef" come from, you try to look up? The composite repo I > > > created has the name 'GEF milestones'. > > > > And, could it be that mirrors are involved (I changed the site and it may > > not be properly propagated yet)? > > I identified the problem. The contents of the compositeContent.xml is not > valid. I will check it. Should be fixed now. Can you give it another try? > Should be fixed now. Can you give it another try?
Yes, it seems to work now (The build went a little bit further and is still running)
Thanks!
I have migrated the gef interim, milestones, and releases sites into composite sites as well. Furthermore, I have enabled that GEF4 drop files are promoted now as well (update-site archive). We will have to adjust the downloads web-page to make them visible. I have also scheduled integration promotions for gef-master, gef-maintenance, and gef4-master now for each Friday. The promotion plugin seems to be too limited for our cases, so I will not set up a respective configuration. Everything else is now in place. All jobs run successfully, the promotion jobs are also functional, and all update sites are converted to composite sites. The project-meta-data has been updated, included the changed CI update sites. Furthermore, weekly integration build promotions are scheduled for gef-master, gef-maintenance, and gef4-master. The old jobs on the shared instance are disabled. Hello Alexandre, I have a similar problem while building my eclipse project using maven. I wonder if the site is up to date. [ERROR] Internal error: java.lang.RuntimeException: Failed to load p2 repository with ID 'GEF' from location http://download.eclipse.org/tools/gef/updates/releases/: Unable to read repository at http://download.eclipse.org/tools/gef/updates/releases. No repository found at http://download.eclipse.org/tools/gef/updates/releases/3.4.0. -> [Help 1] org.apache.maven.InternalErrorException: Internal error: java.lang.RuntimeException: Failed to load p2 repository with ID 'GEF' from location http://download.eclipse.org/tools/gef/updates/releases/ Thank you > [ERROR] Internal error: java.lang.RuntimeException: Failed to load p2
> repository with ID 'GEF' from location
> http://download.eclipse.org/tools/gef/updates/releases/: Unable to read
> repository at http://download.eclipse.org/tools/gef/updates/releases. No
> repository found at
> http://download.eclipse.org/tools/gef/updates/releases/3.4.0. -> [Help 1]
>
>
> org.apache.maven.InternalErrorException: Internal error:
> java.lang.RuntimeException: Failed to load p2 repository with ID 'GEF' from
> location http://download.eclipse.org/tools/gef/updates/releases/
I can browse the repository with p2 browser and eclipse install UI without problems. However, the 3.4.0, 3.4.1, and 3.4.2 update-sites, nested within the composite site, are still "old-/pre-p2-style" repositories. Maybe this causes problems.
(In reply to Alexander Nyßen from comment #16) > > [ERROR] Internal error: java.lang.RuntimeException: Failed to load p2 > > repository with ID 'GEF' from location > > http://download.eclipse.org/tools/gef/updates/releases/: Unable to read > > repository at http://download.eclipse.org/tools/gef/updates/releases. No > > repository found at > > http://download.eclipse.org/tools/gef/updates/releases/3.4.0. -> [Help 1] > > > > > > org.apache.maven.InternalErrorException: Internal error: > > java.lang.RuntimeException: Failed to load p2 repository with ID 'GEF' from > > location http://download.eclipse.org/tools/gef/updates/releases/ > > > I can browse the repository with p2 browser and eclipse install UI without > problems. However, the 3.4.0, 3.4.1, and 3.4.2 update-sites, nested within > the composite site, are still "old-/pre-p2-style" repositories. Maybe this > causes problems. It could also be a caching problem. (In reply to Alexander Nyßen from comment #17) > (In reply to Alexander Nyßen from comment #16) > > > [ERROR] Internal error: java.lang.RuntimeException: Failed to load p2 > > > repository with ID 'GEF' from location > > > http://download.eclipse.org/tools/gef/updates/releases/: Unable to read > > > repository at http://download.eclipse.org/tools/gef/updates/releases. No > > > repository found at > > > http://download.eclipse.org/tools/gef/updates/releases/3.4.0. -> [Help 1] > > > > > > > > > org.apache.maven.InternalErrorException: Internal error: > > > java.lang.RuntimeException: Failed to load p2 repository with ID 'GEF' from > > > location http://download.eclipse.org/tools/gef/updates/releases/ > > > > > > I can browse the repository with p2 browser and eclipse install UI without > > problems. However, the 3.4.0, 3.4.1, and 3.4.2 update-sites, nested within > > the composite site, are still "old-/pre-p2-style" repositories. Maybe this > > causes problems. > > It could also be a caching problem. when I browse the following link: http://download.eclipse.org/tools/gef/updates/releases/3.4.0/ It shows the following: <site><description url="http://download.eclipse.org/tools/gef/updates/releases/site.xml"> To install these plugins, point Eclipse at this site. </description> ... BUT, when I open the site.xml URL, it can not be found. http://download.eclipse.org/tools/gef/updates/releases/site.xml not found by the way, I noticed that another site.xml exists and available by replacing "updates" by "update-site" inside the URL: http://download.eclipse.org/tools/gef/update-site/releases/site.xml. Maybe the URL must be replaced ? > when I browse the following link:
> http://download.eclipse.org/tools/gef/updates/releases/3.4.0/
>
>
> It shows the following:
>
> <site><description
> url="http://download.eclipse.org/tools/gef/updates/releases/site.xml">
> To install these plugins, point Eclipse at this site.
> </description>
> ...
>
>
> BUT, when I open the site.xml URL, it can not be found.
> http://download.eclipse.org/tools/gef/updates/releases/site.xml not found
>
>
> by the way, I noticed that another site.xml exists and available by
> replacing "updates" by "update-site" inside the URL:
> http://download.eclipse.org/tools/gef/update-site/releases/site.xml.
>
> Maybe the URL must be replaced ?
/tools/gef/update-site was the old update-site url we published to before 3.8.0. Is is still in place (but should actually be removed). Before I migrated to the composite site, I had a single integrated site into which I had merged all those sites that are nested below the composite site (so they were converted to the new p2 format). When creating the composite site now, I started from the individual update sites.
The best solution will be to convert the old update-sites to p2 format, so the new composite site is fully p2 compliant. I will take care of it.
I converted the 3.4.0, 3.4.1, and 3.4.2 sites into new-style p2 repositories. Please give it another try. (In reply to Alexander Nyßen from comment #20) > I converted the 3.4.0, 3.4.1, and 3.4.2 sites into new-style p2 > repositories. Please give it another try. I have now a new Error: [INFO] Fetching p2.index from http://download.eclipse.org/tools/gef/updates/releases/ (0B at 0B/s) [INFO] 1 operation remaining. [INFO] Fetching p2.index from http://download.eclipse.org/tools/gef/updates/releases/ (130B at 0B/s) [INFO] Adding repository http://download.eclipse.org/tools/gef/updates/releases [INFO] Fetching content.jar from http://download.eclipse.org/tools/gef/updates/releases/3.4.0/ (0B of 7.41kB at 0B/s) [INFO] 1 operation remaining. [INFO] Fetching content.jar from http://download.eclipse.org/tools/gef/updates/releases/3.4.0/ (2.44kB of 7.41kB at 0B/s) [ERROR] Partial IU: org.eclipse.gef.source [ERROR] Partial IU: org.eclipse.gef.examples.ui.pde [ERROR] Partial IU: org.eclipse.gef.examples.flow [ERROR] Partial IU: org.eclipse.gef.doc.isv [ERROR] Partial IU: org.eclipse.gef.examples.text [ERROR] Partial IU: org.eclipse.zest.core [ERROR] Partial IU: org.eclipse.zest.source [ERROR] Partial IU: org.eclipse.gef.examples.source [ERROR] Partial IU: org.eclipse.zest.layouts [ERROR] Partial IU: org.eclipse.gef.examples.shapes [ERROR] Partial IU: org.eclipse.draw2d.doc.isv [ERROR] Partial IU: org.eclipse.draw2d [ERROR] Partial IU: org.eclipse.draw2d.source [ERROR] Partial IU: org.eclipse.gef.examples.logic [ERROR] Partial IU: org.eclipse.gef [ERROR] Internal error: java.lang.RuntimeException: Failed to load p2 repository with ID 'GEF' from location http://download.eclipse.org/tools/gef/updates/releases/: Unable to read repository at http://download.eclipse.org/tools/gef/updates/releases. The p2 repository at http://download.eclipse.org/tools/gef/updates/releases/3.4.0 contains partial IUs (see above) from an old style update site which cannot be used for dependency resolution -> [Help 1] OK. I recreated them using p2.mirror. Now I have used tycho to actually convert the sites. Can you give it another try? I now further converted 3.5.0, 3.5.1, and 3.5.2, and ensured they are added to the GEF category. 3.6.0 through 3.7.2 are still on my list... I now also re-created 3.6.0, 3.6.1, 3.6.2, 3.7.0, 3.7.1, and 3.7.2 by means of tycho and adjusted the category. The site should now be clean. (In reply to Alexander Nyßen from comment #24) > I now also re-created 3.6.0, 3.6.1, 3.6.2, 3.7.0, 3.7.1, and 3.7.2 by means > of tycho and adjusted the category. The site should now be clean. Yes indeed, it works now for GEF. Thank you. I have the same problems with webtools, maybe thay migrate also. Ok, as the jobs on the shared instance have been removed and everything seems to be appropriate now, resolving this as fixed. |