Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 331301 - Updating from nightly build fails with MD5 error
Summary: Updating from nightly build fails with MD5 error
Status: CLOSED FIXED
Alias: None
Product: EGit
Classification: Technology
Component: Core (show other bugs)
Version: unspecified   Edit
Hardware: PC Windows 7
: P3 normal (vote)
Target Milestone: ---   Edit
Assignee: Matthias Sohn CLA
QA Contact:
URL:
Whiteboard:
Keywords:
: 336569 339939 351847 (view as bug list)
Depends on:
Blocks:
 
Reported: 2010-11-29 03:59 EST by Philipp Thun CLA
Modified: 2011-08-23 06:50 EDT (History)
19 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Philipp Thun CLA 2010-11-29 03:59:01 EST
Build Identifier: 20100917-0705

I am unable to update EGit and JGit using the update site pointing to the nightly build results (http://download.eclipse.org/egit/updates-nightly). Updates worked fine last week, but today I am receiving the following error:

An error occurred while collecting items to be installed
session context was:(profile=epp.package.java, phase=org.eclipse.equinox.internal.p2.engine.phases.Collect, operand=, action=).
Problems downloading artifact: osgi.bundle,org.eclipse.egit.doc,0.10.0.201011282113.
MD5 hash is not as expected. Expected: 322ee1e1b581ea44bc381691aaad7e8e and found 31a90fdac97b37998f3a14278b890338.

Reproducible: Always

Steps to Reproduce:
1. Help -> Check for Updates
Comment 1 Matthias Sohn CLA 2010-11-29 04:20:29 EST
See the discussion thread on the egit list [1]
Could you try to re-install egit ?

[1] http://dev.eclipse.org/mhonarc/lists/egit-dev/msg01630.html
Comment 2 Philipp Thun CLA 2010-11-29 06:56:44 EST
I have uninstalled EGit and JGit and then tried to re-install them - unfortunately the same error came up. The next thing I tried was adding "-Declipse.p2.mirrors=false" to the eclipse.ini file and restarting Eclipse, but this didn't help either.
Comment 3 Philipp Thun CLA 2010-12-01 04:37:20 EST
I have now somehow managed to workaround this issue by specifying the VM parameter mentioned above and also deleting the "cache" folders from /eclipse/p2/org.eclipse.equinox.p2.core and /eclipse/p2/org.eclipse.equinox.p2.repository before restarting Eclipse.
Comment 4 François Rey CLA 2010-12-08 13:17:26 EST
Sounds like this bug is more related to p2. However this happens a lot with eGit.
In fact I have not seen it with another bundle yet since migrating to 3.6.
Any idea why?
eGit is actively developed and snapshots get updated almost every day, so statistically there's more p2 activity with eGit in my case.
But then seeing this only with eGit and having the bug reported against it makes me feel like there might be something else at play in the case of eGit.
Any idea what?

Usually when I get this error I just wait a few hours or the next day and then it works.
Right now I just tried to remove caches as explained above. It did not help.
I had to also add -Declipse.p2.mirrors=false to my eclipse.ini file to make it work.
Comment 5 Chris Aniszczyk CLA 2010-12-08 14:22:16 EST
This probably happens when our nighties fail and get syndicated every three hours. I appreciate you trying out our nightlies ;)

I'll see if we can do a bit better regarding our release engineering.
Comment 6 François Rey CLA 2010-12-08 14:30:01 EST
And I appreciate your tryings.
Just one question:
Was there a syndication sync between the time of my previous post and say 30mn before? My last post explained what I did in that time (plus other things too, eclipse update was a backgroung task).
Comment 7 Mathias Kinzler CLA 2011-02-03 03:24:52 EST
(In reply to comment #3)
> I have now somehow managed to workaround this issue by specifying the VM
> parameter mentioned above and also deleting the "cache" folders from
> /eclipse/p2/org.eclipse.equinox.p2.core and
> /eclipse/p2/org.eclipse.equinox.p2.repository before restarting Eclipse.

I was not successful with this (and also not with the setting in comment #2). Seems to be something else.
Comment 8 Mathias Kinzler CLA 2011-02-09 05:46:02 EST
*** Bug 336569 has been marked as a duplicate of this bug. ***
Comment 9 Mathias Kinzler CLA 2011-03-18 07:12:29 EDT
*** Bug 339939 has been marked as a duplicate of this bug. ***
Comment 10 David Carver CLA 2011-03-18 10:12:58 EDT
(In reply to comment #5)
> This probably happens when our nighties fail and get syndicated every three
> hours. I appreciate you trying out our nightlies ;)
> 
> I'll see if we can do a bit better regarding our release engineering.

Chris probably best to only push a nightly if it is successful, so you probably only want to grab artifacts from the last successfull build.  You can get those artifacts through this link:

https://hudson.eclipse.org/hudson/view/Tycho%20+%20Maven/job/egit/lastSuccessfulBuild/
Comment 11 David Carver CLA 2011-03-18 10:21:01 EDT
In the mean time for those that need or want the last Successfull nightly build:

https://hudson.eclipse.org/hudson/view/Tycho%20+%20Maven/job/egit/1136/artifact/org.eclipse.egit-updatesite/target/site/

Replace the %20 with a space otherwise the Install New Software dialog will incorrectly tell you it can't find a P2 repo.
Comment 12 Ken Gilmer CLA 2011-04-06 03:46:49 EDT
FWIW this is happening to me as well as of 4/6/11.  

Build id: 20110301-1815 on Ubuntu 10.10.

Exact error:
An error occurred while collecting items to be installed
session context was:(profile=epp.package.java, phase=org.eclipse.equinox.internal.p2.engine.phases.Collect, operand=, action=).
Problems downloading artifact: osgi.bundle,org.eclipse.egit.doc,0.12.0.201104051951.
MD5 hash is not as expected. Expected: a876a5ca59972962ff415df9fee21f06 and found a8487ac05cc2f51017fd796752e3998c.

For the lazy who don't want to edit the URL, here is the correct one:

https://hudson.eclipse.org/hudson/view/Tycho + Maven/job/egit/lastSuccessfulBuild/artifact/org.eclipse.egit-updatesite/target/site/
Comment 13 Remy Suen CLA 2011-07-12 12:47:44 EDT
*** Bug 351847 has been marked as a duplicate of this bug. ***
Comment 14 Paul Webster CLA 2011-07-18 07:46:02 EDT
I've tried the hudson URL mentioned in this bug, and even that gives me an invalid EGit archive:

Installing org.eclipse.egit.feature.group 1.1.0.201107171612.
Installing org.eclipse.egit.source.feature.group 1.1.0.201107171612.
Installing org.eclipse.jgit.feature.group 1.1.0.201107141117.
Installing org.eclipse.jgit.source.feature.group 1.1.0.201107141117.
Installing org.eclipse.egit.fetchfactory.feature.group 0.10.0.201011091645.
Installing org.eclipse.releng.tools.feature.group 3.4.100.v20110503-45-7w31221634.
Installation failed.
An error occurred while collecting items to be installed
 session context was:(profile=SDKProfile, phase=org.eclipse.equinox.internal.p2.engine.phases.Collect, operand=, action=).
 Problems downloading artifact: org.eclipse.update.feature,org.eclipse.egit,1.1.0.201107171612.
  Downloaded stream not a valid archive. Check the server.


The command I used to install (the hudson repo is on one line :-)

eclipse/eclipse \
-application org.eclipse.equinox.p2.director \
-noSplash \
-repository \
http://download.eclipse.org/egit/pde/updates-nightly,\
"https://hudson.eclipse.org/hudson/view/Tycho + Maven/job/egit/lastSuccessfulBuild/artifact/org.eclipse.egit-updatesite/target/site",\
http://download.eclipse.org/eclipse/updates/3.8-I-builds \
-installIUs \
org.eclipse.egit.feature.group,\
org.eclipse.egit.source.feature.group,\
org.eclipse.jgit.feature.group,\
org.eclipse.jgit.source.feature.group,\
org.eclipse.egit.fetchfactory.feature.group,\
org.eclipse.releng.tools.feature.group
Comment 15 Paul Webster CLA 2011-07-18 07:47:00 EDT
(In reply to comment #14)
> I've tried the hudson URL mentioned in this bug, and even that gives me an
> invalid EGit archive:

It worked on a second pass.

PW
Comment 16 Steffen Pingel CLA 2011-07-19 16:22:21 EDT
I'm getting this annoying error frequently when updating from the nightly site. Using the Hudson site is not a good workaround since that often causes installs to fail due to I/O errors (comment#14). 

Anything we can do to help? For Mylyn we simply copy the produced artifacts directly to the download server, no magic cron job required.

An error occurred while collecting items to be installed
session context was:(profile=SDKProfile, phase=org.eclipse.equinox.internal.p2.engine.phases.Collect, operand=, action=).
Artifact not found: osgi.bundle,org.eclipse.egit,1.1.0.201107190912.
http://download.eclipse.org/egit/updates-nightly/plugins/org.eclipse.egit_1.1.0.201107190912.jar
Artifact not found: osgi.bundle,org.eclipse.egit.core,1.1.0.201107190912.
Comment 17 Steffen Pingel CLA 2011-07-27 09:39:53 EDT
After setting up jobs for Mylyn that relied on update sites generated by other Hudson jobs we started getting the same md5 problem for artifacts downloaded from hudson.eclipse.org. My suspicion is that hudson.eclipse.org sometimes corrupts files during upload. I have cc'd the webmaster since that might be caused by a problem with the Hudson server.

To fix that for Mylyn, I changed Hudson jobs to copy to dowload.eclipse.org and consume artifacts from there. Here are the steps to make the same change for EGit nightly builds:

Make the updates-nightly directory writeable for the hudsonUser by executing this command on build.eclipse.org:

 setfacl -m user:55011:rwx /home/data/httpd/download.eclipse.org/egit/updates-nightly/

Add an "Execute shell" step to the EGit build at https://hudson.eclipse.org/hudson/job/egit/configure :

 rm -rf /home/data/httpd/download.eclipse.org/egit/updates-nightly/*
 cp -r org.eclipse.egit-updatesite/target/site/* /home/data/httpd/download.eclipse.org/egit/updates-nightly/

The cron job that polls the Hudson job is then no longer required.
Comment 18 Benjamin Muskalla CLA 2011-07-28 10:00:52 EDT
Thanks Steffen for the input.
Passing this over to you Matthias as you've most knowledge about the current status of the build.
Comment 19 Matthias Sohn CLA 2011-08-02 07:16:57 EDT
We no longer use a scheduled script to copy the p2 repo, instead we use the eclipse-maven-signing-plugin to optimize, sign and copy the repo to the updates-nightly folder.

Currently the p2 repo is corrupt and can't be updated neither manually nor by hudson as there seems to be some problem with the file system (hit permission denied despite the fact I should have sufficient permissions). I contacted webmaster to get this solved. See bug 353539.
Comment 20 Matthias Sohn CLA 2011-08-10 03:45:24 EDT
Nightly build is working again, please retry.
Comment 21 Tomasz Zarna CLA 2011-08-10 05:42:18 EDT
(In reply to comment #20)
> Nightly build is working again, please retry.

Worked fine to me, successfully updated to EGit 1.1.0.201108091914 and JGit 1.1.0.201108091746.
Comment 22 Matthias Sohn CLA 2011-08-10 07:42:45 EDT
Tomasz could update so it seems the problem is gone
Comment 23 Steffen Pingel CLA 2011-08-17 09:34:20 EDT
It's not fixed for me:

An error occurred while collecting items to be installed
session context was:(profile=SDKProfile, phase=org.eclipse.equinox.internal.p2.engine.phases.Collect, operand=, action=).
Problems downloading artifact: osgi.bundle,org.eclipse.egit.doc,1.1.0.201108170819.
MD5 hash is not as expected. Expected: 3d0f624213a4c997b61ca07bb3ca1db7 and found a91de5f64ceb6eced9574bb84d804352.
Comment 24 James Blackburn CLA 2011-08-22 11:04:16 EDT
The nightly update site is failing for me with artifact not found:

An error occurred while collecting items to be installed
session context was:(profile=SDKProfile, phase=org.eclipse.equinox.internal.p2.engine.phases.Collect, operand=, action=).
Artifact not found: osgi.bundle,org.eclipse.egit.core,1.1.0.201108201824.
http://download.eclipse.org/egit/updates-nightly/plugins/org.eclipse.egit.core_1.1.0.201108201824.jar
Artifact not found: osgi.bundle,org.eclipse.egit.doc,1.1.0.201108201824.
http://download.eclipse.org/egit/updates-nightly/plugins/org.eclipse.egit.doc_1.1.0.201108201824.jar
Artifact not found: osgi.bundle,org.eclipse.egit.ui,1.1.0.201108201824.
http://download.eclipse.org/egit/updates-nightly/plugins/org.eclipse.egit.ui_1.1.0.201108201824.jar
Artifact not found: osgi.bundle,org.eclipse.egit,1.1.0.201108201824.
http://download.eclipse.org/egit/updates-nightly/plugins/org.eclipse.egit_1.1.0.201108201824.jar
Artifact not found: org.eclipse.update.feature,org.eclipse.egit,1.1.0.201108201824.
...
Comment 25 Matthias Sohn CLA 2011-08-23 05:28:45 EDT
Please try again, the Hudson user lost file system permissions to upload the nightly build results which corrupted the p2 repository at download.eclipse.org/egit/updates-nightly.
This was fixed yesterday. I just tested updating and it worked for me.
Comment 26 Tomasz Zarna CLA 2011-08-23 05:57:35 EDT
(In reply to comment #25)
> This was fixed yesterday. I just tested updating and it worked for me.

FWIW, it worked for me as well, updated to EGit	1.1.0.201108230343 and JGit	1.1.0.201108211817.
Comment 27 Matthias Sohn CLA 2011-08-23 06:50:54 EDT
fixed and verified