Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 322441 - Are there any good mirrors with org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz ?
Summary: Are there any good mirrors with org.eclipse.jst.jsf.common.runtime.tests_1.1....
Status: RESOLVED WORKSFORME
Alias: None
Product: Equinox
Classification: Eclipse Project
Component: p2 (show other bugs)
Version: unspecified   Edit
Hardware: PC Linux
: P3 normal (vote)
Target Milestone: ---   Edit
Assignee: P2 Inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2010-08-11 17:38 EDT by Nick Boldt CLA
Modified: 2012-03-14 11:26 EDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Nick Boldt CLA 2010-08-11 17:38:27 EDT
I've been on and off trying to build against the WTP 3.2.0 or 3.2.1 repos for the past two days. Everything goes swimmingly until I hit this:

[INFO] Fetching org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz (3.65kB of 10.64kB at 0B/s) from http://mirrors.med.harvard.edu/eclipse//webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz
[INFO] Fetching org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz (0B of 10.64kB at 0B/s) from http://mirror.csclub.uwaterloo.ca/eclipse/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz
[INFO] Fetching org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz (0B of 10.64kB at 0B/s) from http://mirror.cc.columbia.edu/pub/software/eclipse/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz
[INFO] Fetching org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz (0B of 10.64kB at 0B/s) from http://mirror.cs.rit.edu/mirrors/eclipse/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz
[INFO] Fetching org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz (4kB of 10.64kB at 0B/s) from http://eclipse.a3-system.be/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz
...

whereupon the provisioning operation stalls entirely and loops, trying numerous mirrors to no avail.

I've checked if this file is on the download.eclipse.org server, and it is:

$ cd ~/downloads/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/; find . -name org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

./plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

Given this affects at least 5 mirrors, I have to wonder what's gone wrong w/ the mirror selection script on www.eclipse.org...
Comment 1 Denis Roy CLA 2010-08-11 22:20:04 EDT
With wget I have no problems fetching that file from all five of those mirrors.
Comment 2 David Williams CLA 2010-08-11 22:53:08 EDT
I'm moving this to p2. I've noticed similar things (on other jars, at varying times) where p2 seems to get "stuck" due to "bad mirrors". So 

1) the mirrors don't seem bad (maybe offline for a short time, but so many? all at once? and 

2) even if a mirror or a gz file is "bad", p2 is supposed to recover and get the next good mirror, or jar instead of gz. 

So, I'm thinking some "retry loop" in p2 isn't quite right?
Comment 3 Nick Boldt CLA 2010-08-12 11:56:42 EDT
More mirrors apparently failing:

http://carroll.aset.psu.edu/pub/eclipse/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

http://ftp.kaist.ac.kr/eclipse/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

http://ftp.yz.yamagata-u.ac.jp/pub/eclipse//webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

http://ftp.sh.cvut.cz/MIRRORS/eclipse/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

http://linorg.usp.br/eclipse/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

http://www.rcp-vision.com/eclipse/eclipseMirror/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

http://eclipse.i-logic.hu/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

http://ftp.man.poznan.pl/eclipse/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

http://ftp-stud.fht-esslingen.de/pub/Mirrors/eclipse/webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

http://ftp.heanet.ie/pub/eclipse//webtools/downloads/drops/R3.2.0/R-3.2.0-20100615235519/repository/plugins/org.eclipse.jst.jsf.common.runtime.tests_1.1.0.v20100524.jar.pack.gz

Seems odd that Tycho calling p2 would attempt all these different countries and still fail to fetch this file. Is it possible the metadata describing this file is corrupt? Or maybe it's a pack200 problem in that p2 can't unpack the jar using OpenJDK6 ?
Comment 4 David Williams CLA 2010-08-12 12:14:25 EDT
I can click on one of those mirror URLs and it downloads the file (I used last in list) and IBM JRE 6.0.8 unpacks it ... didn't try OpenJDK6.
Comment 5 Denis Roy CLA 2010-08-12 13:09:13 EDT
Nick, are you able to download those files from a web browser, or wget?  I just tried all 10 of them, and I got a 10,895 byte file from each.

I'm just trying to eliminate the possibility of bad mirrors.
Comment 6 David Williams CLA 2012-02-24 12:25:03 EST
Just noticed this pretty old, open bug, with no activity ... should we close as "worksforme"? Or, "won't fix"?
Comment 7 David Williams CLA 2012-02-27 12:54:20 EST
I think this is no longer an issue, please reopen if I have misunderstood.
Comment 8 Nick Boldt CLA 2012-03-14 11:26:12 EDT
FWIW, I now use p2.mirror to generate my own mirror of the various eclipse.org bits we need for building, eg., http://download.jboss.org/jbosstools/updates/requirements/webtools/

Often the mirroring will fail somewhere along the line, but after 1 or 2 respins of my script, I always end up with a working site.

This way I'm never in a situation where some obscure mirror is out of date, offline, or incomplete, and can rely on our own copy when building. (The added bonus too is that the mirrors can be located on the same NFS-mounted disk as the Jenkins slave, so it's also a lot faster to read the metadata.)