Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 479304

Summary: Mirrors for recommenders.incubator/privacy/updates/milestones server inconsistent data
Product: Community Reporter: Andreas Sewe <sewe>
Component: ServersAssignee: Eclipse Webmaster <webmaster>
Status: RESOLVED INVALID QA Contact:
Severity: normal    
Priority: P3 CC: denis.roy
Version: unspecified   
Target Milestone: ---   
Hardware: All   
OS: All   
See Also: https://git.eclipse.org/r/57718
https://git.eclipse.org/c/recommenders.incubator/org.eclipse.recommenders.privacy.git/commit/?id=a35e2c195bcaf574f90c6c7a2ace7cece1bd7259
https://git.eclipse.org/r/57721
https://git.eclipse.org/c/recommenders.incubator/org.eclipse.recommenders.stats.git/commit/?id=2b34dfdcf8d3f03ca472fe060840c59f2fb552b3
https://git.eclipse.org/r/57726
https://git.eclipse.org/c/recommenders.incubator/org.eclipse.recommenders.snipmatch.git/commit/?id=848b3c520832b970434814b18b8534fb5e5c5371
Whiteboard:

Description Andreas Sewe CLA 2015-10-08 03:20:28 EDT
Hi Webmaster,

we (Code Recommenders) frequently observe that one of our update sites is not mirrored correctly, which manifests itself in build failures like the following two:

[ERROR] An error occurred while transferring artifact packed: osgi.bundle,org.eclipse.recommenders.privacy.rcp,0.2.0.v20150708-1345 from repository http://download.eclipse.org/recommenders.incubator/privacy/updates/milestones:
[ERROR]    Retry another mirror:
[ERROR]       Artifact not found: http://eclipse.c3sl.ufpr.br/recommenders/updates/milestones/plugins/org.eclipse.recommenders.privacy.rcp_0.2.0.v20150708-1345.jar.pack.gz.
[ERROR] Internal error: org.eclipse.tycho.repository.local.MirroringArtifactProvider$MirroringFailedException: Could not mirror artifact osgi.bundle,org.eclipse.recommenders.privacy.rcp,0.2.0.v20150708-1345 into the local Maven repository.See log output for details. http://eclipse.c3sl.ufpr.br/recommenders/updates/milestones/plugins/org.eclipse.recommenders.privacy.rcp_0.2.0.v20150708-1345.jar.pack.gz -> [Help 1]

[ERROR] An error occurred while transferring artifact packed: osgi.bundle,com.ibm.icu.base,52.1.1.v201501240615 from repository http://download.eclipse.org/recommenders.incubator/privacy/updates/milestones:
[ERROR]    Retry another mirror:
[ERROR]       Artifact not found: http://ftp.fau.de/eclipse/recommenders/updates/milestones/plugins/com.ibm.icu.base_52.1.1.v201501240615.jar.pack.gz.
[ERROR] Internal error: org.eclipse.tycho.repository.local.MirroringArtifactProvider$MirroringFailedException: Could not mirror artifact osgi.bundle,com.ibm.icu.base,52.1.1.v201501240615 into the local Maven repository.See log output for details. http://ftp.fau.de/eclipse/recommenders/updates/milestones/plugins/com.ibm.icu.base_52.1.1.v201501240615.jar.pack.gz -> [Help 1]

As you can see, multiple mirrors (eclipse.c3sl.ufpr.br, ftp.fau.de) are affected.

Can you retrigger mirror synchronization? Thank you.

FWIW, the contents of our update site haven't changed in weeks.
Comment 1 Denis Roy CLA 2015-10-08 09:58:45 EDT
> http://eclipse.c3sl.ufpr.br/recommenders/updates/milestones/plugins/org.
> eclipse.recommenders.privacy.rcp_0.2.0.v20150708-1345.jar.pack.gz.


Our mirroring infra reports that that file is no longer available:
https://www.eclipse.org/downloads/download.php?file=/recommenders/updates/milestones/plugins/org.eclipse.recommenders.privacy.rcp_0.2.0.v20150708-1345.jar.pack.gz

Not on our download server either:
http://download.eclipse.org/recommenders/updates/milestones/plugins/org.eclipse.recommenders.privacy.rcp_0.2.0.v20150708-1345.jar.pack.gz

Mirrors: 1   Recommenders: 0






> http://ftp.fau.de/eclipse/recommenders/updates/milestones/plugins/com.ibm.
> icu.base_52.1.1.v201501240615.jar.pack.gz.

That file is also reporting as no longer available:
https://www.eclipse.org/downloads/download.php?file=/recommenders/updates/milestones/plugins/com.ibm.icu.base_52.1.1.v201501240615.jar.pack.gz

Not on the download server either:
http://download.eclipse.org/recommenders/updates/milestones/plugins/com.ibm.icu.base_52.1.1.v201501240615.jar.pack.gz

Mirrors: 2   Recommenders: 0



> As you can see, multiple mirrors (eclipse.c3sl.ufpr.br, ftp.fau.de) are
> affected.

As you can see, mirrors seem to be in perfect sync with the home base.

 
> Can you retrigger mirror synchronization? Thank you.

We don't push to mirrors, mirrors pull from us using the RSYNC protocol.


Reopen if I'm missing something -- but I think mirrors are OK.
Comment 2 Andreas Sewe CLA 2015-10-08 10:11:04 EDT
(In reply to Denis Roy from comment #1)
> Reopen if I'm missing something -- but I think mirrors are OK.

The last successful promotion, which copied files into was [1].

  /org.eclipse.recommenders.privacy.rcp_0.2.0.v20150708-1345.jar.pack.gz' -> `/home/data/httpd/download.eclipse.org/recommenders.incubator/privacy/updates/milestones/plugins/org.eclipse.recommenders.privacy.rcp_0.2.0.v20150708-1345.jar.pack.gz'
/com.ibm.icu.base_52.1.1.v201501240615.jar.pack.gz' -> `/home/data/httpd/download.eclipse.org/recommenders.incubator/privacy/updates/milestones/plugins/com.ibm.icu.base_52.1.1.v201501240615.jar.pack.gz'

But it looks like our mirror URL is wrong:

[ERROR] An error occurred while transferring artifact packed: osgi.bundle,org.eclipse.recommenders.privacy.rcp,0.2.0.v20150708-1345 from repository http://download.eclipse.org/recommenders.incubator/privacy/updates/milestones:
[ERROR]    Retry another mirror:
[ERROR]       Artifact not found: http://eclipse.c3sl.ufpr.br/recommenders/updates/milestones/plugins/org.eclipse.recommenders.privacy.rcp_0.2.0.v20150708-1345.jar.pack.gz.

I'll have to check this.

Thanks for your time.

[1] <https://hudson.eclipse.org/recommenders/job/org.eclipse.recommenders.privacy/186/promotion/milestones/lastSuccessful/>
Comment 3 Eclipse Genie CLA 2015-10-08 10:41:10 EDT
New Gerrit change created: https://git.eclipse.org/r/57718
Comment 5 Eclipse Genie CLA 2015-10-08 11:25:53 EDT
New Gerrit change created: https://git.eclipse.org/r/57721
Comment 7 Eclipse Genie CLA 2015-10-08 12:28:12 EDT
New Gerrit change created: https://git.eclipse.org/r/57726