Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 329369

Summary: [releng] Specify mirrors in 4.1/e4 p2 repositories
Product: [Eclipse Project] e4 Reporter: Kim Moir <kim.moir>
Component: UIAssignee: Andrew Niefer <aniefer>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: P3 CC: Lars.Vogel, pwebster, remy.suen
Version: unspecified   
Target Milestone: 4.1 M4   
Hardware: PC   
OS: Windows XP   
Whiteboard:
Attachments:
Description Flags
patch none

Description Kim Moir CLA 2010-11-03 11:59:25 EDT
Mcq remarked in the arch call that Lars mentioned on twitter that it's much slower to install 4.1 versus installing from the Helios repository.  Looking at the 4.1-I-builds repository, it appears that mirroring is not specified in the child repos.  To enable mirroring in the artifacts.jar for the most recent 4.1 milestone, you would have to add the p2.mirrorsURL property

<?xml version='1.0' encoding='UTF-8'?>
<?artifactRepository version='1.1.0'?>
<repository name='&quot;Eclipse Project Test Site&quot;' type='org.eclipse.equinox.p2.artifact.repository.simpleRepository' version='1'>
  <properties size='4'>
    <property name='p2.compressed' value='true'/>
    <property name='p2.timestamp' value='1276012264986'/>
    <property name='publishPackFilesAsSiblings' value='true'/>
    <property name='p2.mirrorsURL' value='http://www.eclipse.org/downloads/download.php?file=/eclipse/updates/4.1-I-builds/20101029-1118&amp;format=xml'/>
  </properties>

The same also applies to the 0.11-I-builds repository with its appropriate url.

If the expectation is that you can install from the repos enabled in 4.1 (Helios, 4.1-I-builds, 0.11-I-builds) at similar speeds, mirroring will help.
Comment 1 Remy Suen CLA 2010-11-03 12:18:57 EDT
Will attempting to contact non-existent repositories cause any slowdowns? See bug 328923.
Comment 2 Andrew Niefer CLA 2010-11-04 17:23:45 EDT
Created attachment 182434 [details]
patch

Patch on the 4.1 builder.  We are using a template artifact repo as a "format" repo when mirroring the build results into the final composite location.

I did it this way instead of the site.xml mentioned in bug 276300 comment 10 because I think it would be good to also have the publishPackFilesAsSiblings=true
Comment 3 Andrew Niefer CLA 2010-11-04 18:16:28 EDT
This patch is in for the 4.1 repo.  I still need to do the e4 repo
Comment 4 Kim Moir CLA 2010-11-05 16:22:31 EDT
I just implemented it for my 3.7 builds as well.  As a sanity check, I looked at the mirror url and it appears that the integration build repositories for 3.7 and 4.1 aren't replicated to any mirrors.  (I didn't know this before, I assumed they were because they reside under eclipse/pdates).  

Here is the list of mirrors for 4.1
http://www.eclipse.org/downloads/download.php?file=/eclipse/updates/4.1-I-builds&amp;format=xml

But if you go to an individual mirror, for instance, at uwaterloo, you can see that none of the child repositories are included.
http://mirror.csclub.uwaterloo.ca/eclipse/eclipse/updates/4.1-I-builds/

I think this is because Denis has a regular expression in his mirroring script which excludes directories that start with [I,N,M]YYYYMMDD*.  Since we don't currently stats enabled on p2 repos (bug 313602), I'll have to talk to him re the cost versus benefit of renabling mirrors for i-build repos.
Comment 5 Andrew Niefer CLA 2010-11-05 17:17:45 EDT
I have released the equivalent for the e4 0.11-I-builds repository.

If mirrors don't actually have IBuilds, did we really want this?
Note now when promoting an I build to a stable milestone build, the artifacts.xml will need to be modified.
Comment 6 Kim Moir CLA 2010-11-05 17:37:03 EDT
I think we should talk to the webmasters about this.  The 4.1 team actually uses their I-builds repo for their milestones so perhaps it should be mirroed.  However, we don't have numbers on downloads because statistics aren't enabled for our repos.
Comment 7 Paul Webster CLA 2010-11-08 10:02:30 EST
(In reply to comment #5)
> I have released the equivalent for the e4 0.11-I-builds repository.
> 
> If mirrors don't actually have IBuilds, did we really want this?
> Note now when promoting an I build to a stable milestone build, the
> artifacts.xml will need to be modified.

we can create a milestone update site, and mirror the promoted I build to updates/4.1-milestones/S-4.1M3-whatever.  We just never got that far.

PW