Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 427123

Summary: [publisher] Stale profile files in org.eclipse.equinox.p2.publisher
Product: [Eclipse Project] Equinox Reporter: Tobias Oberlies <t-oberlies>
Component: p2Assignee: Tobias Oberlies <t-oberlies>
Status: RESOLVED FIXED QA Contact:
Severity: major    
Priority: P3 CC: david_williams, irbull, tjwatson
Version: unspecified   
Target Milestone: Mars M4   
Hardware: All   
OS: All   
Whiteboard:
Bug Depends on:    
Bug Blocks: 250003, 386013, 426841, 437923    

Description Tobias Oberlies CLA 2014-01-31 09:13:57 EST
The org.eclipse.equinox.p2.publisher bundle includes copies of the execution environment profile files. These files tend to become outdated and cause extra efforts (see bug 250003, bug 386013, bug 426841, ... and more to come).

So we should should either be delete the copies and be dynamically look up the profiles org.eclipse.osgi bundle instead (see e.g. [1]), or automatically copy them from the org.eclipse.osgi bundle during the build.

[1] http://git.eclipse.org/c/tycho/org.eclipse.tycho.git/tree/tycho-core/src/main/java/org/eclipse/tycho/core/ee/ExecutionEnvironmentUtils.java#n117
Comment 1 Tobias Oberlies CLA 2014-07-04 05:33:09 EDT
As predicted, the org.eclipse.equinox.p2.publisher yet again has a stale list of profile files: It is missing the new compact profiles.

This copying nonsense has to stop - the publisher really should just take the profiles from org.eclipse.osgi, like everybody else (see e.g. [1])

[1] http://git.eclipse.org/c/tycho/org.eclipse.tycho.git/tree/tycho-core/src/main/java/org/eclipse/tycho/core/ee/ExecutionEnvironmentUtils.java
Comment 2 Tobias Oberlies CLA 2014-09-04 06:12:58 EDT
As a temporary workaround, I've copied the profile files again. This change has been pushed to master and R4_4_maintenance, so it should be included in 4.4 SR1.
Comment 3 Tobias Oberlies CLA 2014-09-04 07:40:52 EDT
Proposed a change to fix the root cause: https://git.eclipse.org/r/#/c/32850/

This change shall only be submitted to master.
Comment 4 Thomas Watson CLA 2014-09-10 15:52:34 EDT
This change is being included in our RC4 build and there was no notification to the platform releng list or the dev lists.  Was it really the intention to include this change right at the last build for SR1?  Are we certain the change will not introduce some regression at this point?  Is someone going to do the necessary p2 testing to make sure SR1 is ready?  Up to this point no changes had been done in p2 for SR1.
Comment 5 Ian Bull CLA 2014-09-10 22:36:55 EDT
I've reverted d38c783 [1]. Since we are into RC4 and there was no review or announcment about this change, the end-game rules won't allow this.

[1] http://git.eclipse.org/c/equinox/rt.equinox.p2.git/commit/?h=R4_4_maintenance&id=5dda21273e2d03169883b0b9d15cdc5eef0451c5
Comment 6 Tobias Oberlies CLA 2014-09-11 07:59:24 EDT
(In reply to comment #4)
> Was it really the intention to include this change right at the last build for SR1?
No, I simply didn't manage to do it earlier.

> Are we certain the change will not introduce some regression at this point?
> Is someone going to do the necessary p2 testing to make sure SR1 is ready?
The automatic tests passed [1], and manual tests with Tycho using the changed publisher bundle also passed.

(In reply to comment #5)
> Since we are into RC4 and there was no review or announcement about this 
> change, the end-game rules won't allow this.

Do you have a link to a wiki page with these rules? AFAIK, there is no developer's guide for p2.

[1] https://hudson.eclipse.org/p2/job/p2-maintenance/1/
Comment 7 Thomas Watson CLA 2014-09-11 10:11:44 EDT
(In reply to Tobias Oberlies from comment #6)
> (In reply to comment #4)
> > Was it really the intention to include this change right at the last build for SR1?
> No, I simply didn't manage to do it earlier.
> 
> > Are we certain the change will not introduce some regression at this point?
> > Is someone going to do the necessary p2 testing to make sure SR1 is ready?
> The automatic tests passed [1], and manual tests with Tycho using the
> changed publisher bundle also passed.
> 
> (In reply to comment #5)
> > Since we are into RC4 and there was no review or announcement about this 
> > change, the end-game rules won't allow this.
> 
> Do you have a link to a wiki page with these rules? AFAIK, there is no
> developer's guide for p2.
> 
> [1] https://hudson.eclipse.org/p2/job/p2-maintenance/1/

Sorry for the confusing Tobias.  Since Equinox builds and releases closely with the Eclipse project we also use the Eclipse project rampdown plan:

http://www.eclipse.org/eclipse/development/plans/freeze_plan_4_3_1.php

I do think it is good to get these profiles updated in p2 and I appreciate the work you have done here, but it is too late for SR1 at this point.  Lets plan to do this for SR2.
Comment 8 Tobias Oberlies CLA 2014-09-11 11:19:38 EDT
(In reply to comment #7)
> I do think it is good to get these profiles updated in p2 and I appreciate the
> work you have done here, but it is too late for SR1 at this point.  Lets plan to
> do this for SR2.
Given that we missed SR1, we are probably going for Mars M2 in the next Tycho milestone release. So we don't need to do anything for SR2.

@Thomas: What do you think of the proposal of deleting the redundant copies of the profile files [1]? I'm tired of running into the problem that they are outdated again and again.

[1] https://git.eclipse.org/r/#/c/32850/
Comment 9 Thomas Watson CLA 2014-09-11 13:06:36 EDT
(In reply to Tobias Oberlies from comment #8)
> (In reply to comment #7)
> > I do think it is good to get these profiles updated in p2 and I appreciate the
> > work you have done here, but it is too late for SR1 at this point.  Lets plan to
> > do this for SR2.
> Given that we missed SR1, we are probably going for Mars M2 in the next
> Tycho milestone release. So we don't need to do anything for SR2.
> 
> @Thomas: What do you think of the proposal of deleting the redundant copies
> of the profile files [1]? I'm tired of running into the problem that they
> are outdated again and again.
> 
> [1] https://git.eclipse.org/r/#/c/32850/

I think that is a good idea for Mars, but lets plan for M3?  You already updated the copies for M2.
Comment 10 Tobias Oberlies CLA 2014-10-24 10:55:27 EDT
(In reply to comment #9)
> I think that is a good idea for Mars, but lets plan for M3?
Hmm, M3 is almost over again.

So, to do the change in M4, do I simply wait until the end of next week (i.e. after M3+0) and submit the change then?
Comment 11 Thomas Watson CLA 2014-10-24 11:04:31 EDT
(In reply to Tobias Oberlies from comment #10)
> (In reply to comment #9)
> > I think that is a good idea for Mars, but lets plan for M3?
> Hmm, M3 is almost over again.
> 
> So, to do the change in M4, do I simply wait until the end of next week
> (i.e. after M3+0) and submit the change then?

Yeah, lets do this as soon as M3 is announced.  Should be end of next week.