Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 365354

Summary: Adopt new orbit and Jetty builds
Product: [Eclipse Project] Platform Reporter: John Arthorne <john.arthorne>
Component: RelengAssignee: Kim Moir <kim.moir>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: P3 CC: daniel_megert, david_williams, gunnar, hmalphettes, jesse.mcconnell, kim.moir, sja.eclipse, tjwatson
Version: 4.1   
Target Milestone: 3.8 M4   
Hardware: PC   
OS: Windows 7   
Whiteboard:
Attachments:
Description Flags
patch for master equinox and sdk features (still in cvs) none

Description John Arthorne CLA 2011-12-01 14:23:55 EST
We need to consume a new orbit build to get the fix for bug 360245. It looks like Orbit build I20111201180206 passed. First we need it to be promoted to a stable orbit build, right?
Comment 1 Kim Moir CLA 2011-12-01 14:44:42 EST
It would be preferable to be a stable build as integration builds are often deleted which causes build breakage.
Comment 2 David Williams CLA 2011-12-01 14:59:10 EST
The "candidate" for the stable build, which has the new javax.servlet in it, has been promoted to 

http://download.eclipse.org/tools/orbit/downloads/drops/I20111201180206/

I'll rename this (or subsequent I build) to S build on Friday afternoon. So should be ready (mirrored) in time for next weeks builds. 

I'd be nice if someone could "test" this I-build version in runtime targets, or similar, as a quick sanity check ... but, I know, Kim, there are issues with using it in a build (need to wait till it mirrors, URL will change soon, etc.) so I'm not suggesting that ... I'm just saying its there.
Comment 3 John Arthorne CLA 2011-12-01 17:07:58 EST
According to Tom (bug 309529 comment 46), we also need a new Jetty. We can use this bug to track both since they need to be coordinated. Tom can you let us known if/when/where a new Jetty build is available with the fixed range on javax.servlet?
Comment 4 Thomas Watson CLA 2011-12-01 17:17:24 EST
(In reply to comment #3)
> According to Tom (bug 309529 comment 46), we also need a new Jetty. We can use
> this bug to track both since they need to be coordinated. Tom can you let us
> known if/when/where a new Jetty build is available with the fixed range on
> javax.servlet?

Jesse, let us know when you have a jetty version that uses the new 2.6 package versions of javax.servlet.  Thanks.
Comment 5 John Arthorne CLA 2011-12-01 17:18:34 EST
(In reply to comment #2)
> I'd be nice if someone could "test" this I-build version in runtime targets, or
> similar, as a quick sanity check ... but, I know, Kim, there are issues with
> using it in a build (need to wait till it mirrors, URL will change soon, etc.)
> so I'm not suggesting that ... I'm just saying its there.

I did quickly look at the javax.servlet bundle in this build, and confirmed the package version was correctly moved backwards to 2.6.
Comment 6 Jesse McConnell CLA 2011-12-01 17:41:25 EST
that will likely be a little while, I am trying to get our bundles smacked around for the latest release candidate as it is...

once I have this working we can look at making those changes in jetty 8 and rolling another RC
Comment 7 Jesse McConnell CLA 2011-12-01 17:43:46 EST
btw, when do you expect to have these?
Comment 8 Thomas Watson CLA 2011-12-01 17:47:19 EST
(In reply to comment #7)
> btw, when do you expect to have these?

Unfortunately we need them very soon so we can update to the M4 stable orbit build for our Juno M4 build which needs to be finalized by the end of next week.
Comment 9 Jesse McConnell CLA 2011-12-01 17:50:03 EST
ok, i just need to beat hudson into submission and get a clean build again for this stuff and then I can look at getting an RC1 out with those changes.  I'll shoot for tomorrow or early next week
Comment 10 Kim Moir CLA 2011-12-01 17:50:48 EST
Monday would be ideal. Our builds toward 3.8M4 actually start tomorrow but Monday is the day that we build our candidate that the teams test on Tuesday.
Comment 11 Jesse McConnell CLA 2011-12-01 17:52:14 EST
ok, I'll see what I can do
Comment 12 Thomas Watson CLA 2011-12-02 09:43:22 EST
(In reply to comment #11)
> ok, I'll see what I can do

Thanks Jesse (and Hugues!).  See bug360245 comment 38 and bug360245 comment 39.  There is a new 8.1 snapshot we could use for a test build, but I think the jetty team will get us a more official build (by Monday?).

Also note that I found a potential breaking change in the jetty 8.1 snapshot build.  We can react to the change, but I am not sure if this was intentional break by the jetty team or not.
Comment 13 Jesse McConnell CLA 2011-12-02 10:13:05 EST
it was planned, though a but unfortunate, part of the reason for 8.1 as opposed to 8.0.6

I am trying to get a jetty8 p2 repo built through our normal mechanism but its proving problematic, there is some bad zip file being pulled that kills the process atm.  

if we can get that fixed I'll be rolling an RC1 for you guys
Comment 14 Thomas Watson CLA 2011-12-02 10:28:28 EST
I released a couple more fixes to react to the package version change for javax.servlet (http://git.eclipse.org/c/equinox/rt.equinox.bundles.git/commit/?id=99045c57555e484066bb0caa6d9a9ffbf1d52f7f).

I imagine we will be picking up all the latest versions of the orbit bundles but the following MUST all be in sync and from the latest orbit build:

javax.servlet.jsp
javax.servlet
org.apache.jasper.glassfish

Kim, I am ready for a test build using the jetty snapshot at:

http://download.eclipse.org/jetty/updates/jetty-bundles-8.x/8.1.0.SNAPSHOT/

Since the version of jetty moved to 8.1.0 do we need to go through and update all of our features?
Comment 15 Thomas Watson CLA 2011-12-02 10:31:04 EST
(In reply to comment #14)
> Since the version of jetty moved to 8.1.0 do we need to go through and update
> all of our features?

To answer my own question, I don't think so because we use open versions (0.0.0) to include the jetty bundles in our features.
Comment 16 Kim Moir CLA 2011-12-02 10:43:46 EST
The build.properties for some of the features currently specify 8.0.4.qualifier to include the jetty source bundles.  I'll fix this.
Comment 17 Kim Moir CLA 2011-12-02 11:39:59 EST
Created attachment 207850 [details]
patch for master equinox and sdk features (still in cvs)

commit to update maps

http://git.eclipse.org/c/platform/eclipse.platform.releng.maps.git/commit/?id=e686380c2dca8f28c14e309fe60c17ad8a187429
Comment 18 Kim Moir CLA 2011-12-02 17:14:52 EST
Test build seems to be proceeding, I have tagged the master-equinox and sdk features for Sunday's integration build.  I'll the update the remaining bundles in the Orbit map on Monday.
Comment 19 Thomas Watson CLA 2011-12-02 17:23:44 EST
(In reply to comment #18)
> Test build seems to be proceeding, I have tagged the master-equinox and sdk
> features for Sunday's integration build.  I'll the update the remaining bundles
> in the Orbit map on Monday.

I have also released my changes to the integration branch for the build.  Thanks Kim.
Comment 20 Dani Megert CLA 2011-12-05 09:50:55 EST
NOTE: You must also update the version numbers in /org.eclipse.platform.doc.isv/platformOptions.txt to avoid Javadoc generation breakage.
Comment 22 Kim Moir CLA 2011-12-05 15:29:18 EST
Jesse, when can we expect non-snapshot bundles that we can consume them for our milestone?
Comment 23 Thomas Watson CLA 2011-12-06 09:30:39 EST
CC'ing Hugues, Please see comment 22.
Comment 24 Hugues Malphettes CLA 2011-12-06 23:15:13 EST
Tom, Jesse took care of building it.
Sorry for the delay.
Comment 25 Kim Moir CLA 2011-12-07 11:02:07 EST
Jesse/Hugues

Noticed that the qualifier is "RC0", in earlier builds it was a number.  Is there a plan to change this?
Comment 26 Jesse McConnell CLA 2011-12-07 11:07:33 EST
It should be RC1 for what I gave you...

but this was a release candidate, we'll be pushing out a proper 7.6.0.v201112## release within a week or three

jesse
Comment 27 Kim Moir CLA 2011-12-07 11:18:22 EST
Yes, I meant RC1 :-) Thanks for the clarification.  I expect we'll update the to the release once it's available.
Comment 28 Kim Moir CLA 2011-12-07 15:37:46 EST
Closing.
Comment 29 Kim Moir CLA 2011-12-07 21:10:35 EST
Having problems building with the new bundles, reopening.
Comment 30 Jesse McConnell CLA 2011-12-08 08:51:34 EST
what sort of issues?
Comment 31 Thomas Watson CLA 2011-12-08 09:40:50 EST
(In reply to comment #30)
> what sort of issues?

During our build we run the p2.director and getting this error:

Cannot satisfy dependency: 
From: Eclipse SDK 3.8.0.I20111207-1435 (org.eclipse.sdk.ide 3.8.0.I20111207-1435) 
To: org.eclipse.sdk.feature.group [3.8.0.v20111207-7Q83A7DQK3C2g8rs0qFpVANXGlm1_h-c5UeJAKeIj4NVL] 
[p2.director] Cannot complete the install because one or more required items could not be found. 
[p2.director] Software being installed: Eclipse SDK 3.8.0.I20111207-1435 (org.eclipse.sdk.ide 3.8.0.I20111207-1435) 
[p2.director] Missing requirement: Jetty Http Service 3.0.0.v20111202-1436 (org.eclipse.equinox.http.jetty 3.0.0.v20111202-1436) requires 'package org.eclipse.jetty.http [8.0.0,9.0.0)' but it could not be found 

This does not make sense because the bundle org.eclipse.jetty.http does export that package at version 8.1.0.  So far I don't think it is an issue with jetty 8.1 RC1 bundles.
Comment 32 Kim Moir CLA 2011-12-08 10:16:42 EST
I'm running a test I build now with a totally clean repo with the hypothesis that a bundle a previous build is causing problems.  We discard bundles with the same name, version and qualifier if they exist in a previous build to ensure that the bundles installed via update are the same as the ones installed via a zip.
Comment 33 Dani Megert CLA 2011-12-09 06:18:28 EST
(In reply to comment #20)
> NOTE: You must also update the version numbers in
> /org.eclipse.platform.doc.isv/platformOptions.txt to avoid Javadoc generation
> breakage.

Looks like this did not happen: we have Javadoc issues in our latest M4 candidate build:
http://download.eclipse.org/eclipse/downloads/drops/I20111208-1305/compilelogs/platform.doc.isv.javadoc.txt
Comment 34 Thomas Watson CLA 2011-12-09 09:24:59 EST
FYI, I did an upgrade from the 3.8 build I20111205-1800 (which included jetty SNAPSHOT bundles) to the I20111208-1305 build and confirmed the new jetty RC1 bundles are now used.  So it did perform the downgrade properly since RC1 < SNAPSHOT.

(In reply to comment #33)
> (In reply to comment #20)
> > NOTE: You must also update the version numbers in
> > /org.eclipse.platform.doc.isv/platformOptions.txt to avoid Javadoc generation
> > breakage.
> 
> Looks like this did not happen: we have Javadoc issues in our latest M4
> candidate build:
> http://download.eclipse.org/eclipse/downloads/drops/I20111208-1305/compilelogs/platform.doc.isv.javadoc.txt

Sorry about that, I was not sure who should update that file or what actually needs updated, I will look into what is needed and get this done if we have a respin.
Comment 35 Thomas Watson CLA 2011-12-09 09:38:04 EST
I fixed this with commit:

http://git.eclipse.org/c/platform/eclipse.platform.common.git/commit/?id=2106ccca51759d4716c09658245c5bd041f52b01

Although I think I may have caused an issue for the build since I released in the middle of the respin build which was going on when I pushed my change.
Comment 36 Kim Moir CLA 2011-12-09 09:43:50 EST
I restarted the build to include this fix.
Comment 37 Kim Moir CLA 2011-12-13 16:52:42 EST
Fixed.