Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 312597 - Eclipse project Hudson builds should invoke build with architecture appropriate vm
Summary: Eclipse project Hudson builds should invoke build with architecture appropria...
Status: RESOLVED FIXED
Alias: None
Product: Platform
Classification: Eclipse Project
Component: Releng (show other bugs)
Version: 3.6   Edit
Hardware: PC Linux
: P3 normal (vote)
Target Milestone: 3.7 M1   Edit
Assignee: Kim Moir CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2010-05-12 08:12 EDT by Paul Webster CLA
Modified: 2010-07-20 10:42 EDT (History)
4 users (show)

See Also:


Attachments
patch (8.50 KB, patch)
2010-05-13 13:49 EDT, Kim Moir CLA
no flags Details | Diff
patch (4.27 KB, patch)
2010-05-13 14:00 EDT, Kim Moir CLA
no flags Details | Diff
patch (1.93 KB, patch)
2010-05-26 10:09 EDT, Kim Moir CLA
no flags Details | Diff
patch to fix java15-home path (8.74 KB, patch)
2010-07-19 11:12 EDT, Kim Moir CLA
no flags Details | Diff
patch (17.18 KB, patch)
2010-07-19 17:54 EDT, Kim Moir CLA
no flags Details | Diff
patch (2.10 KB, patch)
2010-07-19 17:55 EDT, Kim Moir CLA
no flags Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Paul Webster CLA 2010-05-12 08:12:37 EDT
I bound https://build.eclipse.org/hudson/job/eclipse-e4-test/ to build2 and launched it.  It checked out the basebuilder/eclipsebuilder and then failed.

cvs checkout: Updating org.eclipse.releng.eclipsebuilder/test.framework
builderDir <https://build.eclipse.org/hudson/job/eclipse-e4-test/ws/builds/I201005120752>
recipients=
postingDirectory=<https://build.eclipse.org/hudson/job/eclipse-e4-test/66/artifact/builds/transfer/files/bogus/downloads/drops>
builderTag=v20100423
buildDirectory=<https://build.eclipse.org/hudson/job/eclipse-e4-test/ws/builds/I201005120752/src>
<https://build.eclipse.org/hudson/job/eclipse-e4-test/ws/org.eclipse.releng.eclipsebuilder/bootstrapHudsone4.sh>: line 229: /shared/common/ibm-java-ppc-605/jre/bin/java: cannot execute binary file
Build failed (error code 126).
Archiving artifacts


Kim, is this an error in our scripts as opposed to hudson?

PW
Comment 1 Kim Moir CLA 2010-05-12 08:23:05 EDT
Yes, it's an error in our scripts.  We should check for the architecture and invoke the build with the appropriate vm.
Comment 2 David Carver CLA 2010-05-12 10:27:46 EDT
(In reply to comment #1)
> Yes, it's an error in our scripts.  We should check for the architecture and
> invoke the build with the appropriate vm.

Yeah, I think Athena common builder may be running into some of this same issue as well.
Comment 3 Kim Moir CLA 2010-05-13 13:49:49 EDT
Created attachment 168425 [details]
patch
Comment 4 Kim Moir CLA 2010-05-13 14:00:15 EDT
Created attachment 168430 [details]
patch

build2 is actually x86_64 arch
Comment 5 Kim Moir CLA 2010-05-13 14:17:39 EDT
e4 build is running now on build2 with the correct vms.  It will be interesting to see how fast it runs :-)

https://build.eclipse.org/hudson/job/eclipse-e4-test/72/console
Comment 6 Paul Webster CLA 2010-05-13 14:44:21 EDT
It was relatively fast, but it failed:

https://build.eclipse.org/hudson/job/eclipse-e4-test/72/consoleText

/opt/users/hudsonbuild/workspace/eclipse-e4-test/builds/I201005131401/src/compile.master.xml:37: 
The following error occurred while executing this line:
/opt/users/hudsonbuild/workspace/eclipse-e4-test/builds/I201005131401/src/plugins/org.eclipse.swt/buildFragment.xml:84: The following error occurred while executing this line:
/opt/users/hudsonbuild/workspace/eclipse-e4-test/builds/I201005131401/src/plugins/org.eclipse.swt/buildFragment.xml:63: The following error occurred while executing this line:
/opt/users/hudsonbuild/workspace/eclipse-e4-test/builds/I201005131401/src/plugins/org.eclipse.swt/buildFragment.xml:184: The following error occurred while executing this line:
/opt/users/hudsonbuild/workspace/eclipse-e4-test/builds/I201005131401/src/plugins/org.eclipse.swt/buildFragment.xml:408: java.lang.StringIndexOutOfBoundsException: start > length()

PW
Comment 7 Kim Moir CLA 2010-05-13 15:50:46 EDT
The build failed in the part where it replaced the ints with longs in the swt fragments.  Hard to debug because I can't login to build2 with ssh and see the build artifacts. Investigating...
Comment 8 Kim Moir CLA 2010-05-13 17:50:15 EDT
When I made this change, I updated the bootstrap script that invokes the Hudson build to use a newer one. There have been changes to include the s390x platform recently.  I think that this is where the build is failing - updating the build files for this platform from int to long in the swt fragment.  John, could you sync with the map files from HEAD to include the recent changes for the e4 build in R4_HEAD of org.eclipse.releng.  Some of the tags look out of date and this is configured as an integration build.
Comment 9 Paul Webster CLA 2010-05-14 08:45:18 EDT
(In reply to comment #8)
> files for this platform from int to long in the swt fragment.  John, could you
> sync with the map files from HEAD to include the recent changes for the e4
> build in R4_HEAD of org.eclipse.releng.  Some of the tags look out of date and
> this is configured as an integration build.

I've merged the releng map files into R4_HEAD, I'll launch a build after the e4 build completes.

PW
Comment 10 Paul Webster CLA 2010-05-14 10:19:18 EDT
I started https://build.eclipse.org/hudson/job/eclipse-e4-test/74/ around 10:00

PW
Comment 11 Paul Webster CLA 2010-05-14 10:35:50 EDT
Removed the qnx fragment and tagged org.eclipse.platform-feature

I've started another build - https://build.eclipse.org/hudson/job/eclipse-e4-test/75/

PW
Comment 12 Paul Webster CLA 2010-05-14 11:07:28 EDT
https://build.eclipse.org/hudson/job/eclipse-e4-test/75/consoleText

We're back to comment #6

PW
Comment 13 Paul Webster CLA 2010-05-14 14:57:21 EDT
When I merged i accidentally took the sdk-tests feature from HEAD.  I've fixed that and started build #77

PW
Comment 14 Paul Webster CLA 2010-05-14 20:25:06 EDT
I switched back to the slave for build 78, and I'm back to comment #6

PW
Comment 15 Kim Moir CLA 2010-05-17 08:25:11 EDT
I'm going to revert this builder back to the one we used to use for this e4 build and see what happens.  All the feature changes you merged should still be okay, you don't need to make any changes.
Comment 16 Kim Moir CLA 2010-05-18 16:13:47 EDT
So Andrew and I looked at this issue today an we're not sure why it's happening.  It looks like the replace of the int with longs already occurs in the swt fragments source. I'm going to try to run with ant in verbose mode. If this doesn't reveal the source of the problem I'll disable the parallel compilation we use in pde build. (Although this shouldn't be the source of the problem). Faster hardware sometimes reveals problems in build scripts, I recall a similar problem the last time I switched to a faster machine :-)
Comment 17 Kim Moir CLA 2010-05-18 21:55:34 EDT
Andrew, here's is the longer stack trace

https://build.eclipse.org/hudson/job/eclipse-e4-test/88/console

java.lang.StringIndexOutOfBoundsException: start > length()
	at org.apache.tools.ant.ProjectHelper.addLocationToBuildException(ProjectHelper.java:508)
	at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:418)
	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
	at org.apache.tools.ant.Task.perform(Task.java:348)
	at org.apache.tools.ant.Target.execute(Target.java:357)
	at org.apache.tools.ant.Target.performTasks(Target.java:385)
	at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1337)
	at org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
	at org.eclipse.ant.internal.core.ant.EclipseSingleCheckExecutor.executeTargets(EclipseSingleCheckExecutor.java:30)
	at org.apache.tools.ant.Project.executeTargets(Project.java:1189)
	at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:416)
	... 102 more
Comment 18 Kim Moir CLA 2010-05-26 10:09:59 EDT
Created attachment 169993 [details]
patch 

Try removing the parallel compilation parameters and see if this makes a difference. This only impacts the builder for the e4 SDK build, not the regular 3.6 stream build.
Comment 19 Kim Moir CLA 2010-05-26 15:06:40 EDT
Disabling parallel compilation didn't work.  Back to square one.
Comment 20 Andrew Niefer CLA 2010-05-26 15:26:11 EDT
Sorry, can we turn verbose back on, I missed comment #17 and build 88 is gone now.
Comment 21 Kim Moir CLA 2010-05-26 17:00:50 EDT
Running another build now in verbose mode 

https://build.eclipse.org/hudson/view/Eclipse%20and%20Equinox/job/eclipse-e4-test/98/
Comment 22 Paul Webster CLA 2010-05-27 09:28:00 EDT
(In reply to comment #21)
> Running another build now in verbose mode 
> 
> https://build.eclipse.org/hudson/view/Eclipse%20and%20Equinox/job/eclipse-e4-test/98/

When I ran #99 I switched it back to master.  Feel free to switch the config back to slave.

PW
Comment 23 Kim Moir CLA 2010-05-27 14:38:57 EDT
Andrew requested a new build with Ant in verbose mode and parallel compilation disabled.  It's running here

https://build.eclipse.org/hudson/view/Eclipse%20and%20Equinox/job/eclipse-e4-test/100/
Comment 24 Andrew Niefer CLA 2010-05-27 16:36:51 EDT
The root exception is 
java.lang.StringIndexOutOfBoundsException: start > length()
	at java.lang.AbstractStringBuilder.replace(AbstractStringBuilder.java:799)
	at java.lang.StringBuffer.replace(StringBuffer.java:391)
	at org.apache.tools.ant.taskdefs.Replace$Replacefilter.replace(Replace.java:288)
	at org.apache.tools.ant.taskdefs.Replace$Replacefilter.process(Replace.java:258)
	at org.apache.tools.ant.taskdefs.Replace.processFilterChain(Replace.java:668)
	at org.apache.tools.ant.taskdefs.Replace.processFile(Replace.java:613)
	at org.apache.tools.ant.taskdefs.Replace.execute(Replace.java:496)
	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)

I looked at the ant code and I don't see how this can happen so my only explanation is a vm bug.  Probably jit related.

I would suggest trying a different vm if possible
Comment 25 Kim Moir CLA 2010-07-15 17:32:10 EDT
Got past the vm issue, not I have this issue bug 320045.  Once these utilities are installed by the webmaster, I'll run another build.
Comment 26 Kim Moir CLA 2010-07-19 11:12:23 EDT
Created attachment 174630 [details]
patch to fix java15-home path
Comment 27 Kim Moir CLA 2010-07-19 17:54:51 EDT
Created attachment 174682 [details]
patch
Comment 28 Kim Moir CLA 2010-07-19 17:55:17 EDT
Created attachment 174683 [details]
patch

patch
Comment 29 Kim Moir CLA 2010-07-19 17:57:04 EDT
eclipse-equinox-test build is now successfully running on build2 which takes 92 minutes compared to 186 minutes on build.eclipse.org.  I'll also backport these changes to the R4_branch so the 4.0 build can also run on the new hardware.
Comment 30 Kim Moir CLA 2010-07-20 10:42:19 EDT
Closing, changes also released to R4_HEAD stream.