Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 149970

Summary: Intermittent build failures -eclipse-master-${buildId}.zip doesn't exist
Product: [Eclipse Project] Platform Reporter: Kim Moir <kim.moir>
Component: RelengAssignee: Kim Moir <kim.moir>
Status: RESOLVED FIXED QA Contact:
Severity: critical    
Priority: P3 CC: aniefer, daniel_megert, sonia_dimitrov
Version: 3.2   
Target Milestone: ---   
Hardware: PC   
OS: Windows XP   
Whiteboard:
Bug Depends on: 172935    
Bug Blocks:    
Attachments:
Description Flags
logs from failed packing process
none
patch to update.core
none
update.core jar with changes none

Description Kim Moir CLA 2006-07-07 09:35:37 EDT
Warning: Could not find file/builds/N200607070010/src/N20060707-0010/eclipse-master-N20060707-0010.zip

There are intermittent failures on the build machine where the eclipse-master.zip doesn't exist.  I'll try passing more memory to the vm at this stage of the build.  It's a difficult problem to reproduce.  It only seems to happen every 10 builds or so.
Comment 1 Kim Moir CLA 2006-07-10 12:28:52 EDT
Last week, I increased maxmemory="512m" in the pack200 stage in eclipse/helper.xml.  The problem is very intermittent so it is difficult to reproduce.
Comment 2 Kim Moir CLA 2006-07-26 16:18:30 EDT
I'm closing this bug, since I added more memory to the pack200 arguments, we have not seen this intermittent failure.
Comment 3 Kim Moir CLA 2006-07-27 09:05:48 EDT
Happened again with N20060727-0010.
Comment 4 Sonia Dimitrov CLA 2006-11-08 15:15:48 EST
I think the memory setting needs to be set in the extras/pack200 script, ie. @pack200@ -E4 -J-Xms512m $*
Comment 5 Kim Moir CLA 2007-01-09 14:38:20 EST
Closing, hasn't occured since memory changes.
Comment 6 Kim Moir CLA 2007-01-12 09:05:43 EST
Happened again this morning.
Comment 7 Kim Moir CLA 2007-02-01 13:30:56 EST
Andrew advised on implementing additionally loggin in the pack200 section

 <!--pack200-->
           <java jar="${eclipse.home}/startup.jar"
                        fork="true"
                        timeout="10800000"
                        jvm="${java15-home}/bin/java"
                        failonerror="true"
                        maxmemory="768m"
                        error="${buildDirectory}/errorlog.txt"
                        dir="${buildDirectory}"
                        output="${buildDirectory}/jarprocessorlog.txt">
                        <jvmarg value="-Dorg.eclipse.update.jarprocessor.pack200=${eclipse.build.configs}/../../extras"/>
                        <arg line="-consolelog -application org.eclipse.update.core.siteOptimizer"/>
                        <arg line="-jarProcessor -verbose -outputDir ${buildLabel} -processAll -pack ${repack} ${packtmp}/${archiveName}"/>
       </java>

From what we can see, the process exits when packing a single jar. The jar that causes the process to exit differs from build to build.

Comment 8 Kim Moir CLA 2007-02-05 13:54:51 EST
Created attachment 58271 [details]
logs from failed packing process
Comment 9 Kim Moir CLA 2007-02-05 13:55:19 EST
It happened on a a test build this morning.  Andrew, I'm attaching the logs.

Since our signing server was down, both packing and repacking occurred on our build machine. 

The source of the errorlog.txt and jarprocessorlog.txt can bee seen from the ant snippet above.

The packlog.txt is generated by calling from the output of the pack200 script that calls the pack200 executable from the vm.

#!/bin/sh

/builds/N200702051147/jdk/linuxppc/ibm-java2-ppc-50/jre/bin/pack200 -v -l packlog.txt -E4 -J-Xmx768m $*

pack200retCode=$?

if [ $pack200retCode != 0 ]
then
        echo "Build failed (error code $retCode)."
        exit -1
fi
Comment 10 Andrew Niefer CLA 2007-02-05 16:13:09 EST
Created attachment 58283 [details]
patch to update.core

Patch to update.core for the JarProcessor to handle this file not found more gracefully.
Comment 11 Andrew Niefer CLA 2007-02-05 16:16:16 EST
Created attachment 58284 [details]
update.core jar with changes

New update.core jar containing the attached changes to jarprocessor.
Comment 12 Kim Moir CLA 2007-02-05 19:02:22 EST
Thanks Andrew, I will run a test build tomorrow. I didn't have time today with all our our build woes.
Comment 13 Kim Moir CLA 2007-02-06 17:32:45 EST
test build successful, jar released into basebuilder for midnight build.
Comment 14 Kim Moir CLA 2007-02-09 10:23:16 EST
Looks like this is fixed.  I haven't had it happen since I released the fix.  Sonia, when I update basebuilder with M5, I'll update it with this update.core jar as Andrew's patch was not released to that plugin for M5.
Comment 15 Kim Moir CLA 2007-03-21 09:18:22 EDT
closing