Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 304800 - All our jobs using run.sh fail with buildAll.xml does not exist
Summary: All our jobs using run.sh fail with buildAll.xml does not exist
Status: RESOLVED FIXED
Alias: None
Product: z_Archived
Classification: Eclipse Foundation
Component: Dash Athena (show other bugs)
Version: unspecified   Edit
Hardware: PC Linux
: P3 major (vote)
Target Milestone: ---   Edit
Assignee: Project Inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2010-03-05 06:23 EST by Dennis Huebner CLA
Modified: 2012-01-30 11:32 EST (History)
3 users (show)

See Also:


Attachments
Error log (10.63 KB, text/x-log)
2010-03-05 06:23 EST, Dennis Huebner CLA
no flags Details
proposed patch to not delete common project (720 bytes, patch)
2010-03-10 11:29 EST, Bouchet Stéphane CLA
nboldt: iplog+
Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Dennis Huebner CLA 2010-03-05 06:23:40 EST
Created attachment 161103 [details]
Error log

Since yesterday all our hudson jobs (Xtext, Xpand and MWE) fail with 
Buildfile: /opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/org.eclipse.dash.common.releng/buildAll.xml does not exist error.

Seems like linked  /opt/public/cbi/build/org.eclipse.dash.common.releng/ contains any content.

Error log is attached.
Comment 1 Nick Boldt CLA 2010-03-05 10:34:31 EST
Seems like the files keep disappearing from the filesystem - perhaps a cvs checkout failure? Or someone deleting them?

If I do

$ cd /opt/public/cbi/build/org.eclipse.dash.common.releng; cvs up

everything returns.

I've changed the permissions on the folder so that it's only writable by callisto-dev, which should hopefully prevent accidental deletes by the hudson user.
Comment 2 Cedric Brun CLA 2010-03-08 04:52:36 EST
I'm having the same issue for cbi-amalgam-nightly, I had to log and cvs up' and got a build.
Comment 3 Bouchet Stéphane CLA 2010-03-08 05:55:56 EST
hi,

i also got the same problem with ANT based build for EEF job's : 
https://build.eclipse.org/hudson/view/Modeling/job/cbi-emf-eef-0.7-nightly/346/console

Somebody is cleaning his workspace too much ?
Comment 4 Nick Boldt CLA 2010-03-08 14:50:50 EST
Yes, seems someone (cbrun?) has a build which is purging shared files. The build should not have permission to delete these files.

I've changed permissions where possible so that only the dashBuild userid can mess up these files.
Comment 5 Cedric Brun CLA 2010-03-09 03:11:54 EST
You might have seen my user id because I  had to cvs up yesterday to get the amalgam build done.

I launched several builds yesterday without having any issue then, it probably means the amalgam build is not clearing the files.

We'll quickly see which build is failing because it can't delete the common project :)
Comment 6 Bouchet Stéphane CLA 2010-03-10 11:28:37 EST
Nick,

i upgraded the org.eclipse.dash.common.releng project today and notice that in the build.xml file ( in the root directory ), there is a cleanupWorkspace target : 

<target name="cleanupWorkspace"
	        if="isInHudson"
	        description="this will do some extreme cleaning of the workspace to purge leftover build dir from previous build. Handy if in Hudson; bad if on local"
	>
		<delete failonerror="false"
		        dir="${writableBuildRoot}/"
		        defaultexcludes="false"
		        includeemptydirs="true"
		        excludes="3rdPartyJars, downloads"
		/>
	</target>

Does it means that ALL directory under workspaces builds are purged excluding only downloads and 3rdpartysJars ? 

if yes, this may causes the problem, because some projects are making symlinks to org.eclipse.dash.common.releng projects. 

For example, xtext does it : 
https://build.eclipse.org/hudson/job/cbi-tmf-xtext-0.7/ws/build/

notice the org.eclipse.dash.common.releng folder.

looking at the log, you can see these lines : 

++ buildDir=/opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/N201003101026
++ mkdir -p /opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/downloads /opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/signing /opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/N201003101026
++ touch /opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/.cvspass
++ relengBaseBuilderDir=/opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/org.eclipse.releng.basebuilder
++ relengCommonBuilderDir=/opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/org.eclipse.dash.common.releng
++ ln -s /opt/public/cbi/build/org.eclipse.releng.basebuilder /opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/
++ ln -s /opt/public/cbi/build/org.eclipse.dash.common.releng /opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/
++ ln -s /opt/public/cbi/build/3rdPartyJars /opt/users/hudsonbuild/.hudson/jobs/cbi-tmf-xtext-0.7/workspace/build/
Comment 7 Bouchet Stéphane CLA 2010-03-10 11:29:40 EST
Created attachment 161627 [details]
proposed patch to not delete common project
Comment 8 Nick Boldt CLA 2010-03-13 16:38:24 EST
With recent changes to improve the testing experience, and the addition of a vnc password, you can now run your tests with either "test" (calls runtests.sh to start VNC) or "testLocal" (keeps everything in the same Eclipse process and display thread, and therefore must have the "Use Xvnc" box checked on your Hudson job).

I'd like to close this but I need confirmation from the various affected parties that things are better. 

Sound off!
Comment 9 Nick Boldt CLA 2010-03-13 16:39:02 EST
Comment on attachment 161627 [details]
proposed patch to not delete common project

Thanks for the patch. Applied.
Comment 10 Nick Boldt CLA 2010-03-28 12:47:07 EDT
Two weeks without a comment. closing. If still broken, reopen.