Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 353776

Summary:	build.eclipse.org /shared/eclipse/e4 has subdirectories owned by root
Product:	Community	Reporter:	Andrew Niefer <aniefer>
Component:	Servers	Assignee:	Eclipse Webmaster <webmaster>
Status:	RESOLVED FIXED	QA Contact:
Severity:	blocker
Priority:	P3	CC:	daniel_megert
Version:	unspecified
Target Milestone:	---
Hardware:	PC
OS:	Linux
Whiteboard:

Description Andrew Niefer

2011-08-03 10:40:08 EDT

There are a number of sub directories under /shared/eclipse/e4 that are owned by root.  These should be owned by e4Build.

This is blocking Eclipse 4.2, 4.1.x and Orion builds from running.

4Build@build:/shared/eclipse/e4> ls -la | grep root
drwx------   2 root    root  4096 2011-07-27 23:11 eclipse.org-common
drwx------   2 root    root  4096 2011-07-27 23:11 flex_sdk_3.2.0.3794_mpl
drwx------   2 root    root  4096 2011-07-27 23:11 git
drwx------   2 root    root  4096 2011-07-27 23:11 images
drwx------   2 root    root  4096 2011-07-27 23:11 logs
drwx------   2 root    root  4096 2011-07-27 23:11 mirror-example
drwx------   2 root    root  4096 2011-07-27 23:11 orion
drwx------   2 root    root  4096 2011-07-27 23:11 releasing
drwx------   2 root    root  4096 2011-07-27 23:11 sdk
drwx------   2 root    root  4096 2011-07-27 23:11 t
drwx------   2 root    root  4096 2011-07-27 23:11 tests
drwx------   2 root    root  4096 2011-07-27 23:11 tst40

Even in directories owned by e4Build, there are further subdirectories owned by root.
e4Build@build:/shared/eclipse/e4/build/e4> ls -la | grep root
drwx------ 2 root root 4096 2011-07-27 23:12 icu451Repo
drwx------ 2 root root 4096 2011-07-27 23:12 jface
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.e4.builder_HEAD
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.e4.builder_R4_1_maintenance
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.e4.builder_R4_1_SDK_LONGBUILD
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.e4.sdk_HEAD
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.e4.sdk_R4_1_maintenance
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.e4.sdk_R4_1_SDK_LONGBUILD
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.orion.releng
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.releng.basebuilder_R3_6
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.releng.basebuilder_v20101019
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.releng.basebuilder_v20110302
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.releng.eclipsebuilder_R4_1_maintenance
drwx------ 2 root root 4096 2011-07-27 23:12 org.eclipse.releng.eclipsebuilder_R4_HEAD

Comment 1 Denis Roy

2011-08-03 11:16:58 EDT

Ah.  I'm not surprised.

Saturday when I was migrating to the new file servers, I watched as the files were being copied from the old server to the new server.  /shared/eclipse/e4 went on and on and on and on for hours and hours and hours.

No wonder -- there is >200GB in 4 million files within 400,000 directories.

I compared that to the /shared/webtools directory, which runs builds in a similar fashion.  35G in 366,000 files within 62,500 directories.

This directory, full of old I-builds, most of which contain >250,000 files, was particularly interesting:
/shared/eclipse/e4/build/e4/downloads/drops/4.0.0/workspace/builds

Anyway, that is my rant.  The permissions are being fixed right now but I don't expect it to be done anytime soon.

Comment 2 Andrew Niefer

2011-08-03 11:41:18 EDT

Denis, all the affected folders now seem to be empty, all the content is gone.

Comment 3 Andrew Niefer

2011-08-03 11:44:42 EDT

Regarding cleanup, while I did do some last week (apparently not enough), I never even looked under .../4.0.0/workspace and was not aware of significant content in there.  I'm deleting that folder.

Comment 4 Andrew Niefer

2011-08-03 11:51:17 EDT

Is there any way to restore /shared/eclipse/e4/releasing ?

This folder is the most critical, I may be able to recreate the other stuff but I have no way to get releasing back.

Comment 5 Denis Roy

2011-08-03 11:54:45 EDT

(In reply to comment #4)
> Is there any way to restore /shared/eclipse/e4/releasing ?

Yes, I'll fire up the old server and poke through there.  Stay tuned.

Comment 6 Denis Roy

2011-08-03 12:15:24 EDT

releasing is back.  Is there anything else in there that you need, while I have this mounted up?

Comment 7 Andrew Niefer

2011-08-03 12:24:45 EDT

I think
/shared/eclipse/e4/sdk/template

And any of /shared/eclipse/orion excluding the N* and I* subfolders, in particular /shared/eclipse/orion/jsdoc-toolkit

Comment 8 Denis Roy

2011-08-03 12:30:07 EDT

Done; anything else?

Comment 9 Andrew Niefer

2011-08-03 12:59:30 EDT

I think we should be ok now, though I won't know for certain until after running the builds.  I'll start on this now, though it may be a few hours.

Thanks for your help Denis.

Comment 10 Andrew Niefer

2011-08-04 16:07:15 EDT

Marking this fixed, we've run builds for all of Orion, Eclipse 4.2 and Eclipse 4.1 maintenance.