Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 317976

Summary: create 3.6 baselines for 3.7 performance builds
Product: [Eclipse Project] Platform Reporter: Kim Moir <kim.moir>
Component: RelengAssignee: Kim Moir <kim.moir>
Status: RESOLVED FIXED QA Contact:
Severity: major    
Priority: P1 CC: frederic_fusier, satyam.kandula
Version: 3.7   
Target Milestone: 3.7 M1   
Hardware: PC   
OS: Windows XP   
Whiteboard:
Attachments:
Description Flags
perf_36x branch patches
none
patch for HEAD
none
patch to fix mapsRepo issue
none
patch
none
more patches
none
patches none

Description Kim Moir CLA 2010-06-25 09:30:32 EDT
We need to create performance baselines for 3.6 and run 3.7 performance tests.

The perf run on Thursday nightly build should be removed.  

The perf machines should be systematically rebooted on Friday morning.
Comment 1 Frederic Fusier CLA 2010-06-25 11:09:01 EDT
This is something which must be done as soon as possible because usually the first milestone is the ideal moment to put big and/or high risk changes, hence performances can be dramatically impacted at this early stage of development.

As the sooner is the better to detect performance regressions, I think we should not wait too much before restarting the performance runs in 3.7 dvpt stream.

So, I'm increasing the priority and the severity of this bug to reflect this urgency...

Kim, I hope this is OK for you.

TIA
Comment 2 Kim Moir CLA 2010-06-25 13:57:54 EDT
Followed this procedure.

http://wiki.eclipse.org/Platform-releng-new-baseline

branched R3_6 of org.eclipse.releng.eclipsebuilder, org.eclipse.releng.basebuilder, eclipseInternalBuildTools, eclipsePerformanceBuildTools to perf_36x

Will attach patches
Comment 3 Kim Moir CLA 2010-06-25 13:58:20 EDT
Created attachment 172795 [details]
perf_36x branch patches
Comment 4 Kim Moir CLA 2010-06-25 14:22:47 EDT
Created attachment 172796 [details]
patch for HEAD
Comment 5 Kim Moir CLA 2010-06-25 16:04:36 EDT
Ran a test build and had this error, will investigate on Monday.

BUILD FAILED
/builds/perf36_201006251555/3.6_perf_36x/eclipsePerformanceBuildTools/all.xml:29: The following error occurred while executing this line:
/builds/perf36_201006251555/3.6_perf_36x/org.eclipse.releng.eclipsebuilder/build.xml:35: The following error occurred while executing this line:
/builds/perf36_201006251555/3.6_perf_36x/org.eclipse.releng.basebuilder/plugins/org.eclipse.pde.build_3.6.0.v20100603/scripts/build.xml:20: Property mapsRepo was circularly defined.
Comment 6 Frederic Fusier CLA 2010-06-28 09:51:25 EDT
(In reply to comment #3)
> Created an attachment (id=172795) [details]
> perf_36x branch patches

Shouldn't it be:
-		<condition property="3.5.tested">
- 			<equals arg1="${testedBuildId}" arg2="3.5" />
+		<condition property="3.6.tested">
+ 			<equals arg1="${testedBuildId}" arg2="3.6" />
 		</condition>
instead ?
Comment 7 Kim Moir CLA 2010-06-28 10:01:34 EDT
Thanks Frederic, I've fixed the typo
Comment 8 Kim Moir CLA 2010-06-28 10:07:00 EDT
Created attachment 172906 [details]
patch to fix mapsRepo issue
Comment 9 Kim Moir CLA 2010-06-28 11:11:39 EDT
Created attachment 172914 [details]
patch

Test build failed this way.  Since the p2 bundles don't have performance tests anyways, this patch excludes these bundles from being built in the perf_36x stream.

sdk.tests: Bundle org.eclipse.equinox.p2.tests.discovery_1.0.0.v20100503 failed to resolve.:
        Missing required plug-in org.eclipse.equinox.p2.discovery_1.0.0.
        Missing required plug-in org.eclipse.equinox.p2.discovery.compatibility_1.0.0.
        Missing required plug-in org.eclipse.equinox.p2.ui.discovery_1.0.0.
Comment 10 Kim Moir CLA 2010-06-28 16:51:22 EDT
Created attachment 172959 [details]
more patches
Comment 11 Kim Moir CLA 2010-06-30 10:39:20 EDT
Baseline ran successfully last night.    Frederic, can you confirm that the results are as expected?
Comment 12 Kim Moir CLA 2010-06-30 10:42:05 EDT
Created attachment 173102 [details]
patches
Comment 13 Kim Moir CLA 2010-07-05 16:43:11 EDT
Okay, I've created the database as well as fixed some other errors in the builder.  It looks like there is new data in the perfDb37 database - the baselines are running now.
Comment 14 Kim Moir CLA 2010-07-06 11:00:08 EDT
Confirmed that baseline results are in perfDb37.  One of the perf machines crashed overnight.  I'll run another baseline today to to get a better baseline.  Also, I have renabled performance results on our upcoming builds.
Comment 15 Frederic Fusier CLA 2010-07-06 11:07:53 EDT
(In reply to comment #14)
> Confirmed that baseline results are in perfDb37.  One of the perf machines
> crashed overnight.  I'll run another baseline today to to get a better
> baseline.  Also, I have renabled performance results on our upcoming builds.

Great news!

Thanks Kim :-)