Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 317976 - create 3.6 baselines for 3.7 performance builds
Summary: create 3.6 baselines for 3.7 performance builds
Status: RESOLVED FIXED
Alias: None
Product: Platform
Classification: Eclipse Project
Component: Releng (show other bugs)
Version: 3.7   Edit
Hardware: PC Windows XP
: P1 major (vote)
Target Milestone: 3.7 M1   Edit
Assignee: Kim Moir CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2010-06-25 09:30 EDT by Kim Moir CLA
Modified: 2010-07-06 11:07 EDT (History)
2 users (show)

See Also:


Attachments
perf_36x branch patches (2.38 KB, patch)
2010-06-25 13:58 EDT, Kim Moir CLA
no flags Details | Diff
patch for HEAD (6.76 KB, patch)
2010-06-25 14:22 EDT, Kim Moir CLA
no flags Details | Diff
patch to fix mapsRepo issue (853 bytes, text/plain)
2010-06-28 10:07 EDT, Kim Moir CLA
no flags Details
patch (1.75 KB, text/plain)
2010-06-28 11:11 EDT, Kim Moir CLA
no flags Details
more patches (2.29 KB, application/octet-stream)
2010-06-28 16:51 EDT, Kim Moir CLA
no flags Details
patches (4.35 KB, patch)
2010-06-30 10:42 EDT, Kim Moir CLA
no flags Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Kim Moir CLA 2010-06-25 09:30:32 EDT
We need to create performance baselines for 3.6 and run 3.7 performance tests.

The perf run on Thursday nightly build should be removed.  

The perf machines should be systematically rebooted on Friday morning.
Comment 1 Frederic Fusier CLA 2010-06-25 11:09:01 EDT
This is something which must be done as soon as possible because usually the first milestone is the ideal moment to put big and/or high risk changes, hence performances can be dramatically impacted at this early stage of development.

As the sooner is the better to detect performance regressions, I think we should not wait too much before restarting the performance runs in 3.7 dvpt stream.

So, I'm increasing the priority and the severity of this bug to reflect this urgency...

Kim, I hope this is OK for you.

TIA
Comment 2 Kim Moir CLA 2010-06-25 13:57:54 EDT
Followed this procedure.

http://wiki.eclipse.org/Platform-releng-new-baseline

branched R3_6 of org.eclipse.releng.eclipsebuilder, org.eclipse.releng.basebuilder, eclipseInternalBuildTools, eclipsePerformanceBuildTools to perf_36x

Will attach patches
Comment 3 Kim Moir CLA 2010-06-25 13:58:20 EDT
Created attachment 172795 [details]
perf_36x branch patches
Comment 4 Kim Moir CLA 2010-06-25 14:22:47 EDT
Created attachment 172796 [details]
patch for HEAD
Comment 5 Kim Moir CLA 2010-06-25 16:04:36 EDT
Ran a test build and had this error, will investigate on Monday.

BUILD FAILED
/builds/perf36_201006251555/3.6_perf_36x/eclipsePerformanceBuildTools/all.xml:29: The following error occurred while executing this line:
/builds/perf36_201006251555/3.6_perf_36x/org.eclipse.releng.eclipsebuilder/build.xml:35: The following error occurred while executing this line:
/builds/perf36_201006251555/3.6_perf_36x/org.eclipse.releng.basebuilder/plugins/org.eclipse.pde.build_3.6.0.v20100603/scripts/build.xml:20: Property mapsRepo was circularly defined.
Comment 6 Frederic Fusier CLA 2010-06-28 09:51:25 EDT
(In reply to comment #3)
> Created an attachment (id=172795) [details]
> perf_36x branch patches

Shouldn't it be:
-		<condition property="3.5.tested">
- 			<equals arg1="${testedBuildId}" arg2="3.5" />
+		<condition property="3.6.tested">
+ 			<equals arg1="${testedBuildId}" arg2="3.6" />
 		</condition>
instead ?
Comment 7 Kim Moir CLA 2010-06-28 10:01:34 EDT
Thanks Frederic, I've fixed the typo
Comment 8 Kim Moir CLA 2010-06-28 10:07:00 EDT
Created attachment 172906 [details]
patch to fix mapsRepo issue
Comment 9 Kim Moir CLA 2010-06-28 11:11:39 EDT
Created attachment 172914 [details]
patch

Test build failed this way.  Since the p2 bundles don't have performance tests anyways, this patch excludes these bundles from being built in the perf_36x stream.

sdk.tests: Bundle org.eclipse.equinox.p2.tests.discovery_1.0.0.v20100503 failed to resolve.:
        Missing required plug-in org.eclipse.equinox.p2.discovery_1.0.0.
        Missing required plug-in org.eclipse.equinox.p2.discovery.compatibility_1.0.0.
        Missing required plug-in org.eclipse.equinox.p2.ui.discovery_1.0.0.
Comment 10 Kim Moir CLA 2010-06-28 16:51:22 EDT
Created attachment 172959 [details]
more patches
Comment 11 Kim Moir CLA 2010-06-30 10:39:20 EDT
Baseline ran successfully last night.    Frederic, can you confirm that the results are as expected?
Comment 12 Kim Moir CLA 2010-06-30 10:42:05 EDT
Created attachment 173102 [details]
patches
Comment 13 Kim Moir CLA 2010-07-05 16:43:11 EDT
Okay, I've created the database as well as fixed some other errors in the builder.  It looks like there is new data in the perfDb37 database - the baselines are running now.
Comment 14 Kim Moir CLA 2010-07-06 11:00:08 EDT
Confirmed that baseline results are in perfDb37.  One of the perf machines crashed overnight.  I'll run another baseline today to to get a better baseline.  Also, I have renabled performance results on our upcoming builds.
Comment 15 Frederic Fusier CLA 2010-07-06 11:07:53 EDT
(In reply to comment #14)
> Confirmed that baseline results are in perfDb37.  One of the perf machines
> crashed overnight.  I'll run another baseline today to to get a better
> baseline.  Also, I have renabled performance results on our upcoming builds.

Great news!

Thanks Kim :-)