Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 356926 - setup performance baselines and tests in 3.8 stream builds
Summary: setup performance baselines and tests in 3.8 stream builds
Status: RESOLVED FIXED
Alias: None
Product: Platform
Classification: Eclipse Project
Component: Releng (show other bugs)
Version: 3.8   Edit
Hardware: PC Windows XP
: P3 normal (vote)
Target Milestone: 3.8 M4   Edit
Assignee: Kim Moir CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-09-07 08:56 EDT by Kim Moir CLA
Modified: 2011-12-06 11:02 EST (History)
6 users (show)

See Also:


Attachments
patch to fetch baseline maps from Git (28.86 KB, patch)
2011-12-01 11:39 EST, Kim Moir CLA
no flags Details | Diff
another patch to fetch from Git (1.37 KB, patch)
2011-12-01 11:40 EST, Kim Moir CLA
no flags Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Kim Moir CLA 2011-09-07 08:56:30 EDT
Currently they are not running because the baseline is not set up.
Comment 1 John Arthorne CLA 2011-10-07 09:54:54 EDT
Is setting up a baseline a lot of work? Is this impacted by Git migration at all?
Comment 2 Kim Moir CLA 2011-10-07 11:55:04 EDT
Yes, it takes a while to do - one or two days of testing. Yes, the Git migration has interfered with it. My goal is to have this ready for M3, I'll set aside a day early next week to fix this.
Comment 3 Kim Moir CLA 2011-11-09 21:39:28 EST
Today's problem is that bundles in the builder don't resolve.  Tomorrow I will release a new builder, I think some of the pde build jars are corrupted in CVS, which sometimes happens.
Comment 4 Kim Moir CLA 2011-11-10 18:58:51 EST
Today's problems
SDK produced are corrupt zips
equinoxp2.properties file does not list current repo location
pdebuild.scripts is still not resolving with new builder

working through the issues :-)
Comment 5 Kim Moir CLA 2011-11-15 10:08:02 EST
Okay, the baselines ran successfully last night and I enabled performance tests in the integration build this morning.  Will check the results generation later.
Comment 6 Kim Moir CLA 2011-11-16 10:40:22 EST
We have performance results for I20111115-0800

http://download.eclipse.org/eclipse/downloads/drops/I20111115-0800/performance/performance.php

but only for two machines.  Will investigate why they weren't generated for the other two machines.
Comment 7 Satyam Kandula CLA 2011-11-17 08:23:33 EST
(In reply to comment #6)
> We have performance results for I20111115-0800
> 
> http://download.eclipse.org/eclipse/downloads/drops/I20111115-0800/performance/performance.php
> 
> but only for two machines.  Will investigate why they weren't generated for the
> other two machines.
Thank you Kim, The tests seems to have run on one of the windows machines, but the results  have not been generated. The main page doesn't show all the projects though the runs are available. I think this is to do with the baselines not being available. I am also investigating. Thanks.
Comment 8 Satyam Kandula CLA 2011-11-17 20:08:18 EST
(In reply to comment #7)
> (In reply to comment #6)
> > We have performance results for I20111115-0800
> > 
> > http://download.eclipse.org/eclipse/downloads/drops/I20111115-0800/performance/performance.php
> > 
> > but only for two machines.  Will investigate why they weren't generated for the
> > other two machines.
> Thank you Kim, The tests seems to have run on one of the windows machines, but
> the results  have not been generated. The main page doesn't show all the
> projects though the runs are available. I think this is to do with the
> baselines not being available. I am also investigating. Thanks.
Baselines seem to be available.
Comment 9 Kim Moir CLA 2011-12-01 11:39:51 EST
Created attachment 207796 [details]
patch to fetch baseline maps from Git
Comment 10 Kim Moir CLA 2011-12-01 11:40:12 EST
Created attachment 207797 [details]
another patch to fetch from Git
Comment 11 Kim Moir CLA 2011-12-06 11:02:43 EST
Performance baselines and tests are running. You can update the perf_37x branch in Git with your changes to the test bundles.