Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 311546

Summary:	[perfs] Regression for StatePerformanceTest#testResolution100()
Product:	[Eclipse Project] Equinox	Reporter:	Frederic Fusier <frederic_fusier>
Component:	Framework	Assignee:	equinox.framework-inbox <equinox.framework-inbox>
Status:	RESOLVED FIXED	QA Contact:
Severity:	normal
Priority:	P3	CC:	daniel_megert, tjwatson
Version:	3.6	Keywords:	test
Target Milestone:	3.6 RC1
Hardware:	PC
OS:	Windows XP
Whiteboard:
Bug Depends on:
Bug Blocks:	286955

Description Frederic Fusier

2010-05-04 09:36:36 EDT

Verifying 3.6M7 perf results, it appears that I missed to report a regression on StatePerformanceTest#testResolution100() test which occurs since build N20100415-2000 (between -14% and -20%).

Note that I also can see a similar regression (ie. which appeared exactly on the same build) on following tests:
 - StateUsesPerformanceTest#testUsesResolution00100()
 - StateUsesPerformanceTest#testUsesResolution00500()

This regression is only noticeable on the Win XP Sun 1.5.0_10 test machine.

Sorry, I'm not sure it's the right component, please reassign if necessary, thanks

Comment 1 Thomas Watson

2010-05-04 10:03:05 EDT

This looks to be caused by the fix in bug269185.  We are trading off reduction of memory usage for a small jump in execution time.

Comment 2 Frederic Fusier

2010-05-04 10:27:27 EDT

I also can see a similar regression (ie. which appeared exactly on
the same build) on following test:
 - StatePerformanceTest#testResolution500()

My tool didn't notice me for it as it's just at the -10% threshold, sometimes
over and sometimes below, hence there are never 3 consecutive builds having
this failure...

Comment 3 Frederic Fusier

2010-05-04 10:28:32 EDT

(In reply to comment #1)
> This looks to be caused by the fix in bug269185.  We are trading off reduction
> of memory usage for a small jump in execution time.

Hence, the best solution in this case is to add a comment in these tests.

Comment 4 Thomas Watson

2010-05-04 11:12:39 EDT

I added a regression comment to the four tests you have identified.