Description Markus Keller 2012-01-26 10:50:06 EST

Created attachment 210122 [details]
OrderedTestSuite.java

For performance tests, the execution order of test methods is often essential. 

In org.eclipse.jdt.ui.tests, we've implemented an OrderedTestSuite, which not only guarantees the execution order, but also emits an error if the test methods in a class don't correspond to the tests specified in the suite (e.g. if a new test got added, but is missing in the suite).

This replaces manual patterns like this:

public static Test suite() {
    // we must make sure that cold is executed before warm
    TestSuite suite= new TestSuite("RenamePackagePerfTests1");
    suite.addTest(new RenamePackagePerfTests1("testCold_10_10"));
    suite.addTest(new RenamePackagePerfTests1("test_10_10"));
    suite.addTest(new RenamePackagePerfTests1("test_100_10"));
    suite.addTest(new RenamePackagePerfTests1("test_1000_10"));
    return new RefactoringPerformanceTestSetup(suite);
}

... with safer and less verbose code like this:

public static Test suite() {
    // we must make sure that cold is executed before warm
    return new OrderedTestSuite(RenamePackagePerfTests1.class, new String[] {
        "testCold_10_10", "test_10_10", "test_100_10", "test_1000_10"
    });
}