Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 438413

Summary: Organize client test results on Hudson
Product: [ECD] Orion Reporter: Mark Macdonald <mamacdon>
Component: RelengAssignee: Mark Macdonald <mamacdon>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: P3    
Version: 5.0   
Target Milestone: 7.0   
Hardware: PC   
OS: Windows 7   
Whiteboard:

Description Mark Macdonald CLA 2014-06-27 11:01:45 EDT 
The orion-client test results on Hudson are displayed in a big flat list [1]. It's disorganized and hard to read.

Jenkins (and Hudson?) supports a classname="Foo.Bar.Baz" attribute in the test XML, which causes tests to be sorted hierarchically as Foo > Bar > Baz [2]

We should create a new & improved xunit reporter for mocha that produces a classname="A.B.C" attribute on each testcase, where A.B.C corresponds to the nested describe() structure it was defined in, eg:

> describe("A", function() {
>     describe("B", function() {
>         describe("C", function() {
>              // tests here would be in classname="A.B.C"
>         });
>     });
> })



[1] https://hudson.eclipse.org/orion/job/orion-client/lastCompletedBuild/testReport/%28root%29/

[2] http://nelsonwells.net/2012/09/how-jenkins-ci-parses-and-displays-junit-output/
Comment 1 Mark Macdonald CLA 2014-09-15 18:28:45 EDT 
Released a fix
http://git.eclipse.org/c/orion/org.eclipse.orion.client.git/commit/?id=c890ddf

In local testing, this made Hudson/Jenkins group the tests at the top level by browser + test suite. 

When you drill into a browser-testsuite, you see all the flattened-out describe()s chains in it (i.e. "A B C"), and then if you click on one of those, you see all the individual tests.

I didn't have to change the mocha reporter for this.