Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 187864

Summary: Skewed completion rates in BIRT test reports.
Product: z_Archived Reporter: Paul Slauenwhite <paulslau>
Component: TPTPAssignee: Paul Slauenwhite <paulslau>
Status: CLOSED FIXED QA Contact:
Severity: critical    
Priority: P1 CC: aeberbac, jerome.gout, jkubasta
Version: unspecifiedKeywords: plan
Target Milestone: ---   
Hardware: All   
OS: All   
Whiteboard:
Attachments:
Description Flags
Sample projects.
none
Sample projects.
none
Patch none

Description Paul Slauenwhite CLA 2007-05-18 13:44:46 EDT 
Skewed completion rates in BIRT test reports.

Using the BIRT Test Execution Tabular Report generator in the TPTP-4.4.0-200705080100C driver to generate a report for TPTP Test Bucket, the follow test suites show 0% completion rate thereby skewing the total completion rate:

Monitor.UI.WSDM_Tooling_Editor_Capability
Monitor.UI.WSDM_Tooling_Editor_Capability_Import_Javaclass
Monitor.UI.WSDM_Tooling_Editor_DeploymentDescriptor
Monitor.UI.WSDM_Tooling_Editor_MRT
Monitor.UI.WSDM_Tooling_Editor_MRT_Relationship.testsuite
Monitor.UI.WSDM_Tooling_Editor_MRT_ServiceGroup

This is because the AllTest_IBM*.testsuite and ALLTest_SUN*.testsuite inherit these testsuites.  This is related to the fact that inherited relationships and aggregate relationships are modeled the same in the test model (see enhancement #163110).
Comment 1 Paul Slauenwhite CLA 2007-05-18 13:46:04 EDT 
Sheldon, please provide a sizing.
Comment 2 Paul Slauenwhite CLA 2007-05-22 08:40:14 EDT 
Sheldon, we will need a test case to cover this symptom added to the reporting test suite.
Comment 3 Paul Slauenwhite CLA 2007-08-27 09:58:30 EDT 
Increasing the severity since this is impacting our 4.4.0.x smoke test pass reports.
Comment 4 Paul Slauenwhite CLA 2007-08-27 09:59:40 EDT 
Created attachment 77027 [details]
Sample projects.
Comment 5 Paul Slauenwhite CLA 2007-08-27 10:00:12 EDT 
Estimated sizing.
Comment 6 Paul Slauenwhite CLA 2007-08-29 11:51:33 EDT 
Created attachment 77267 [details]
Sample projects.
Comment 7 Paul Slauenwhite CLA 2007-11-07 06:32:46 EST 
Bulk update of the target field to reflect the change in iteration numbers.
Comment 8 Paul Slauenwhite CLA 2007-11-09 15:44:29 EST 
Created attachment 82569 [details]
Patch
Comment 9 Paul Slauenwhite CLA 2007-11-09 15:51:22 EST 
Updating hours worked.
Comment 10 Paul Slauenwhite CLA 2007-11-27 06:12:14 EST 
The following files checked-in to CVS (HEAD):

org.eclipse.tptp.test.report.birt.internal.TabularTPFTestSuiteReportElement.java
org.eclipse.tptp.test.report.birt.internal.ResolveTestExecutions.java
org.eclipse.tptp.test.report.birt.internal.TestPassTPFTestSuiteReportElement.java
org.eclipse.hyades.models.common.util.ExecutionUtil.java
org.eclipse.tptp.test.report.birt\templates\TabularReport.rptdesign
Comment 11 Paul Slauenwhite CLA 2007-12-17 12:33:49 EST 
Verified using TPTP-4.5.0-200712160400. 

Closing.