Bug 212877

Description Paul Slauenwhite 2007-12-13 09:27:32 EST

TPTP test results are not reported correctly.

There are some cases (e.g. Platform.Communication.New_Agent_Controller_Application_Console.Windows_IAEM64T in http://www.eclipse.org/tptp/test/reports/4.5_i4_TP1/index.html) that the same test execution result appears more than one in the TPTP Test Report, therefore corrupting the test pass results.  This is caused by the execution result referencing more than one test suite with the same ID.  This is the result of creating test suites by copying a *.testsuite file, which does not update the ID of the copied test suite (see https://bugs.eclipse.org/bugs/show_bug.cgi?id=166025).

To resolve this problem, the below files require following updates by the Project Leads (or their delegates):

1) For each pair of test suites, determine which test suite was copied.
2) Create a new test suite to replace the copied test suite, including the same test cases and test behavior.
3) Delete the copied test suite.
4) Update the test suite(s) (e.g. AllTests.test suite) referencing the deleted/copied test suite by removing and re-adding the test invocation of the deleted/copied test suite.
5) Regenerate the execution results for the deleted/copied test suite for the current test pass (e.g. 4.5 I4 TP1 or TP2).

Platform:

org.eclipse.hyades.probekit.tests\test-resources\AllTests.testsuite and org.eclipse.hyades.probekit.tests\test-resources\AllSmokeTests.testsuite

org.eclipse.hyades.probekit.tests\test-resources\Platform.Execution.Probekit.LaunchTypes.testsuite and org.eclipse.hyades.probekit.tests\test-resources\Platform.Execution.Probekit.LaunchTypes.JVMPI.testsuite

org.eclipse.hyades.use.cases\gui\AllTests.testsuite and org.eclipse.hyades.use.cases\gui\AllSmokeTests.testsuite

org.eclipse.hyades.use.cases\gui\Profiling_and_Logging\Report\Platform.UI.Report.testsuite and org.eclipse.hyades.use.cases\gui\Profiling_and_Logging\Report\Platform.UI.Log.Report.testsuite

org.eclipse.hyades.use.cases\manual\AllTests.testsuite and org.eclipse.hyades.use.cases\manual\AllSmokeTests.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Application_Console.Linux_IA64.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Application_Console.Linux_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Application_Console.Linux_IAEM64T.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Application_Console.Linux_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Application_Console.Windows_IA64.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Application_Console.Windows_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Application_Console.Windows_IAEM64T.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Application_Console.Windows_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Basic.Linux_IA64.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Basic.Linux_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Basic.Linux_IAEM64T.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Basic.Linux_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Basic.Windows_IA64.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Basic.Windows_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Basic.Windows_IAEM64T.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_Basic.Windows_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_File_Transfer.Linux_IA64.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_File_Transfer.Linux_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_File_Transfer.Linux_IAEM64T.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_File_Transfer.Linux_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_File_Transfer.Windows_IA64.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_File_Transfer.Windows_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_File_Transfer.Windows_IAEM64T.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.Communication.New_Agent_Controller_File_Transfer.Windows_IA32.testsuite

org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.UI.LogSets.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.UI.ImportMultiLogFiles.testsuite

org.eclipse.tptp.platform.common.ui.tests\junit\LocationValidatorTest.testsuite and org.eclipse.hyades.test.java.tests\junit\Test.JUnit.JUnitTestGeneration.testsuite


Test:

org.eclipse.hyades.test.ui.datapool.tests\manual\datapool\Test.UI.DatapoolEditor_editing.testsuite and org.eclipse.hyades.test.ui.datapool.tests\manual\datapool\Test.UI.DatapoolEditor_basic.testsuite

org.eclipse.hyades.test.URLTest.tests\manual\FVT\68553\ExecutionBucket.testsuite and org.eclipse.hyades.test.URLTest.tests\manual\basic_tests\Test.Execution.URLRunner.testsuite

org.eclipse.hyades.test.URLTest.tests\manual\Smoke_Tests\Test.UI.URLTest.Linux.testsuite and org.eclipse.hyades.test.URLTest.tests\manual\basic_tests\Test.UI.URLTest.Linux.testsuite

org.eclipse.hyades.test.URLTest.tests\manual\Smoke_Tests\Test.UI.URLTest.Windows.testsuite and org.eclipse.hyades.test.URLTest.tests\manual\basic_tests\Test.UI.URLTest.Windows.testsuite

org.eclipse.tptp.test.testservices.tests\junit\Test.IBM15_TestServices.testsuite and org.eclipse.tptp.test.testservices.tests\junit\Test.IBM142_TestServices.testsuite

org.eclipse.tptp.test.testservices.tests\junit\Test.Sun142_TestServices.testsuite and org.eclipse.tptp.test.testservices.tests\junit\Test.IBM142_TestServices.testsuite

org.eclipse.tptp.test.testservices.tests\junit\Test.Sun15_TestServices.testsuite and org.eclipse.tptp.test.testservices.tests\junit\Test.IBM142_TestServices.testsuite


Trace:

org.eclipse.hyades.trace.ui.tests\plugin-junit\AllTests.testsuite and org.eclipse.hyades.trace.ui.tests\plugin-junit\AllSmokeTests.testsuite

org.eclipse.tptp.trace.use.cases\manual\Profiling_and_Logging\Trace.UI.Thread.Stat.View.testsuite and org.eclipse.tptp.trace.use.cases\manual\Profiling_and_Logging\Trace.UI.ObjectAlloc.Stat.View.testsuite


Monitoring:

org.eclipse.tptp.monitoring.managedagent.test\junit\agent\JMXAgentTest.testsuite and org.eclipse.tptp.monitoring.managedagent.jmx.test\junit\agent\JMXAgentTest.testsuite

org.eclipse.tptp.monitoring.managedagent.test\junit\helper\MBeanHelperTest.testsuite and org.eclipse.tptp.monitoring.managedagent.jmx.test\junit\helper\MBeanHelperTest.testsuite

org.eclipse.tptp.monitoring.managedagent.test\manual\Monitor.UI.ManagedResourcesExplorer.TomcatMBeanTest.testsuite and org.eclipse.tptp.monitoring.managedagent.jmx.test\manual\TomcatMBeanTest.testsuite

org.eclipse.tptp.monitoring.managedagent.test\manual\Monitor.UI.ManagedResourcesExplorer_IBMJava150.testsuite and org.eclipse.tptp.monitoring.managedagent.test\manual\Monitor.UI.ManagedResourcesExplorer_IBMJava142.testsuite

org.eclipse.tptp.monitoring.managedagent.test\manual\Monitor.UI.ManagedResourcesExplorer_SUNJava142.testsuite and org.eclipse.tptp.monitoring.managedagent.test\manual\Monitor.UI.ManagedResourcesExplorer_IBMJava142.testsuite

org.eclipse.tptp.monitoring.managedagent.test\manual\Monitor.UI.ManagedResourcesExplorer_SUNJava150.testsuite and org.eclipse.tptp.monitoring.managedagent.test\manual\Monitor.UI.ManagedResourcesExplorer_IBMJava142.testsuite

org.eclipse.tptp.monitoring.tests\gui\Monitor.Analysis.LogImport\Monitor.Analysis.LogImport_Windows_Vista.testsuite and org.eclipse.tptp.monitoring.tests\gui\Monitor.Analysis.LogImport\Monitor.Analysis.LogImport_Windows_EM64T.testsuite

org.eclipse.tptp.monitoring.tests\gui\Monitor.Analysis.LogImport_Windows_Event_Logs\MonitorAnalysisLogImportWindowsEvent_Windows_Vista.testsuite and org.eclipse.tptp.monitoring.tests\gui\Monitor.Analysis.LogImport_Windows_Event_Logs\MonitorAnalysisLogImportWindowsEvent_Windows_EM64T.testsuite

org.eclipse.tptp.monitoring.tests\gui\Monitor.UI.ImportSymptomDB\Monitor.UI.ImportSymptomDB.LocalSymptomImportTest2.testsuite and org.eclipse.tptp.monitoring.tests\gui\Monitor.UI.ImportSymptomDB\Monitor.UI.ImportSymptomDB.LocalSymptomImportTest1.testsuite

org.eclipse.tptp.monitoring.tests\gui\Monitor.UI.ImportSymptomDB\Monitor.UI.ImportSymptomDB.RemoteSymptomImportTest1.testsuite and org.eclipse.tptp.monitoring.tests\gui\Monitor.UI.ImportSymptomDB\Monitor.UI.ImportSymptomDB.LocalSymptomImportTest1.testsuite

org.eclipse.tptp.monitoring.tests\gui\Monitor.UI.ImportSymptomDB\Monitor.UI.ImportSymptomDB.RemoteSymptomImportTest2.testsuite and org.eclipse.tptp.monitoring.tests\gui\Monitor.UI.ImportSymptomDB\Monitor.UI.ImportSymptomDB.LocalSymptomImportTest1.testsuite

org.eclipse.tptp.monitoring.tests\manual\Profiling_and_Logging\Monitor.Analysis.LogImport.Windows_IPF.testsuite and org.eclipse.tptp.monitoring.tests\manual\Profiling_and_Logging\Monitor.Analysis.LogImport.Solaris_SPARC.testsuite

org.eclipse.tptp.monitoring.tests\manual\Profiling_and_Logging\Monitor.Analysis.StandaloneGLA.Windows_Vista.testsuite and org.eclipse.tptp.monitoring.tests\manual\Profiling_and_Logging\Monitor.Analysis.StandaloneGLA.Windows_EM64T.testsuite

org.eclipse.tptp.monitoring.tests\manual\Profiling_and_Logging\Monitor.Analysis.StandaloneGLA_Windows_Vista_Event_Logs.testsuite and org.eclipse.tptp.monitoring.tests\manual\Profiling_and_Logging\Monitor.Analysis.StandaloneGLA_Windows_IPF_Event_Logs.testsuite

org.eclipse.tptp.wsdm.editor.test\junit\manageableResourceType\prototype\command\AllPrototypeCommandTest.testsuite and org.eclipse.tptp.wsdm.editor.test\junit\capability\overview\command\AllOverviewCommandTest.testsuite

org.eclipse.tptp.wsdm.editor.test\junit\manageableResourceType\prototype\command\ChangeMRTNameCommandTest.testsuite and org.eclipse.tptp.wsdm.editor.test\junit\capability\overview\command\ChangeCapabilityNameCommandTest.testsuite

org.eclipse.tptp.wsdm.editor.test\junit\manageableResourceType\prototype\command\ChangeMRTNamespaceCommandTest.testsuite and org.eclipse.tptp.wsdm.editor.test\junit\capability\overview\command\ChangeCapabilityNameCommandTest.testsuite

org.eclipse.tptp.wsdm.editor.test\manual\capability\AllTests_IBMJava150.testsuite and org.eclipse.tptp.wsdm.editor.test\manual\capability\AllTests_IBMJava142.testsuite

org.eclipse.tptp.wsdm.editor.test\manual\capability\AllTests_SUNJava142.testsuite and org.eclipse.tptp.wsdm.editor.test\manual\capability\AllTests_IBMJava142.testsuite

org.eclipse.tptp.wsdm.editor.test\manual\capability\AllTests_SUNJava150.testsuite and org.eclipse.tptp.wsdm.editor.test\manual\capability\AllTests_IBMJava142.testsuite

org.eclipse.tptp.wsdm.editor.test\manual\capability\Monitor.UI.WSDM_Tooling_Editor_Capability.testsuite and org.eclipse.tptp.wsdm.editor.test\manual\capability\Capablity.testsuite

org.eclipse.tptp.wsdm.editor.test\manual\dd\AllTests_IBMJava150.testsuite and org.eclipse.tptp.wsdm.editor.test\manual\dd\AllTests_IBMJava142.testsuite

org.eclipse.tptp.wsdm.editor.test\manual\dd\AllTests_SUNJava142.testsuite and org.eclipse.tptp.wsdm.editor.test\manual\dd\AllTests_IBMJava142.testsuite

org.eclipse.tptp.wsdm.editor.test\manual\dd\AllTests_SUNJava150.testsuite and org.eclipse.tptp.wsdm.editor.test\manual\dd\AllTests_IBMJava142.testsuite

org.eclipse.tptp.wsdm.editor.test\manual\mrt\AllTests_IBMJava150.testsuite and org.eclipse.tptp.wsdm.editor.test\manual\mrt\AllTests_IBMJava142.testsuite

org.eclipse.tptp.wsdm.editor.test\manual\mrt\AllTests_SUNJava142.testsuite and org.eclipse.tptp.wsdm.editor.test\manual\mrt\AllTests_IBMJava142.testsuite

org.eclipse.tptp.wsdm.editor.test\manual\mrt\AllTests_SUNJava150.testsuite and org.eclipse.tptp.wsdm.editor.test\manual\mrt\AllTests_IBMJava142.testsuite