Bugzilla – Full Text Bug Listing
| Summary: | TPTP test results are not reported correctly. | ||
|---|---|---|---|
| Product: | z_Archived | Reporter: | Paul Slauenwhite <paulslau> |
| Component: | TPTP | Assignee: | jkubasta |
| Status: | CLOSED FIXED | QA Contact: | |
| Severity: | major | ||
| Priority: | P1 | Keywords: | plan |
| Version: | unspecified | ||
| Target Milestone: | --- | ||
| Hardware: | All | ||
| OS: | All | ||
| Whiteboard: | |||
|
Description
Paul Slauenwhite
Can you include this in the 4.5 plan (P1 priority/plan keyword)? Changes checked in for all but the following, to date: Platform: org.eclipse.hyades.probekit.tests\test-resources\AllTests.testsuite and org.eclipse.hyades.probekit.tests\test-resources\AllSmokeTests.testsuite org.eclipse.hyades.use.cases\gui\AllTests.testsuite and org.eclipse.hyades.use.cases\gui\AllSmokeTests.testsuite org.eclipse.hyades.use.cases\gui\Profiling_and_Logging\Report\Platform.UI.Report.testsuite and org.eclipse.hyades.use.cases\gui\Profiling_and_Logging\Report\Platform.UI.Log.Report.testsuite org.eclipse.hyades.use.cases\manual\AllTests.testsuite and org.eclipse.hyades.use.cases\manual\AllSmokeTests.testsuite org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.UI.LogSets.testsuite and org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.UI.ImportMultiLogFiles.testsuite org.eclipse.tptp.platform.common.ui.tests\junit\LocationValidatorTest.testsuite and org.eclipse.hyades.test.java.tests\junit\Test.JUnit.JUnitTestGeneration.testsuite org.eclipse.hyades.probekit.tests\test-resources\AllSmokeTests.testsuite replaced with org.eclipse.hyades.probekit.tests\test-resources\All_Smoke_Tests.testsuite org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.UI.ImportMultiLogFiles.testsuite replaced with org.eclipse.hyades.use.cases\manual\Profiling_and_Logging\Platform.UI.Import_Multi_LogFiles.testsuite org.eclipse.hyades.use.cases\gui\AllSmokeTests.testsuite replaced with org.eclipse.hyades.use.cases\gui\All_Smoke_Tests.testsuite. Additionally, the following tests were omitted from the new file: 1. CodeCoverage 2. AllSmokeTests org.eclipse.hyades.use.cases\gui\AllSmokeTests.testsuite was replaced with org.eclipse.hyades.use.cases\gui\All_Smoke_Tests.testsuite Paul, please tell me how I move the testcases in org.eclipse.hyades.use.cases\gui\Profiling_and_Logging\Report\Platform.UI.Log.Report.testsuite into the new testcase org.eclipse.hyades.use.cases\manual\AllSmokeTests.testsuite replaced with org.eclipse.hyades.use.cases\manual\All_Smoke_Tests.testsuite Paul, org.eclipse.hyades.test.java.tests\junit\Test.JUnit.JUnitTestGeneration.testsuite appears to be a copy of org.eclipse.tptp.platform.common.ui.tests\junit\LocationValidatorTest.testsuite . Please update (In reply to comment #7) > Paul, please tell me how I move the testcases in > org.eclipse.hyades.use.cases\gui\Profiling_and_Logging\Report\Platform.UI.Log.Report.testsuite > into the new testcase > 1) Create a new AGR test suite. 2) Create new test cases in that AGR test suite (note, you need to start the AGR recorder and immediately stop it to create a new AGR test case). 3) Copy the object mine. 4) Copy the test case macro. 5) Save. (In reply to comment #9) > Paul, > org.eclipse.hyades.test.java.tests\junit\Test.JUnit.JUnitTestGeneration.testsuite > appears to be a copy of > org.eclipse.tptp.platform.common.ui.tests\junit\LocationValidatorTest.testsuite > . Please update > org.eclipse.hyades.test.java.tests\junit\Test.JUnit.JUnitTestGeneration.testsuite has since been updated. However, I did notice that org.eclipse.tptp.platform.common.ui.tests\junit\LocationValidatorTest.testsuite does not have an ID property. Can you recreate the test suite again? Note, you can import the JUnit Test class (File >> Import... >> Test >> JUnit tests to TPTP). org.eclipse.hyades.use.cases\gui\Profiling_and_Logging\Report\Platform.UI.Log.Report.testsuite replaced with org.eclipse.hyades.use.cases\gui\Profiling_and_Logging\Report\Platform_UI_Log_Report.testsuite org.eclipse.tptp.platform.common.ui.tests\junit\LocationValidatorTest.testsuite replaced with org.eclipse.tptp.platform.common.ui.tests\junit\Location_Validator_Test.testsuite Paul, please verify when you have a chance The test suites that were updated now do not appear in the I7 TP report (http://www.eclipse.org/tptp/test/reports/4.5_i7_TP1/index.html). When a new test it created, it needs to be added to the root test suite(s) (e.g. AllTests.testsuite, AllSmoketests.testsuite) for that plug-in (see http://www.eclipse.org/tptp/home/documents/process/TPTP_Testing_Strategy.html#2.0) to be included in the test reports. resolved as far as I can tell. Please reopen if you disagree Verified in http://www.eclipse.org/tptp/test/reports/4.5_i8_TP2/index.html. Closing. |