Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 218779

Summary: Test Tools documentation I5/I6 smoke test failures.
Product: z_Archived Reporter: Paul Slauenwhite <paulslau>
Component: TPTPAssignee: Paul Slauenwhite <paulslau>
Status: CLOSED FIXED QA Contact:
Severity: normal    
Priority: P1 CC: analexee, apnan, jkubasta, ruthdaly
Version: unspecified   
Target Milestone: ---   
Hardware: All   
OS: All   
Whiteboard:
Bug Depends on: 219845, 223230    
Bug Blocks:    
Attachments:
Description Flags
I6 Smoke Test Errors
none
Patch
none
Patch (Part 2) none

Description Paul Slauenwhite CLA 2008-02-13 08:30:13 EST
Test Tools documentation I5 smoke test failures.

************
[Error] notices.html must be created in D:\AC_Hyades_WSAD_Drivers\Smoke_Test\doc\tptp\test\runtime\org.eclipse.hyades.test.doc.user
[Error] notices.html must be a file containing the legal information for the plug-in D:\AC_Hyades_WSAD_Drivers\Smoke_Test\doc\tptp\test\runtime\org.eclipse.hyades.test.doc.user
************

--------------------------------------------------------------
Documentation Directory org.eclipse.hyades.test.doc.user...[D:\AC_Hyades_WSAD_Drivers\Smoke_Test\doc\tptp\test\runtime\org.eclipse.hyades.test.doc.user]
--------------------------------------------------------------
[orphan] concepts/cartifacteditor.htm
[orphan] concepts/ccommontestingtasksandconcepts.htm
[orphan] concepts/cdatapools.htm
[orphan] concepts/cdeployeditor.htm
[orphan] concepts/cedittest.htm
[orphan] concepts/cintro.htm
[orphan] concepts/cjunitintro.htm
[orphan] concepts/cJUnitTestEditor.htm
[orphan] concepts/clocationeditor.htm
[orphan] concepts/coverview-of-the-automatable-services-framework.htm
[orphan] concepts/cpluginTestEditor.htm
[orphan] concepts/ctestwithhyades.htm
[orphan] concepts/cworkbenchLocationEditor.htm
[orphan] concepts/c_viewingtestresults.html
[orphan] ref/rdeploymentGroundRules.htm
[orphan] ref/rgenericlaunchconfigprops.htm
[orphan] ref/rreferencesoverview.htm
[orphan] ref/rsupported-test-execution-service-properties.htm
[orphan] ref/r_testlog_events.html
[orphan] ref/r_testlog_overview.html
[orphan] ref/r_testlog_toolbar.html
[orphan] samples/saccessdp.htm
[orphan] tasks/tassociateartifact.htm
[orphan] tasks/tcreateartifact.htm
[orphan] tasks/tcreatedp.htm
[orphan] tasks/tcreatejunit.htm
[orphan] tasks/tcreatelocation.htm
[orphan] tasks/tcreateperformancetestreports.htm
[orphan] tasks/tcreatePluginProject.htm
[orphan] tasks/tcreatePluginTest.htm
[orphan] tasks/tcreatetestdeployment.htm
[orphan] tasks/tcreatetestreports.htm
[orphan] tasks/tcreateWorkbenchLocation.htm
[orphan] tasks/tdatapool.htm
[orphan] tasks/tdeploy.htm
[orphan] tasks/tdeploy2.htm
[orphan] tasks/tdeploymentintro.htm
[orphan] tasks/teditdp.htm
[orphan] tasks/texecuting-the-test-execution-service.htm
[orphan] tasks/tgenerateexecutabletest.htm
[orphan] tasks/tlaunching-tests-from-scripts-and-applications.htm
[orphan] tasks/topendp.htm
[orphan] tasks/tptpJUnitTest_addingTestMethods.htm
[orphan] tasks/tptpJUnitTest_creatingManually.htm
[orphan] tasks/tptpJUnitTest_importing.htm
[orphan] tasks/tptpJUnitTest_testMethods.htm
[orphan] tasks/trecordtest.html
[orphan] tasks/trun.htm
[orphan] tasks/trunningjunittestsuite.htm
[orphan] tasks/t_associating_defects.html
[orphan] tasks/t_openinglogs.html
[orphan] tasks/t_searching_testlogs.html
[orphan] tasks/t_submitting_defects.html
[orphan] tasks/t_viewingevents.html

************
[Error] notices.html must be created in D:\AC_Hyades_WSAD_Drivers\Smoke_Test\doc\tptp\test\sdk\org.eclipse.tptp.test.doc.isv
[Error] notices.html must be a file containing the legal information for the plug-in D:\AC_Hyades_WSAD_Drivers\Smoke_Test\doc\tptp\test\sdk\org.eclipse.tptp.test.doc.isv
************

--------------------------------------------------------------
Documentation Directory org.eclipse.tptp.test.doc.isv...[D:\AC_Hyades_WSAD_Drivers\Smoke_Test\doc\tptp\test\sdk\org.eclipse.tptp.test.doc.isv]
--------------------------------------------------------------
[orphan] concepts/c_exnewtestrec.html
[orphan] concepts/c_genrecframework.html
[orphan] concepts/c_recuiwizard.html
[orphan] concepts/c_testrecorders.html
[orphan] tasks/t_cretestrec.html
[orphan] tasks/t_extgenrec.html
[orphan] tasks/t_portrecorder.html
Comment 1 Paul Slauenwhite CLA 2008-02-13 09:19:52 EST
Testing plug-ins with JUnit >> Creating a JUnit plug-in test contains Tutorial: Accessing a datapool from a JUnit test and not:

Creating a JUnit test manually
Importing an existing JUnit test
Comment 2 Paul Slauenwhite CLA 2008-03-31 12:14:06 EDT
Deferring to I7 as discussed by PMC/AG (http://wiki.eclipse.org/TPTP-AG-20080331#Test_Project).
Comment 3 Paul Slauenwhite CLA 2008-03-31 13:11:48 EDT
I6 smoke test failures:

org.eclipse.tptp.test.recorders.url:

CHKPII v10.01               Check Translated PII Files           03/31/08 02:17
                      NLV Directory:      /workspace/plugins/org.eclipse.tptp.test.recorders.url/
                      List-of-Files:      /workspace/includeFile/pii-include-plugin-org.eclipse.tptp.test.recorders.url.txt
                      Exclude File:       /workspace/excludeFile/pii-exclude-plugin-org.eclipse.tptp.test.recorders.url.txt
                      Parameters:         Process subdirectories,  List errors/warnings ONLY,  Report TM markup errors,  Case-sensitive file names,  Check variant chars

  File          Type       Msgid  Status                   >>>>   IBM Authorized Use Only   <<<<L
---------------------------------------------------------------------------------------------------------------------

src-ui/org/eclipse/tptp/test/recorders/url/ui/internal/resources/
  messages.properties  JAVA2-PRB   919   Found 2 consecutive single quotes in text not handled by Java MessageFormat class. Remove 1 quote.  Line: 51


---------------------------------------------------------------------------------------------------------------------
  Msgid   Count   Message Summary   (Help: http://w3-03.ibm.com/globalization/page/2190#HDRHERRMSG)
---------------------------------------------------------------------------------------------------------------------
   919       1    Found 2 consecutive single quotes in text not handled by Java MessageFormat class. Remove 1 quote.  Line: ****


---------------------------------------------------------------------------------------------------------------------
          Count   TM Markup Summary
---------------------------------------------------------------------------------------------------------------------
             5    IBMUJDK2    (UTF-8)
             1    IBMXMECL    (UTF-8)


---------------------------------------------------------------------------------------------------------------------
          Count   File Type Summary
---------------------------------------------------------------------------------------------------------------------
             5    JAVA2-PRB
             1    XML-WSWECL
---------------------------------------------------------------------------------------------------------------------
                 6   Files 
                 6   Files Checked 
                 5   Files Contain No Errors/Warnings
                 1   Files Contain Errors
                 0   Files Contain Warnings Only
                 0   Files Could Not Be Processed

-------------------  End of Listing  --------------------  IBM Authorized Use Only  ---------------------------------

org.eclipse.tptp.test.tools.manual:

CHKPII v10.01               Check Translated PII Files           03/31/08 02:13
                      NLV Directory:      /workspace/features/org.eclipse.tptp.test.tools.manual/
                      List-of-Files:      /workspace/includeFile/pii-include-feature-org.eclipse.tptp.test.tools.manual.txt
                      Exclude File:       /workspace/excludeFile/pii-exclude-feature-org.eclipse.tptp.test.tools.manual.txt
                      Parameters:         Process subdirectories,  List errors/warnings ONLY,  Report TM markup errors,  Case-sensitive file names,  Check variant chars

  File          Type       Msgid  Status                   >>>>   IBM Authorized Use Only   <<<<L
---------------------------------------------------------------------------------------------------------------------

sourceTemplatePlugin/
  about.properties  JAVA2-PRB   914   Separator between string ID and text should be '='.  May be invalid text continuation.  Line: 36


---------------------------------------------------------------------------------------------------------------------
  Msgid   Count   Message Summary   (Help: http://w3-03.ibm.com/globalization/page/2190#HDRHERRMSG)
---------------------------------------------------------------------------------------------------------------------
   914       1    Separator between string ID and text should be '****'.  May be invalid text continuation.  Line: ****


---------------------------------------------------------------------------------------------------------------------
          Count   TM Markup Summary
---------------------------------------------------------------------------------------------------------------------
             5    IBMUJDK2    (UTF-8)


---------------------------------------------------------------------------------------------------------------------
          Count   File Type Summary
---------------------------------------------------------------------------------------------------------------------
             5    JAVA2-PRB
---------------------------------------------------------------------------------------------------------------------
                 5   Files 
                 5   Files Checked 
                 4   Files Contain No Errors/Warnings
                 1   Files Contain Errors
                 0   Files Contain Warnings Only
                 0   Files Could Not Be Processed

-------------------  End of Listing  --------------------  IBM Authorized Use Only  ---------------------------------
Comment 4 Paul Slauenwhite CLA 2008-03-31 13:33:23 EDT
Created attachment 94263 [details]
I6 Smoke Test Errors
Comment 5 Paul Slauenwhite CLA 2008-03-31 14:15:47 EDT
Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/concepts/cintro.htm - Line: 91 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/concepts/../tasks/tcreatetestreports.htm

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/concepts/cworkbenchLocationEditor.htm - Line: 97 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/concepts/../tasks/tdeploymentintro.htm

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/tdeploy2.htm - Line: 50 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/../concepts/cartifacteditor.htm

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/tdeploy2.htm - Line: 51 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/../concepts/cdeployeditor.htm

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/tcreatePluginTest.htm - Line: 59 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/../concepts/cJUnitTestEditor.htm

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/tdeploy2.htm - Line: 52 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/../concepts/clocationeditor.htm

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/tdeploy2.htm - Line: 60 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/../tasks/tassociateartifact.htm

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/tdeploy2.htm - Line: 57 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/../tasks/tcreateartifact.htm

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/tdeploy2.htm - Line: 59 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/../tasks/tcreatelocation.htm

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/tdeploy2.htm - Line: 58 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/../tasks/tcreatetestdeployment.htm

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/tdeploy.htm - Line: 44 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.tools.junit.plugin.doc.user/tasks/tdeploymentintro.htm 


Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.recorders.url.doc.user/tasks/trecordtest.html - Line: 40 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.recorders.url.doc.user/tasks/../../org.eclipse.tptp.platform.agentcontroller.doc.user/concepts/rac/ciacintro.html

Check Links
Test Suite: Check Links - [No Project File]
	

Source: D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.recorders.url.doc.user/tasks/trecordtest.html - Line: 40 - Severity: n/a
Broken Link: file:/D:/TPTP/Smoke_Test/doc/tptp/test/sdk/org.eclipse.tptp.test.recorders.url.doc.user/tasks/../../org.eclipse.tptp.platform.agentcontroller.doc.user/tasks/rac/tworkwac.html 

Comment 6 Paul Slauenwhite CLA 2008-04-02 20:50:24 EDT
(In reply to comment #3)
 
Covered under defect 223230.
Comment 7 Paul Slauenwhite CLA 2008-04-04 08:20:29 EDT
Smoke tests must be performed on the following Test Project plug-ins:

org.eclipse.hyades.test.doc.user
org.eclipse.tptp.platform.report.birt.doc.user
org.eclipse.tptp.test.doc.isv
org.eclipse.tptp.test.recorders.url.doc.user
org.eclipse.tptp.test.report.birt.doc.user
org.eclipse.tptp.test.tools.junit.plugin.doc.user
org.eclipse.tptp.test.tools.manual.doc.user
Comment 8 Paul Slauenwhite CLA 2008-04-04 08:53:46 EDT
(In reply to comment #7)
> Smoke tests must be performed on the following Test Project plug-ins:
> 
> org.eclipse.hyades.test.doc.user
> org.eclipse.tptp.platform.report.birt.doc.user
> org.eclipse.tptp.test.doc.isv
> org.eclipse.tptp.test.recorders.url.doc.user
> org.eclipse.tptp.test.report.birt.doc.user
> org.eclipse.tptp.test.tools.junit.plugin.doc.user
> org.eclipse.tptp.test.tools.manual.doc.user
> 

The documentation smoke tests need to be refactored to handle the following:

1) Process TOC files not in the root directory of a documentation plug-in.  The solution is to retrieve the path for the TOC files from the implementations of the org.eclipse.help.toc extension point in the plugin.xml.

2) Process the following missing documentation plug-ins:

org.eclipse.tptp.test.report.birt.doc.user (runtime only): Caused by https://bugs.eclipse.org/bugs/show_bug.cgi?id=219845 since this plug-in is not shipped with the run-time ZIP.  Also, when 219845, only the empty plug-in is processed by the documentation smoke tests since it does not handle as-is components. 

org.eclipse.tptp.test.tools.manual.doc.user: Update documentation smoke tests to handle as-is components. 


Comment 9 Paul Slauenwhite CLA 2008-04-04 09:08:09 EDT
Created attachment 94837 [details]
Patch
Comment 10 Paul Slauenwhite CLA 2008-04-04 09:08:49 EDT
Hours worked on triage, patch, and refactoring the documentation smoke tests.
Comment 11 Paul Slauenwhite CLA 2008-04-04 09:35:11 EDT
(In reply to comment #8)

> 2) Process the following missing documentation plug-ins:
> 
> org.eclipse.tptp.test.report.birt.doc.user (runtime only): Caused by
> https://bugs.eclipse.org/bugs/show_bug.cgi?id=219845 since this plug-in is not
> shipped with the run-time ZIP.  Also, when 219845, only the empty plug-in is
> processed by the documentation smoke tests since it does not handle as-is
> components. 
> 
> org.eclipse.tptp.test.tools.manual.doc.user: Update documentation smoke tests
> to handle as-is components. 

Not required since we do not test as-is components. 

Comment 12 Paul Slauenwhite CLA 2008-04-04 10:05:13 EDT
(In reply to comment #8)

> The documentation smoke tests need to be refactored to handle the following:
> 
> 1) Process TOC files not in the root directory of a documentation plug-in.  The
> solution is to retrieve the path for the TOC files from the implementations of
> the org.eclipse.help.toc extension point in the plugin.xml.

Complete and checked in to CVS (HEAD):

/test-results/platform/org.eclipse.hyades.use.cases/resources/Doc_smoke.zip

Project Leads: Please continue to use this version of the documentation smoke tests.
Comment 13 Paul Slauenwhite CLA 2008-04-04 10:08:04 EDT
Created attachment 94851 [details]
Patch (Part 2)
Comment 14 Paul Slauenwhite CLA 2008-04-09 15:58:14 EDT
Patches checked in to CVS (HEAD).
Comment 15 Paul Slauenwhite CLA 2008-06-10 10:57:32 EDT
Verified in TPTP-4.5.0RC3-200806031051.  Closing.