Download
Getting Started
Members
Projects
Community
Marketplace
Events
Planet Eclipse
Newsletter
Videos
Participate
Report a Bug
Forums
Mailing Lists
Wiki
IRC
How to Contribute
Working Groups
Automotive
Internet of Things
LocationTech
Long-Term Support
PolarSys
Science
OpenMDM
More
Community
Marketplace
Events
Planet Eclipse
Newsletter
Videos
Participate
Report a Bug
Forums
Mailing Lists
Wiki
IRC
How to Contribute
Working Groups
Automotive
Internet of Things
LocationTech
Long-Term Support
PolarSys
Science
OpenMDM
Toggle navigation
Bugzilla – Attachment 102509 Details for
Bug 211777
Provide TPTP Testing Process (part 1 and part 2).
Home
|
New
|
Browse
|
Search
|
[?]
|
Reports
|
Requests
|
Help
|
Log In
[x]
|
Terms of Use
|
Copyright Agent
Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read
this important communication.
Updated Part 1 document
TPTP_Testing_Strategy_Part_1.html (text/html), 75.50 KB, created by
Alan Haggarty
on 2008-05-28 16:19:29 EDT
(
hide
)
Description:
Updated Part 1 document
Filename:
MIME Type:
Creator:
Alan Haggarty
Created:
2008-05-28 16:19:29 EDT
Size:
75.50 KB
patch
obsolete
><html xmlns:v="urn:schemas-microsoft-com:vml" >xmlns:o="urn:schemas-microsoft-com:office:office" >xmlns:w="urn:schemas-microsoft-com:office:word" >xmlns="http://www.w3.org/TR/REC-html40"> > ><head> ><meta http-equiv=Content-Type content="text/html; charset=windows-1252"> ><meta name=ProgId content=Word.Document> ><meta name=Generator content="Microsoft Word 10"> ><meta name=Originator content="Microsoft Word 10"> ><link rel=File-List href="TPTP_Testing_Strategy_Part_1_files/filelist.xml"> ><link rel=Edit-Time-Data href="TPTP_Testing_Strategy_Part_1_files/editdata.mso"> ><!--[if !mso]> ><style> >v\:* {behavior:url(#default#VML);} >o\:* {behavior:url(#default#VML);} >w\:* {behavior:url(#default#VML);} >.shape {behavior:url(#default#VML);} ></style> ><![endif]--> ><title>TPTP Testing Strategy Part 1</title> ><!--[if gte mso 9]><xml> > <o:DocumentProperties> > <o:Author>chng1me</o:Author> > <o:LastAuthor>chng1me</o:LastAuthor> > <o:Revision>87</o:Revision> > <o:TotalTime>10838</o:TotalTime> > <o:Created>2007-11-29T02:51:00Z</o:Created> > <o:LastSaved>2008-05-28T20:16:00Z</o:LastSaved> > <o:Pages>1</o:Pages> > <o:Words>2257</o:Words> > <o:Characters>12870</o:Characters> > <o:Company>IBM</o:Company> > <o:Lines>107</o:Lines> > <o:Paragraphs>30</o:Paragraphs> > <o:CharactersWithSpaces>15097</o:CharactersWithSpaces> > <o:Version>10.6817</o:Version> > </o:DocumentProperties> ></xml><![endif]--><!--[if gte mso 9]><xml> > <w:WordDocument> > <w:SpellingState>Clean</w:SpellingState> > <w:GrammarState>Clean</w:GrammarState> > <w:Compatibility> > <w:BreakWrappedTables/> > <w:SnapToGridInCell/> > <w:WrapTextWithPunct/> > <w:UseAsianBreakRules/> > </w:Compatibility> > <w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel> > </w:WordDocument> ></xml><![endif]--> ><style> ><!-- > /* Style Definitions */ > p.MsoNormal, li.MsoNormal, div.MsoNormal > {mso-style-parent:""; > margin:0in; > margin-bottom:.0001pt; > mso-pagination:widow-orphan; > font-size:12.0pt; > font-family:"Times New Roman"; > mso-fareast-font-family:"Times New Roman";} >a:link, span.MsoHyperlink > {color:blue; > text-decoration:underline; > text-underline:single;} >a:visited, span.MsoHyperlinkFollowed > {color:purple; > text-decoration:underline; > text-underline:single;} >p > {mso-margin-top-alt:auto; > margin-right:0in; > mso-margin-bottom-alt:auto; > margin-left:0in; > mso-pagination:widow-orphan; > font-size:12.0pt; > font-family:"Times New Roman"; > mso-fareast-font-family:"Times New Roman";} >code > {font-family:"Courier New"; > mso-ascii-font-family:"Courier New"; > mso-fareast-font-family:"Times New Roman"; > mso-hansi-font-family:"Courier New"; > mso-bidi-font-family:"Courier New";} >span.resultoftext > {mso-style-name:resultoftext;} >span.filepath > {mso-style-name:filepath;} >span.uicontrol > {mso-style-name:uicontrol;} >span.SpellE > {mso-style-name:""; > mso-spl-e:yes;} >span.GramE > {mso-style-name:""; > mso-gram-e:yes;} >@page Section1 > {size:8.5in 11.0in; > margin:1.0in 1.25in 1.0in 1.25in; > mso-header-margin:.5in; > mso-footer-margin:.5in; > mso-paper-source:0;} >div.Section1 > {page:Section1;} > /* List Definitions */ > @list l0 > {mso-list-id:92744791; > mso-list-template-ids:-1684253540;} >@list l0:level1 > {mso-level-start-at:4; > mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l1 > {mso-list-id:141234346; > mso-list-template-ids:-289743920;} >@list l2 > {mso-list-id:174006188; > mso-list-template-ids:-1713706948;} >@list l2:level1 > {mso-level-start-at:4; > mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l2:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l2:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l2:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l2:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l2:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l2:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l2:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l2:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l3 > {mso-list-id:282734531; > mso-list-template-ids:40507662;} >@list l3:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l3:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l3:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l3:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l3:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l3:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l3:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l3:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l3:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l4 > {mso-list-id:383453367; > mso-list-template-ids:417136210;} >@list l4:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l4:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l4:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l4:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l4:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l4:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l4:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l4:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l4:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l5 > {mso-list-id:387077248; > mso-list-template-ids:364411036;} >@list l5:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l5:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l5:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l5:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l5:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l5:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l5:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l5:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l5:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l6 > {mso-list-id:463472923; > mso-list-template-ids:364411036;} >@list l6:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l6:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l6:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l6:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l6:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l6:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l6:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l6:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l6:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l7 > {mso-list-id:525607275; > mso-list-template-ids:364411036;} >@list l7:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l7:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l7:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l7:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l7:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l7:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l7:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l7:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l7:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l8 > {mso-list-id:539055317; > mso-list-template-ids:1683631112;} >@list l8:level1 > {mso-level-number-format:bullet; > mso-level-text:\F0B7; > mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in; > mso-ansi-font-size:10.0pt; > font-family:Symbol;} >@list l8:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l8:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l8:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l8:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l8:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l8:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l8:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l8:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l9 > {mso-list-id:540476659; > mso-list-template-ids:366112964;} >@list l10 > {mso-list-id:678698775; > mso-list-template-ids:2067012672;} >@list l10:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l10:level2 > {mso-level-number-format:alpha-lower; > mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l10:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l10:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l10:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l10:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l10:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l10:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l10:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l11 > {mso-list-id:733502716; > mso-list-type:hybrid; > mso-list-template-ids:-317027414 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;} >@list l11:level1 > {mso-level-number-format:bullet; > mso-level-text:\F0B7; > mso-level-tab-stop:.75in; > mso-level-number-position:left; > margin-left:.75in; > text-indent:-.25in; > font-family:Symbol;} >@list l11:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l11:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l11:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l11:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l11:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l11:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l11:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l11:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l12 > {mso-list-id:752972821; > mso-list-type:hybrid; > mso-list-template-ids:-421634994 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;} >@list l12:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l13 > {mso-list-id:764151593; > mso-list-template-ids:-473121702;} >@list l14 > {mso-list-id:875197164; > mso-list-template-ids:1192423218;} >@list l14:level1 > {mso-level-start-at:5; > mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l15 > {mso-list-id:911617600; > mso-list-template-ids:671776898;} >@list l15:level1 > {mso-level-number-format:bullet; > mso-level-text:\F0B7; > mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in; > mso-ansi-font-size:10.0pt; > font-family:Symbol;} >@list l16 > {mso-list-id:915284730; > mso-list-type:hybrid; > mso-list-template-ids:-314245460 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;} >@list l16:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l16:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l16:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l16:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l16:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l16:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l16:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l16:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l16:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l17 > {mso-list-id:963463129; > mso-list-template-ids:1104553342;} >@list l17:level1 > {mso-level-start-at:4; > mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l17:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l17:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l17:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l17:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l17:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l17:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l17:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l17:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l18 > {mso-list-id:1021663441; > mso-list-template-ids:1029086670;} >@list l18:level2 > {mso-level-number-format:alpha-lower; > mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l19 > {mso-list-id:1022901798; > mso-list-template-ids:-360950964;} >@list l19:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l19:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l19:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l19:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l19:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l19:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l19:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l19:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l19:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l20 > {mso-list-id:1026910047; > mso-list-template-ids:-287171560;} >@list l21 > {mso-list-id:1143277723; > mso-list-template-ids:2067012672;} >@list l21:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l21:level2 > {mso-level-number-format:alpha-lower; > mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l21:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l21:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l21:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l21:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l21:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l21:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l21:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l22 > {mso-list-id:1165125296; > mso-list-template-ids:1585888766;} >@list l23 > {mso-list-id:1243297063; > mso-list-template-ids:-1179326278;} >@list l24 > {mso-list-id:1261139367; > mso-list-template-ids:-1096526558;} >@list l25 > {mso-list-id:1283800744; > mso-list-template-ids:91676230;} >@list l25:level1 > {mso-level-start-at:4; > mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l26 > {mso-list-id:1331446212; > mso-list-template-ids:2067012672;} >@list l26:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l26:level2 > {mso-level-number-format:alpha-lower; > mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l26:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l26:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l26:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l26:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l26:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l26:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l26:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l27 > {mso-list-id:1336881819; > mso-list-template-ids:1406673138;} >@list l27:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l27:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l27:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l27:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l27:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l27:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l27:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l27:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l27:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l28 > {mso-list-id:1346788010; > mso-list-template-ids:11439954;} >@list l29 > {mso-list-id:1402825979; > mso-list-type:hybrid; > mso-list-template-ids:918989474 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;} >@list l29:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l30 > {mso-list-id:1561555207; > mso-list-type:hybrid; > mso-list-template-ids:-436827038 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;} >@list l30:level1 > {mso-level-number-format:bullet; > mso-level-text:\F0B7; > mso-level-tab-stop:.75in; > mso-level-number-position:left; > margin-left:.75in; > text-indent:-.25in; > font-family:Symbol;} >@list l30:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l30:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l30:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l30:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l30:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l30:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l30:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l30:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l31 > {mso-list-id:1619218184; > mso-list-template-ids:1452588582;} >@list l32 > {mso-list-id:1632784571; > mso-list-template-ids:-1248713324;} >@list l32:level1 > {mso-level-start-at:2; > mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l33 > {mso-list-id:1688942465; > mso-list-template-ids:239618888;} >@list l33:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l33:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l33:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l33:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l33:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l33:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l33:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l33:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l33:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l34 > {mso-list-id:1700815944; > mso-list-template-ids:-285804542;} >@list l34:level1 > {mso-level-start-at:2; > mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l35 > {mso-list-id:1750536643; > mso-list-template-ids:566636214;} >@list l36 > {mso-list-id:1793555678; > mso-list-type:hybrid; > mso-list-template-ids:1155423620 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;} >@list l36:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l37 > {mso-list-id:1929387494; > mso-list-template-ids:-2013595910;} >@list l37:level1 > {mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l37:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l37:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l37:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l37:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l37:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l37:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l37:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l37:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l38 > {mso-list-id:1951086013; > mso-list-type:hybrid; > mso-list-template-ids:-1031005610 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;} >@list l38:level1 > {mso-level-number-format:bullet; > mso-level-text:\F0B7; > mso-level-tab-stop:.75in; > mso-level-number-position:left; > margin-left:.75in; > text-indent:-.25in; > font-family:Symbol;} >@list l38:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l38:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l38:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l38:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l38:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l38:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l38:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l38:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l39 > {mso-list-id:1998531004; > mso-list-template-ids:-1325115436;} >@list l40 > {mso-list-id:2023051434; > mso-list-template-ids:-1138867394;} >@list l41 > {mso-list-id:2040230432; > mso-list-template-ids:329806632;} >@list l41:level1 > {mso-level-start-at:2; > mso-level-tab-stop:.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l41:level2 > {mso-level-tab-stop:1.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l41:level3 > {mso-level-tab-stop:1.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l41:level4 > {mso-level-tab-stop:2.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l41:level5 > {mso-level-tab-stop:2.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l41:level6 > {mso-level-tab-stop:3.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l41:level7 > {mso-level-tab-stop:3.5in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l41:level8 > {mso-level-tab-stop:4.0in; > mso-level-number-position:left; > text-indent:-.25in;} >@list l41:level9 > {mso-level-tab-stop:4.5in; > mso-level-number-position:left; > text-indent:-.25in;} >ol > {margin-bottom:0in;} >ul > {margin-bottom:0in;} >--> ></style> ><!--[if gte mso 10]> ><style> > /* Style Definitions */ > table.MsoNormalTable > {mso-style-name:"Table Normal"; > mso-tstyle-rowband-size:0; > mso-tstyle-colband-size:0; > mso-style-noshow:yes; > mso-style-parent:""; > mso-padding-alt:0in 5.4pt 0in 5.4pt; > mso-para-margin:0in; > mso-para-margin-bottom:.0001pt; > mso-pagination:widow-orphan; > font-size:10.0pt; > font-family:"Times New Roman";} ></style> ><![endif]--><!--[if gte mso 9]><xml> > <o:shapedefaults v:ext="edit" spidmax="8194"> > <o:colormenu v:ext="edit" fillcolor="none"/> > </o:shapedefaults></xml><![endif]--><!--[if gte mso 9]><xml> > <o:shapelayout v:ext="edit"> > <o:idmap v:ext="edit" data="1"/> > </o:shapelayout></xml><![endif]--> ></head> > ><body lang=EN-US link=blue vlink=purple style='tab-interval:.5in'> > ><div class=Section1> > ><p class=MsoNormal align=center style='text-align:center'><b><span >style='font-size:14.0pt'>TPTP Testing Strategy Part 1<o:p></o:p></span></b></p> > ><p class=MsoNormal align=center style='text-align:center'><b>Executing and >Creating TPTP tests<o:p></o:p></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal>1.0 Preparation</p> > ><p class=MsoNormal><span style='mso-spacerun:yes'> </span>1.1 Install the TPTP >Testing Tools</p> > ><p class=MsoNormal><span style='mso-spacerun:yes'> </span>1.2 Extracting the >Test Resources</p> > ><p class=MsoNormal><span style='mso-spacerun:yes'> </span>1.3 Structure of the >Test Resources</p> > ><p class=MsoNormal>2.0 Creating Tests</p> > ><p class=MsoNormal><span style='mso-spacerun:yes'> </span>2.1 Manual Test >Suites</p> > ><p class=MsoNormal><span style='mso-spacerun:yes'> </span>2.2 JUnit and JUnit >Plug-in Test Suites</p> > ><p class=MsoNormal><span style='mso-spacerun:yes'> </span>2.3 AGR Test Suites</p> > ><p class=MsoNormal>3.0 Executing Tests</p> > ><p class=MsoNormal><span style='mso-spacerun:yes'> </span>3.1 Manual Test >Suites</p> > ><p class=MsoNormal><span style='mso-spacerun:yes'> </span>3.2 <span >style='mso-bidi-font-weight:bold'>JUnit and JUnit Plug-in Test Suites<o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span >style='mso-spacerun:yes'> </span>3.3 AGR test Suites<o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'>4.0 Common Tasks<o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span >style='mso-spacerun:yes'> </span>4.1 Creating Test Suites<o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span >style='mso-spacerun:yes'> </span>4.2 Launching Test Suites<o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span >style='mso-spacerun:yes'> </span>4.3 Viewing Test Logs<o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span >style='mso-spacerun:yes'> </span>4.4 Report Test Results<o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'>5.0 Help</span></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><div class=MsoNormal align=center style='text-align:center'> > ><hr size=2 width="100%" align=center> > ></div> > ><p class=MsoNormal><sub></sub><b><span style='font-size:14.0pt'>1.0 >Preparation<o:p></o:p></span></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b>1.1 Install the TPTP testing tools<o:p></o:p></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l3 level1 lfo3;tab-stops:list .5in'>Open > the TPTP <a href="http://www.eclipse.org/tptp/home/downloads">download > site</a>. </li> > <li class=MsoNormal style='mso-list:l3 level1 lfo3;tab-stops:list .5in'>Select > the release of TPTP to be tested and download and unzip the TPTP plugins > as well as the requirements listed in the TPTP Plugins for Eclipse > section.</li> > <li class=MsoNormal style='mso-list:l3 level1 lfo3;tab-stops:list .5in'>Download > and unzip Automated GUI Recording (As Is section).</li> > <ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l3 level2 lfo3;tab-stops:list 1.0in'><i>Note: > Remember to restart eclipse with the clean option after installing the > AGR<o:p></o:p></i></li> > </ol> > <li class=MsoNormal style='mso-list:l3 level1 lfo3;tab-stops:list .5in'>If > remote execution is required download and unzip the Agent Controller > (Agent Controller section).</li> > <li class=MsoNormal style='mso-list:l3 level1 lfo3;tab-stops:list .5in'>The > Installation Guide and Release Notes are located in the Documentation > section. </li> ></ol> > ><p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> > ><p class=MsoNormal><b>1.2 Extracting the Test Resources<o:p></o:p></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><ul style='margin-top:0in' type=disc> > <li class=MsoNormal style='mso-list:l8 level1 lfo6;tab-stops:list .5in'>Test > suites, cases, deployment configurations and execution histories are > stored in the TPTP CVS repository (<span class=SpellE>dev.eclipse.org:/home/tptp</span> > or <a href="http://www.eclipse.org/tptp/">www.eclipse.org/tptp</a> > >> CVS Repository), under the <a > href="http://dev.eclipse.org/viewcvs/index.cgi/test-results/?cvsroot=TPTP_Project">test-results</a> > module.</li> > <li class=MsoNormal style='mso-list:l8 level1 lfo6;tab-stops:list .5in'>The > test-results module contains subfolders for each of the four subprojects - > monitoring, platform, test and trace - in the TPTP project. Each subfolder > contains the test projects for that subproject.</li> ></ul> > ><p class=MsoNormal><o:p> </o:p></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l19 level1 lfo9;tab-stops:list .5in'>Check > out the individual test projects under test-results/monitoring/, > test-results/platform/, test-results/test/, or test-results/trace/ to the > local workspace.</li> ></ol> > ><p class=MsoNormal style='margin-left:.75in'><b>For Example: </b><a >href="http://dev.eclipse.org/viewcvs/index.cgi/test-results/platform/org.eclipse.hyades.use.cases/?root=TPTP_Project">test-results/platform/<span >class=SpellE>org.eclipse.hyades.use.cases</span></a></p> > ><ol style='margin-top:0in' start=2 type=1> > <li class=MsoNormal style='mso-list:l41 level1 lfo12;tab-stops:list .5in'>To > ensure that the local workspace contains the latest test projects, update > at the beginning of each test pass and report generation.</li> ></ol> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b style='mso-bidi-font-weight:normal'>1.3 Structure of the >Test Resources<o:p></o:p></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l5 level1 lfo15;tab-stops:list .5in'>Test > projects must follow a defined structure. Please see Part 2 <span > style='color:red'>(link needed)</span> for the required structure of test > project contents. When structuring the internal organization of the > associated test suite folders (for example, <span class=SpellE>junit</span> > and <span class=SpellE>junit_plugin</span>), create summary test suites > for each subfolder (for example,/<span class=SpellE>junit/AllTests.testsuite</span> > and /<span class=SpellE>junit_plugin/AllTests.testsuite</span>). The > summary test suites (for example,/<span class=SpellE>junit/AllTests.testsuite</span> > and /<span class=SpellE>junit_plugin/AllTests.testsuite</span>) will > reference all test suites within the current folder. These summary test > suites are registered with the root-level JUnit and JUnit Plug-in test > suites > (test-results/platform/org.eclipse.hyades.tests/AllJUnitTests.testsuite > and > test-results/platform/org.eclipse.hyades.tests/AllJUnitPluginTests.testsuite), > thereby reducing work when creating and removing plug-in or component test > suites.</li> ></ol> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal style='margin-left:.25in'>AGR tests structure</p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l26 level1 lfo18;tab-stops:list .5in'>There > is a recommended structure for the internal content of the '<span > class=SpellE>gui</span>' folder that committers are encouraged to use when > automating existing manual test suites:</li> > <ol style='margin-top:0in' start=1 type=a> > <li class=MsoNormal style='mso-list:l26 level2 lfo18;tab-stops:list 1.0in'>The > folders that are a direct child of the '<span class=SpellE>gui</span>' > folder should correspond exactly to the folders that are a direct child > of the 'manual' folder. When structuring the internal organization of the > associated test suite folder (for example, <span class=SpellE>gui</span>), > create a summary test suite for the subfolder (for example<span > class=GramE>,/</span><span class=SpellE>gui/AllTests.testsuite</span>). > The summary test suite (for example<span class=GramE>,/</span><span > class=SpellE>gui/AllTests.testsuite</span>) will reference all test > suites within the current folder. This summary test <span class=GramE>suites</span> > is registered with the root-level <span class=SpellE>gui</span> test > suite (test-results/platform/org.eclipse.hyades.tests/AllGUITests.testsuite), > thereby reducing work when creating and removing plug-in or component > test suites.</li> > <li class=MsoNormal style='mso-list:l26 level2 lfo18;tab-stops:list 1.0in'>The > name of the automated <span class=SpellE><span class=GramE>gui</span></span> > test suite should correspond exactly to the name of the manual test suite > that is being automated (if applicable).</li> > <li class=MsoNormal style='mso-list:l26 level2 lfo18;tab-stops:list 1.0in'>A > resource directory should be used to contain the resources required for > the verification hooks of a test suite. The name of the directory should > be <test-suite-name>.Resources (For example the resource directory > for the <span class=SpellE>Monitor.UI.LogSets</span> test suite is <span > class=SpellE>Monitor.UI.LogSets.Resources</span>. This directory may > contain any number of log files or any other files that the test suite > depends on). If a <span class=SpellE>datapool</span> is being associated > with a test suite, then include the <span class=SpellE>datapool</span> as > part of this directory </li> > <li class=MsoNormal style='mso-list:l26 level2 lfo18;tab-stops:list 1.0in'>Use > the directory '<span class=SpellE>Common.Resources</span>' to store > resources that are shared amongst multiple test suites</li> > </ol> ></ol> > ><p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> > ><div class=MsoNormal align=center style='text-align:center'> > ><hr size=2 width="100%" align=center> > ></div> > ><p class=MsoNormal><b><span style='font-size:14.0pt'>2.0 Creating New TPTP >Tests<o:p></o:p></span></b></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><o:p> </o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'>To create new TPTP >test suites and cases please follow the documentation in the TPTP Help and AGR >documentation.<o:p></o:p></span></p> > ><p class=MsoNormal><span class=GramE><span style='mso-bidi-font-weight:bold'>For >guidelines specific to testing TPTP see the Common Tasks </span><span >style='color:red;mso-bidi-font-style:italic'>(need link)</span> <span >style='mso-bidi-font-weight:bold'>section below.</span></span><span >style='mso-bidi-font-weight:bold'><o:p></o:p></span></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b>2.1 Creating Manual Test Cases and Suites<o:p></o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l21 level1 lfo21;tab-stops:list .5in'><span > style='mso-bidi-font-weight:bold'>For TPTP 4.5.0 and greater download and > install the Manual Test Tools from the <span class=GramE><b>As-</b></span><b>Is > Components</b> section of the TPTP download page.</span></li> > <li class=MsoNormal style='mso-list:l21 level1 lfo21;tab-stops:list .5in'><span > style='mso-bidi-font-weight:bold'>Detailed steps for creating manual test > cases and suites can be found under Help >> Help Contents >> > Testing Applications >> Testing Manually </span></li> > <li class=MsoNormal style='mso-list:l21 level1 lfo21;tab-stops:list .5in'>Manual > tests are created in the manual folder of a test project. Please refer to > the naming conventions section of Part 2<span style='color:red'> <span > style='mso-bidi-font-style:italic'>(need link)</span></span>.</li> > <li class=MsoNormal style='mso-list:l21 level1 lfo21;tab-stops:list .5in'>The <a > href="http://www.eclipse.org/tptp/home/documents/process/TPTP_Manual_Test_Case_Generator.html">TPTP > Manual Test Case Generator</a> may be used to generate the structure of > manual test case descriptions based on the standardized structured manual > test case format.</li> > <li class=MsoNormal style='mso-list:l21 level1 lfo21;tab-stops:list .5in'>Try > to create suites with a number of cases that can be completed in less than > one hour. </li> ></ol> > ><p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b>2.2 Creating Junit and Junit Plug-in Test Cases and >Suites<o:p></o:p></b></p> > ><p class=MsoNormal style='margin-left:.25in'><b><o:p> </o:p></b></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l10 level1 lfo24;tab-stops:list .5in'><span > style='mso-bidi-font-weight:bold'>JUnit tests are created in the JUnit > folder of a test project, Junit Plug-ins tests in the <span class=SpellE>junit_plugin</span> > folder. Please refer to the naming conventions section of Part 2<span > style='color:red'> </span></span><span style='color:red;mso-bidi-font-style: > italic'>(need link)</span><span style='mso-bidi-font-weight:bold'>.<o:p></o:p></span></li> > <li class=MsoNormal style='mso-list:l10 level1 lfo24;tab-stops:list .5in'><span > style='mso-bidi-font-weight:bold'>Detailed steps for creating new TPTP > JUnit tests can be found under Help >> Help Contents >> > Testing Applications >> Testing with JUnit<o:p></o:p></span></li> > <li class=MsoNormal style='mso-list:l10 level1 lfo24;tab-stops:list .5in'><span > style='mso-bidi-font-weight:bold'>Detailed steps for creating new TPTP > JUnit Plug-in tests can be found under Help >> Help Contents > >> Testing Applications >> Testing plug-ins with JUnit<o:p></o:p></span></li> ></ol> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b>2.3 Creating AGR Test Suites<o:p></o:p></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l12 level1 lfo60;tab-stops:list .5in'>For > TPTP 4.5.0 and greater download the Automated GUI Recorder from the <span > class=GramE><b style='mso-bidi-font-weight:normal'>As-</b></span><b > style='mso-bidi-font-weight:normal'>Is Components</b> section of the TPTP > download page.</li> ></ol> > ><p class=MsoNormal style='margin-left:.25in'>2. <span style='mso-tab-count: >1'> </span>Detailed steps for creating AGR test cases and suites can be found >in the document An Introduction to Using <span class=SpellE>TPTP's</span> >Automated GUI Recorder<span class=GramE><span style='mso-bidi-font-weight:bold'> ><span style='mso-spacerun:yes'> </span>found</span></span><span >style='mso-bidi-font-weight:bold'> at <a >href="http://www.eclipse.org/tptp/test/documents/index.php">http://www.eclipse.org/tptp/test/documents/index.php</a><o:p></o:p></span></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><div class=MsoNormal align=center style='text-align:center'> > ><hr size=2 width="100%" align=center> > ></div> > ><p class=MsoNormal><b style='mso-bidi-font-weight:normal'><span >style='font-size:14.0pt'>3.0 Executing Tests<o:p></o:p></span></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b>3.1 Manual Test Suites<o:p></o:p></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l4 level1 lfo30;tab-stops:list .5in'>Open > the Test perspective.</li> > <li class=MsoNormal style='mso-list:l4 level1 lfo30;tab-stops:list .5in'>In > the Test Navigator view, select the manual test suite to be executed. </li> > <li class=MsoNormal style='mso-list:l4 level1 lfo30;tab-stops:list .5in'>Launch > the selected test suite by creating a Test configuration in the Run dialog</li> ></ol> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Under the Test >tab select the test suite</p> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Choose the >results folder associated with the selected test suite and deployment platform</p> > ><p class=MsoNormal style='margin-left:1.5in'><b>Note:</b> The name and >directory structure containing the generated execution history file <b>MUST</b> >be the same as it will be in CVS in order for generated reports to work >correctly.</p> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Click Run</p> > ><ol style='margin-top:0in' start=4 type=1> > <li class=MsoNormal style='mso-list:l2 level1 lfo33;tab-stops:list .5in'>Launch > a candidate workbench on the testing platform</li> > <li class=MsoNormal style='mso-list:l2 level1 lfo33;tab-stops:list .5in'>Execute > each test case as specified in the TPTP Manual Test View on the local > host.</li> > <li class=MsoNormal style='mso-list:l2 level1 lfo33;tab-stops:list .5in'>Record > the result of the test case execution by capturing the status of the test > case execution using the following explanation for TPTP Testing Tools > Status options: </li> ></ol> > ><table class=MsoNormalTable border=1 cellpadding=0 align=left style='mso-cellspacing: > 1.5pt;mso-table-lspace:.5in;margin-left:33.75pt;mso-table-rspace:9.35pt; > margin-right:7.1pt;mso-table-tspace:12.15pt;margin-top:9.9pt;mso-table-anchor-vertical: > paragraph;mso-table-anchor-horizontal:column;mso-table-left:left;mso-padding-alt: > 0in 5.4pt 0in 5.4pt'> > <tr style='mso-yfti-irow:0'> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'><b>TPTP > Testing Tools Status<o:p></o:p></b></p> > </td> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'><b>Explanation<o:p></o:p></b></p> > </td> > </tr> > <tr style='mso-yfti-irow:1'> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>Error</p> > </td> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>Do > not use.</p> > </td> > </tr> > <tr style='mso-yfti-irow:2'> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>Fail</p> > </td> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>The > test case could be executed and failed due to a blocking defect. </p> > </td> > </tr> > <tr style='mso-yfti-irow:3'> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>Inconclusive</p> > </td> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>The test > case was not applicable OR the test case could be executed and failed due to > a non-blocking defect. </p> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>A > non-blocking defect is defined as a nice-to-have fix that does not degrade > the core functionality being tested by the test case. </p> > </td> > </tr> > <tr style='mso-yfti-irow:4;mso-yfti-lastrow:yes'> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>Pass</p> > </td> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: > .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>The > test case could be executed and passed.</p> > </td> > </tr> ></table> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l30 level1 lfo35; >tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; >mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol;mso-bidi-font-weight: >bold'><span style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> ></span></span></span><![endif]><span style='mso-bidi-font-weight:bold'>For >verdicts of Fail or Inconclusive please provide a defect number and explanation >in the test log. <o:p></o:p></span></p> > ><p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l30 level1 lfo35; >tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; >mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol;mso-bidi-font-weight: >bold'><span style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> ></span></span></span><![endif]><span style='mso-bidi-font-weight:bold'>For >instructions on submitting defects from the test log which will create a link >from the test log to <span class=SpellE>bugzilla</span> please see Submitting >Defects <span style='color:red'>(need link)</span> in the Common tasks <span >style='color:red'>(need link)</span> section.<o:p></o:p></span></p> > ><p class=MsoNormal style='margin-left:.25in'><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b>3.2 JUnit and JUnit Plug-in Test Suites<o:p></o:p></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l37 level1 lfo38;tab-stops:list .5in'>Open > the Test perspective.</li> > <li class=MsoNormal style='mso-list:l37 level1 lfo38;tab-stops:list .5in'>In > the Test Navigator view, select the JUnit test suite to be executed.</li> > <li class=MsoNormal style='mso-list:l37 level1 lfo38;tab-stops:list .5in'>Launch > the selected test suite by creating a Test configuration in the Run dialog</li> ></ol> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Under the Test >tab select the test suite</p> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Select the >deployment. </p> > ><p class=MsoNormal style='margin-left:1.75in;text-indent:-.25in'>To run a test >remotely you will need to create and configure a new test deployment</p> > ><p class=MsoNormal style='margin-left:1.75in;text-indent:-.25in'>For JUnit >plug-in tests you also may want to specify deployment on a different workbench >location. </p> > ><p class=MsoNormal style='margin-left:1.75in;text-indent:-.25in'>The steps to >create a new location and deployment are in the TPTP Project Documentation >under <b>Testing Plugins with JUnit</b> </p> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Choose the >results folder associated with the selected test suite and deployment platform</p> > ><p class=MsoNormal style='margin-left:1.5in'><b>Note:</b> The name and >directory structure containing the generated execution history file <b>MUST</b> >be the same as it will be in CVS in order for generated reports to work >correctly.</p> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Click Run</p> > ><ol style='margin-top:0in' start=4 type=1> > <li class=MsoNormal style='mso-list:l17 level1 lfo41;tab-stops:list .5in'>An > execution history will be generated according to the following explanation > of TPTP Testing Tools Status options: </li> ></ol> > ><table class=MsoNormalTable border=1 cellpadding=0 align=left style='mso-cellspacing: > 1.5pt;mso-table-lspace:.5in;margin-left:33.75pt;mso-table-rspace:9.35pt; > margin-right:7.1pt;mso-table-tspace:.1in;margin-top:4.95pt;mso-table-anchor-vertical: > paragraph;mso-table-anchor-horizontal:column;mso-table-left:left;mso-table-top: > .05pt;mso-padding-alt:0in 5.4pt 0in 5.4pt'> > <tr style='mso-yfti-irow:0'> > <td style='padding:.7pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'><b>TPTP Testing Tools Status<o:p></o:p></b></p> > </td> > <td style='padding:.7pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'><b>Explanation<o:p></o:p></b></p> > </td> > </tr> > <tr style='mso-yfti-irow:1'> > <td style='padding:.7pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>Error</p> > </td> > <td style='padding:.7pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>The test case was or could not be executed due to a > run time error.</p> > </td> > </tr> > <tr style='mso-yfti-irow:2'> > <td style='padding:.7pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>Fail</p> > </td> > <td style='padding:.7pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>The test case could be executed and failed due to a defect.</p> > </td> > </tr> > <tr style='mso-yfti-irow:3;mso-yfti-lastrow:yes'> > <td style='padding:.7pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>Pass</p> > </td> > <td style='padding:.7pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>The test case could be executed and passed.</p> > </td> > </tr> ></table> > ><p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l38 level1 lfo43; >tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; >mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span >style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> ></span></span></span><![endif]>The Fail and Error verdict events in the test >log will contain a stack trace that can jump to source.</p> > ><p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l38 level1 lfo43; >tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; >mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol;mso-bidi-font-weight: >bold'><span style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> ></span></span></span><![endif]><span style='mso-bidi-font-weight:bold'>For >instructions on submitting defects from the test log which will create a link >from the test log to <span class=SpellE>bugzilla</span> please see Submitting >Defects <span style='color:red'>(need link)</span> in the Common tasks <span >style='color:red'>(need link)</span> section.<o:p></o:p></span></p> > ><p class=MsoNormal style='margin-left:.5in'><span style='mso-bidi-font-weight: >bold'><o:p> </o:p></span></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><b>3.3 AGR Test Suites</b> ><b><o:p></o:p></b></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l33 level1 lfo46;tab-stops:list .5in'>Ensure > that the Agent Controller is installed and started.</li> > <li class=MsoNormal style='mso-list:l33 level1 lfo46;tab-stops:list .5in'>Open > the Test perspective.</li> > <li class=MsoNormal style='mso-list:l33 level1 lfo46;tab-stops:list .5in'>In the > Test Navigator view, select the Automated GUI Test to be executed.</li> > <li class=MsoNormal style='mso-list:l33 level1 lfo46;tab-stops:list .5in'>Execute > the test suite by creating a launch configuration item. See Creating > Launch Configurations <span style='color:red'>(need link)</span> in the > Common Tasks <span style='color:red'>(need link)</span> section of this > document. </li> ></ol> > ><p class=MsoNormal style='margin-left:.75in'><b>Important: </b>Using the 'Quick >Run' mode will not generate an execution history file. Make sure that a proper >launch configuration is used.</p> > ><ol style='margin-top:0in' start=5 type=1> > <li class=MsoNormal style='mso-list:l33 level1 lfo46;tab-stops:list .5in'> The > runner will generate an execution history according to the following > explanation of TPTP Testing Tools Status options: </li> ></ol> > ><table class=MsoNormalTable border=1 cellpadding=0 align=left style='mso-cellspacing: > 1.5pt;mso-table-lspace:.5in;margin-left:33.75pt;mso-table-rspace:9.35pt; > margin-right:7.1pt;mso-table-tspace:.1in;margin-top:4.95pt;mso-table-anchor-vertical: > paragraph;mso-table-anchor-horizontal:column;mso-table-left:left;mso-table-top: > .05pt;mso-padding-alt:0in 5.4pt 0in 5.4pt'> > <tr style='mso-yfti-irow:0'> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'><b>TPTP Testing Tools Status<o:p></o:p></b></p> > </td> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'><b>Explanation<o:p></o:p></b></p> > </td> > </tr> > <tr style='mso-yfti-irow:1'> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>Error</p> > </td> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>The test case was or could not be executed due to a > run time error.</p> > </td> > </tr> > <tr style='mso-yfti-irow:2'> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>Fail</p> > </td> > <td style='padding:.75pt .75pt .75pt .75pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>The test case could be executed and failed due to a > defect.</p> > </td> > </tr> > <tr style='mso-yfti-irow:3;mso-yfti-lastrow:yes;height:20.85pt'> > <td style='padding:.75pt .75pt .75pt .75pt;height:20.85pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>Pass</p> > </td> > <td style='padding:.75pt .75pt .75pt .75pt;height:20.85pt'> > <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; > mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: > paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; > mso-height-rule:exactly'>The test case could be executed and passed.</p> > </td> > </tr> ></table> > ><p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> > ><p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal style='margin-left:.25in;text-indent:.25in'><o:p> </o:p></p> > ><p class=MsoNormal style='margin-left:.5in'><o:p> </o:p></p> > ><p class=MsoNormal style='margin-left:.25in;text-indent:.25in'><o:p> </o:p></p> > ><p class=MsoNormal style='margin-left:.25in;text-indent:.25in'><o:p> </o:p></p> > ><p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l11 level1 lfo49; >tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; >mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span >style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> ></span></span></span><![endif]>The Fail and Error verdict events in the test >log will contain a stack trace that can jump to source.</p> > ><p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l11 level1 lfo49; >tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; >mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol;mso-bidi-font-weight: >bold'><span style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> ></span></span></span><![endif]><span style='mso-bidi-font-weight:bold'>For >instructions on submitting defects from the test log which will create a link >from the test log to <span class=SpellE>bugzilla</span> please see Submitting >Defects <span style='color:red'>(need link)</span> in the Common tasks <span >style='color:red'>(need link)</span> section.<o:p></o:p></span></p> > ><p class=MsoNormal style='margin-left:.25in;text-indent:.25in'><o:p> </o:p></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><div class=MsoNormal align=center style='text-align:center'> > ><hr size=2 width="100%" align=center> > ></div> > ><p class=MsoNormal><b style='mso-bidi-font-weight:normal'><span >style='font-size:14.0pt'>4.0 Common Tasks<o:p></o:p></span></b></p> > ><p class=MsoNormal><b style='mso-bidi-font-weight:normal'><span >style='font-size:14.0pt'><o:p> </o:p></span></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b style='mso-bidi-font-weight:normal'>4.1 Creating Test >Suites<o:p></o:p></b></p> > ><p class=MsoNormal><b style='mso-bidi-font-weight:normal'><o:p> </o:p></b></p> > ><p class=MsoNormal>General Guidelines for test case creation:</p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l6 level1 lfo52;tab-stops:list .5in'>Create > short concise cases that cover identifiable partitions of functionality. > This increases reporting accuracy and allows for easy reproduction by > testers and fixers.</li> > <li class=MsoNormal style='mso-list:l6 level1 lfo52;tab-stops:list .5in'>Comment > test cases thoroughly in the description section of the including the > manual steps for what the test case is performing.</li> > <li class=MsoNormal style='mso-list:l6 level1 lfo52;tab-stops:list .5in'>If > any resource (such as a <span class=SpellE>datapool</span>) needs to be > modified before the test suite is executed, then include that as part of > the description of the test suite. Any other important information that > the tester should be aware of needs to be included in the description of > the test suite.</li> > <li class=MsoNormal style='mso-list:l6 level1 lfo52;tab-stops:list .5in'>If an > existing manual test case is being automated, then add '(DEPRECATED - Use > <automated test suite name>)' to the beginning of the description of > the manual test case.</li> > <li class=MsoNormal style='mso-list:l6 level1 lfo52;tab-stops:list .5in'><span > style='color:black'>For more guidance creating effective test cases please > refer to the best practices section of </span><a > href="http://www.eclipse.org/tptp/home/documents/process/TPTP_Testing_Strategy.html#2.2"><span > style='color:windowtext;text-decoration:none;text-underline:none'>Part 2</span></a> > <span style='color:red'>(need link)</span>.<o:p></o:p></li> ></ol> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b style='mso-bidi-font-weight:normal'>4.2 Launching Test >Suites<o:p></o:p></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal>Creating Test Deployments</p> > ><p class=MsoNormal><span style='mso-tab-count:1'> </span>Detailed >steps for creating test deployments can be found in Help >> Help Contents >>> Testing Applications >> Creating a Test Deployment</p> > ><p class=MsoNormal><span style='color:red'><o:p> </o:p></span></p> > ><p class=MsoNormal>Create a Test Launch Configuration<o:p></o:p></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l29 level1 lfo62;tab-stops:list .5in'>Create > a new launch configuration by selecting the entry Test from the list of > configurations in Run >> Run Configurations</li> > <li class=MsoNormal style='mso-list:l29 level1 lfo62;tab-stops:list .5in'>Use > the Select test to run pane to navigate to and select the test suite you > wish to run.</li> > <li class=MsoNormal style='mso-list:l29 level1 lfo62;tab-stops:list .5in'>Select > the deployment for running the test suite. By default the test will be > deployed locally; to change this see the <span style='mso-bidi-font-style: > italic'>Creating Test Deployments <span style='color:red'>(need link)</span></span> > topic. Manual tests are always run in the local deployment.<o:p></o:p></li> > <li class=MsoNormal style='mso-list:l29 level1 lfo62;tab-stops:list .5in'>In > the Test Logs tab override the default log configuration to match the > desired log directory (for example <span class=SpellE>plugin_results</span>). > Please refer to the naming conventions section of Part 2 <span > style='color:red'>(need link)</span> for the names of result directories.<o:p></o:p></li> ></ol> > ><p class=MsoNormal><b style='mso-bidi-font-weight:normal'><o:p> </o:p></b></p> > ><p class=MsoNormal><b style='mso-bidi-font-weight:normal'>4.3 Viewing Test Logs<o:p></o:p></b></p> > ><p>To open a <span class=resultoftext><span name=resultofMatch>test</span></span> ><span class=resultoftext><span name=resultofMatch>log</span></span> file, use >the Open File window, or double-click in the <span class=resultoftext><span name=resultofMatch>Test</span></span> >Navigator the file with the extension, <span class=filepath>.execution</span>.</p> > ><ol start=1 type=1> > <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto; > mso-list:l7 level1 lfo55;tab-stops:list .5in'>From the <span > class=uicontrol>File</span> menu, click <span class=uicontrol>Open File</span>. > </li> > <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto; > mso-list:l7 level1 lfo55;tab-stops:list .5in'>Browse to and select the <span > class=resultoftext><span name=resultofMatch>test</span></span> <span > class=resultoftext><span name=resultofMatch>log</span></span> file to > open. (<span class=resultoftext><span name=resultofMatch>Test</span></span> > <span class=resultoftext><span name=resultofMatch>log</span></span> files > use the extension, <span class=filepath>.execution</span>.) </li> > <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto; > mso-list:l7 level1 lfo55;tab-stops:list .5in'>Click <span class=uicontrol>OK</span>. > </li> ></ol> > ><p class=MsoNormal><b style='mso-bidi-font-weight:normal'>4.4 Reporting Test >Results<o:p></o:p></b></p> > ><p class=MsoNormal><o:p> </o:p></p> > ><p class=MsoNormal><b>Submitting Execution Histories<o:p></o:p></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><ol style='margin-top:0in' start=1 type=1> > <li class=MsoNormal style='mso-list:l27 level1 lfo58;tab-stops:list .5in'>Execution > histories should be checked-in to the CVS branch for the release under > test. They are checked into a results folder under the associated <span > class=SpellE>plugin</span> for the type of test executed (<span > class=SpellE>manual_results</span>, <span class=SpellE>junit_results</span>, > <span class=SpellE>junit_plugin_results</span>, <span class=SpellE>gui_results</span>). > To delineate between test executions on multiple platforms, each results > folder contains subfolders for the supported platforms.</li> ></ol> > ><p class=MsoNormal style='margin-left:.75in'><b style='mso-bidi-font-weight: >normal'>For Example:</b> The results of executing the manual test <i >style='mso-bidi-font-style:normal'>org.eclipse.hyades.use.cases/manual/Profiling_and_Logging/Platform.Communication.Control_Channel_Remote_Profiling.Windows_IA32.testsuite</i> >should be generated to and checked into <i style='mso-bidi-font-style:normal'>org.eclipse.hyades.use.cases/manual_results/Profiling_and_Logging/Windows_XP</i></p> > ><ol style='margin-top:0in' start=2 type=1> > <li class=MsoNormal style='mso-list:l27 level1 lfo58;tab-stops:list .5in'>Testers > who are not committers should email the execution history files to the > committer for the associated component.</li> ></ol> > ><p class=MsoNormal style='margin-left:.75in'>Include the following in your >email:</p> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Name of tester >if not same as sender</p> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'><span >class=GramE>Deployment platform(s) including name, version and release.</span></p> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'><span >class=GramE>Execution specific information including name, version and release.</span></p> > ><p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>TPTP driver >build id and test pass identifier.</p> > ><p class=MsoNormal><o:p> </o:p></p> > ><div class=MsoNormal align=center style='text-align:center'> > ><hr size=2 width="100%" align=center> > ></div> > ><p class=MsoNormal><b><span style='font-size:14.0pt'>5.0 Help<o:p></o:p></span></b></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><a >href="http://www.eclipse.org/tptp/">Eclipse Test & Performance Tools >Platform Project Web Site</a><o:p></o:p></span></p> > ><p class=MsoNormal><b><o:p> </o:p></b></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'>Full current TPTP >Test Tools Documentation can be found in the eclipse help under:<span >style='mso-spacerun:yes'> </span>Help >> Help Contents >> Testing >Applications<o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><o:p> </o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'>AGR Documentation<o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span >style='mso-tab-count:1'> </span><a >href="http://www.eclipse.org/tptp/test/documents/index.php">http://www.eclipse.org/tptp/test/documents/index.php</a><o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span >style='mso-tab-count:1'> </span>See </span>An Introduction to Using ><span class=SpellE>TPTP's</span> Automated GUI Recorder for your TPTP release >version.<span style='mso-bidi-font-weight:bold'><o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><o:p> </o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><a >href="http://www.eclipse.org/tptp/home/documents/extenders.php">Documentation >for TPTP extenders</a><o:p></o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><o:p> </o:p></span></p> > ><p class=MsoNormal><span style='mso-bidi-font-weight:bold'><a >href="http://www.eclipse.org/tptp/home/project_info/general/mailnews.php">TPTP >Mailing Lists and Newsgroups</a><o:p></o:p></span></p> > ></div> > ></body> > ></html>
<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv=Content-Type content="text/html; charset=windows-1252"> <meta name=ProgId content=Word.Document> <meta name=Generator content="Microsoft Word 10"> <meta name=Originator content="Microsoft Word 10"> <link rel=File-List href="TPTP_Testing_Strategy_Part_1_files/filelist.xml"> <link rel=Edit-Time-Data href="TPTP_Testing_Strategy_Part_1_files/editdata.mso"> <!--[if !mso]> <style> v\:* {behavior:url(#default#VML);} o\:* {behavior:url(#default#VML);} w\:* {behavior:url(#default#VML);} .shape {behavior:url(#default#VML);} </style> <![endif]--> <title>TPTP Testing Strategy Part 1</title> <!--[if gte mso 9]><xml> <o:DocumentProperties> <o:Author>chng1me</o:Author> <o:LastAuthor>chng1me</o:LastAuthor> <o:Revision>87</o:Revision> <o:TotalTime>10838</o:TotalTime> <o:Created>2007-11-29T02:51:00Z</o:Created> <o:LastSaved>2008-05-28T20:16:00Z</o:LastSaved> <o:Pages>1</o:Pages> <o:Words>2257</o:Words> <o:Characters>12870</o:Characters> <o:Company>IBM</o:Company> <o:Lines>107</o:Lines> <o:Paragraphs>30</o:Paragraphs> <o:CharactersWithSpaces>15097</o:CharactersWithSpaces> <o:Version>10.6817</o:Version> </o:DocumentProperties> </xml><![endif]--><!--[if gte mso 9]><xml> <w:WordDocument> <w:SpellingState>Clean</w:SpellingState> <w:GrammarState>Clean</w:GrammarState> <w:Compatibility> <w:BreakWrappedTables/> <w:SnapToGridInCell/> <w:WrapTextWithPunct/> <w:UseAsianBreakRules/> </w:Compatibility> <w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel> </w:WordDocument> </xml><![endif]--> <style> <!-- /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {mso-style-parent:""; margin:0in; margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:12.0pt; font-family:"Times New Roman"; mso-fareast-font-family:"Times New Roman";} a:link, span.MsoHyperlink {color:blue; text-decoration:underline; text-underline:single;} a:visited, span.MsoHyperlinkFollowed {color:purple; text-decoration:underline; text-underline:single;} p {mso-margin-top-alt:auto; margin-right:0in; mso-margin-bottom-alt:auto; margin-left:0in; mso-pagination:widow-orphan; font-size:12.0pt; font-family:"Times New Roman"; mso-fareast-font-family:"Times New Roman";} code {font-family:"Courier New"; mso-ascii-font-family:"Courier New"; mso-fareast-font-family:"Times New Roman"; mso-hansi-font-family:"Courier New"; mso-bidi-font-family:"Courier New";} span.resultoftext {mso-style-name:resultoftext;} span.filepath {mso-style-name:filepath;} span.uicontrol {mso-style-name:uicontrol;} span.SpellE {mso-style-name:""; mso-spl-e:yes;} span.GramE {mso-style-name:""; mso-gram-e:yes;} @page Section1 {size:8.5in 11.0in; margin:1.0in 1.25in 1.0in 1.25in; mso-header-margin:.5in; mso-footer-margin:.5in; mso-paper-source:0;} div.Section1 {page:Section1;} /* List Definitions */ @list l0 {mso-list-id:92744791; mso-list-template-ids:-1684253540;} @list l0:level1 {mso-level-start-at:4; mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l1 {mso-list-id:141234346; mso-list-template-ids:-289743920;} @list l2 {mso-list-id:174006188; mso-list-template-ids:-1713706948;} @list l2:level1 {mso-level-start-at:4; mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l2:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l2:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l2:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l2:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l2:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l2:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l2:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l2:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l3 {mso-list-id:282734531; mso-list-template-ids:40507662;} @list l3:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l3:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l3:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l3:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l3:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l3:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l3:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l3:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l3:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l4 {mso-list-id:383453367; mso-list-template-ids:417136210;} @list l4:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l4:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l4:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l4:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l4:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l4:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l4:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l4:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l4:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l5 {mso-list-id:387077248; mso-list-template-ids:364411036;} @list l5:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l5:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l5:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l5:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l5:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l5:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l5:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l5:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l5:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l6 {mso-list-id:463472923; mso-list-template-ids:364411036;} @list l6:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l6:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l6:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l6:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l6:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l6:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l6:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l6:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l6:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l7 {mso-list-id:525607275; mso-list-template-ids:364411036;} @list l7:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l7:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l7:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l7:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l7:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l7:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l7:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l7:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l7:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l8 {mso-list-id:539055317; mso-list-template-ids:1683631112;} @list l8:level1 {mso-level-number-format:bullet; mso-level-text:\F0B7; mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in; mso-ansi-font-size:10.0pt; font-family:Symbol;} @list l8:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l8:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l8:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l8:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l8:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l8:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l8:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l8:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l9 {mso-list-id:540476659; mso-list-template-ids:366112964;} @list l10 {mso-list-id:678698775; mso-list-template-ids:2067012672;} @list l10:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l10:level2 {mso-level-number-format:alpha-lower; mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l10:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l10:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l10:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l10:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l10:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l10:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l10:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l11 {mso-list-id:733502716; mso-list-type:hybrid; mso-list-template-ids:-317027414 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;} @list l11:level1 {mso-level-number-format:bullet; mso-level-text:\F0B7; mso-level-tab-stop:.75in; mso-level-number-position:left; margin-left:.75in; text-indent:-.25in; font-family:Symbol;} @list l11:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l11:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l11:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l11:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l11:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l11:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l11:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l11:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l12 {mso-list-id:752972821; mso-list-type:hybrid; mso-list-template-ids:-421634994 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;} @list l12:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l13 {mso-list-id:764151593; mso-list-template-ids:-473121702;} @list l14 {mso-list-id:875197164; mso-list-template-ids:1192423218;} @list l14:level1 {mso-level-start-at:5; mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l15 {mso-list-id:911617600; mso-list-template-ids:671776898;} @list l15:level1 {mso-level-number-format:bullet; mso-level-text:\F0B7; mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in; mso-ansi-font-size:10.0pt; font-family:Symbol;} @list l16 {mso-list-id:915284730; mso-list-type:hybrid; mso-list-template-ids:-314245460 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;} @list l16:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l16:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l16:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l16:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l16:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l16:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l16:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l16:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l16:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l17 {mso-list-id:963463129; mso-list-template-ids:1104553342;} @list l17:level1 {mso-level-start-at:4; mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l17:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l17:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l17:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l17:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l17:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l17:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l17:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l17:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l18 {mso-list-id:1021663441; mso-list-template-ids:1029086670;} @list l18:level2 {mso-level-number-format:alpha-lower; mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l19 {mso-list-id:1022901798; mso-list-template-ids:-360950964;} @list l19:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l19:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l19:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l19:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l19:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l19:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l19:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l19:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l19:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l20 {mso-list-id:1026910047; mso-list-template-ids:-287171560;} @list l21 {mso-list-id:1143277723; mso-list-template-ids:2067012672;} @list l21:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l21:level2 {mso-level-number-format:alpha-lower; mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l21:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l21:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l21:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l21:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l21:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l21:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l21:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l22 {mso-list-id:1165125296; mso-list-template-ids:1585888766;} @list l23 {mso-list-id:1243297063; mso-list-template-ids:-1179326278;} @list l24 {mso-list-id:1261139367; mso-list-template-ids:-1096526558;} @list l25 {mso-list-id:1283800744; mso-list-template-ids:91676230;} @list l25:level1 {mso-level-start-at:4; mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l26 {mso-list-id:1331446212; mso-list-template-ids:2067012672;} @list l26:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l26:level2 {mso-level-number-format:alpha-lower; mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l26:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l26:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l26:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l26:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l26:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l26:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l26:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l27 {mso-list-id:1336881819; mso-list-template-ids:1406673138;} @list l27:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l27:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l27:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l27:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l27:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l27:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l27:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l27:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l27:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l28 {mso-list-id:1346788010; mso-list-template-ids:11439954;} @list l29 {mso-list-id:1402825979; mso-list-type:hybrid; mso-list-template-ids:918989474 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;} @list l29:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l30 {mso-list-id:1561555207; mso-list-type:hybrid; mso-list-template-ids:-436827038 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;} @list l30:level1 {mso-level-number-format:bullet; mso-level-text:\F0B7; mso-level-tab-stop:.75in; mso-level-number-position:left; margin-left:.75in; text-indent:-.25in; font-family:Symbol;} @list l30:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l30:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l30:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l30:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l30:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l30:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l30:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l30:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l31 {mso-list-id:1619218184; mso-list-template-ids:1452588582;} @list l32 {mso-list-id:1632784571; mso-list-template-ids:-1248713324;} @list l32:level1 {mso-level-start-at:2; mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l33 {mso-list-id:1688942465; mso-list-template-ids:239618888;} @list l33:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l33:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l33:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l33:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l33:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l33:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l33:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l33:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l33:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l34 {mso-list-id:1700815944; mso-list-template-ids:-285804542;} @list l34:level1 {mso-level-start-at:2; mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l35 {mso-list-id:1750536643; mso-list-template-ids:566636214;} @list l36 {mso-list-id:1793555678; mso-list-type:hybrid; mso-list-template-ids:1155423620 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;} @list l36:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l37 {mso-list-id:1929387494; mso-list-template-ids:-2013595910;} @list l37:level1 {mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l37:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l37:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l37:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l37:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l37:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l37:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l37:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l37:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l38 {mso-list-id:1951086013; mso-list-type:hybrid; mso-list-template-ids:-1031005610 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;} @list l38:level1 {mso-level-number-format:bullet; mso-level-text:\F0B7; mso-level-tab-stop:.75in; mso-level-number-position:left; margin-left:.75in; text-indent:-.25in; font-family:Symbol;} @list l38:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l38:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l38:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l38:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l38:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l38:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l38:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l38:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} @list l39 {mso-list-id:1998531004; mso-list-template-ids:-1325115436;} @list l40 {mso-list-id:2023051434; mso-list-template-ids:-1138867394;} @list l41 {mso-list-id:2040230432; mso-list-template-ids:329806632;} @list l41:level1 {mso-level-start-at:2; mso-level-tab-stop:.5in; mso-level-number-position:left; text-indent:-.25in;} @list l41:level2 {mso-level-tab-stop:1.0in; mso-level-number-position:left; text-indent:-.25in;} @list l41:level3 {mso-level-tab-stop:1.5in; mso-level-number-position:left; text-indent:-.25in;} @list l41:level4 {mso-level-tab-stop:2.0in; mso-level-number-position:left; text-indent:-.25in;} @list l41:level5 {mso-level-tab-stop:2.5in; mso-level-number-position:left; text-indent:-.25in;} @list l41:level6 {mso-level-tab-stop:3.0in; mso-level-number-position:left; text-indent:-.25in;} @list l41:level7 {mso-level-tab-stop:3.5in; mso-level-number-position:left; text-indent:-.25in;} @list l41:level8 {mso-level-tab-stop:4.0in; mso-level-number-position:left; text-indent:-.25in;} @list l41:level9 {mso-level-tab-stop:4.5in; mso-level-number-position:left; text-indent:-.25in;} ol {margin-bottom:0in;} ul {margin-bottom:0in;} --> </style> <!--[if gte mso 10]> <style> /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:10.0pt; font-family:"Times New Roman";} </style> <![endif]--><!--[if gte mso 9]><xml> <o:shapedefaults v:ext="edit" spidmax="8194"> <o:colormenu v:ext="edit" fillcolor="none"/> </o:shapedefaults></xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext="edit"> <o:idmap v:ext="edit" data="1"/> </o:shapelayout></xml><![endif]--> </head> <body lang=EN-US link=blue vlink=purple style='tab-interval:.5in'> <div class=Section1> <p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:14.0pt'>TPTP Testing Strategy Part 1<o:p></o:p></span></b></p> <p class=MsoNormal align=center style='text-align:center'><b>Executing and Creating TPTP tests<o:p></o:p></b></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal>1.0 Preparation</p> <p class=MsoNormal><span style='mso-spacerun:yes'> </span>1.1 Install the TPTP Testing Tools</p> <p class=MsoNormal><span style='mso-spacerun:yes'> </span>1.2 Extracting the Test Resources</p> <p class=MsoNormal><span style='mso-spacerun:yes'> </span>1.3 Structure of the Test Resources</p> <p class=MsoNormal>2.0 Creating Tests</p> <p class=MsoNormal><span style='mso-spacerun:yes'> </span>2.1 Manual Test Suites</p> <p class=MsoNormal><span style='mso-spacerun:yes'> </span>2.2 JUnit and JUnit Plug-in Test Suites</p> <p class=MsoNormal><span style='mso-spacerun:yes'> </span>2.3 AGR Test Suites</p> <p class=MsoNormal>3.0 Executing Tests</p> <p class=MsoNormal><span style='mso-spacerun:yes'> </span>3.1 Manual Test Suites</p> <p class=MsoNormal><span style='mso-spacerun:yes'> </span>3.2 <span style='mso-bidi-font-weight:bold'>JUnit and JUnit Plug-in Test Suites<o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span style='mso-spacerun:yes'> </span>3.3 AGR test Suites<o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'>4.0 Common Tasks<o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span style='mso-spacerun:yes'> </span>4.1 Creating Test Suites<o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span style='mso-spacerun:yes'> </span>4.2 Launching Test Suites<o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span style='mso-spacerun:yes'> </span>4.3 Viewing Test Logs<o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span style='mso-spacerun:yes'> </span>4.4 Report Test Results<o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'>5.0 Help</span></p> <p class=MsoNormal><o:p> </o:p></p> <div class=MsoNormal align=center style='text-align:center'> <hr size=2 width="100%" align=center> </div> <p class=MsoNormal><sub></sub><b><span style='font-size:14.0pt'>1.0 Preparation<o:p></o:p></span></b></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b>1.1 Install the TPTP testing tools<o:p></o:p></b></p> <p class=MsoNormal><o:p> </o:p></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l3 level1 lfo3;tab-stops:list .5in'>Open the TPTP <a href="http://www.eclipse.org/tptp/home/downloads">download site</a>. </li> <li class=MsoNormal style='mso-list:l3 level1 lfo3;tab-stops:list .5in'>Select the release of TPTP to be tested and download and unzip the TPTP plugins as well as the requirements listed in the TPTP Plugins for Eclipse section.</li> <li class=MsoNormal style='mso-list:l3 level1 lfo3;tab-stops:list .5in'>Download and unzip Automated GUI Recording (As Is section).</li> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l3 level2 lfo3;tab-stops:list 1.0in'><i>Note: Remember to restart eclipse with the clean option after installing the AGR<o:p></o:p></i></li> </ol> <li class=MsoNormal style='mso-list:l3 level1 lfo3;tab-stops:list .5in'>If remote execution is required download and unzip the Agent Controller (Agent Controller section).</li> <li class=MsoNormal style='mso-list:l3 level1 lfo3;tab-stops:list .5in'>The Installation Guide and Release Notes are located in the Documentation section. </li> </ol> <p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> <p class=MsoNormal><b>1.2 Extracting the Test Resources<o:p></o:p></b></p> <p class=MsoNormal><o:p> </o:p></p> <ul style='margin-top:0in' type=disc> <li class=MsoNormal style='mso-list:l8 level1 lfo6;tab-stops:list .5in'>Test suites, cases, deployment configurations and execution histories are stored in the TPTP CVS repository (<span class=SpellE>dev.eclipse.org:/home/tptp</span> or <a href="http://www.eclipse.org/tptp/">www.eclipse.org/tptp</a> >> CVS Repository), under the <a href="http://dev.eclipse.org/viewcvs/index.cgi/test-results/?cvsroot=TPTP_Project">test-results</a> module.</li> <li class=MsoNormal style='mso-list:l8 level1 lfo6;tab-stops:list .5in'>The test-results module contains subfolders for each of the four subprojects - monitoring, platform, test and trace - in the TPTP project. Each subfolder contains the test projects for that subproject.</li> </ul> <p class=MsoNormal><o:p> </o:p></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l19 level1 lfo9;tab-stops:list .5in'>Check out the individual test projects under test-results/monitoring/, test-results/platform/, test-results/test/, or test-results/trace/ to the local workspace.</li> </ol> <p class=MsoNormal style='margin-left:.75in'><b>For Example: </b><a href="http://dev.eclipse.org/viewcvs/index.cgi/test-results/platform/org.eclipse.hyades.use.cases/?root=TPTP_Project">test-results/platform/<span class=SpellE>org.eclipse.hyades.use.cases</span></a></p> <ol style='margin-top:0in' start=2 type=1> <li class=MsoNormal style='mso-list:l41 level1 lfo12;tab-stops:list .5in'>To ensure that the local workspace contains the latest test projects, update at the beginning of each test pass and report generation.</li> </ol> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b style='mso-bidi-font-weight:normal'>1.3 Structure of the Test Resources<o:p></o:p></b></p> <p class=MsoNormal><o:p> </o:p></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l5 level1 lfo15;tab-stops:list .5in'>Test projects must follow a defined structure. Please see Part 2 <span style='color:red'>(link needed)</span> for the required structure of test project contents. When structuring the internal organization of the associated test suite folders (for example, <span class=SpellE>junit</span> and <span class=SpellE>junit_plugin</span>), create summary test suites for each subfolder (for example,/<span class=SpellE>junit/AllTests.testsuite</span> and /<span class=SpellE>junit_plugin/AllTests.testsuite</span>). The summary test suites (for example,/<span class=SpellE>junit/AllTests.testsuite</span> and /<span class=SpellE>junit_plugin/AllTests.testsuite</span>) will reference all test suites within the current folder. These summary test suites are registered with the root-level JUnit and JUnit Plug-in test suites (test-results/platform/org.eclipse.hyades.tests/AllJUnitTests.testsuite and test-results/platform/org.eclipse.hyades.tests/AllJUnitPluginTests.testsuite), thereby reducing work when creating and removing plug-in or component test suites.</li> </ol> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal style='margin-left:.25in'>AGR tests structure</p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l26 level1 lfo18;tab-stops:list .5in'>There is a recommended structure for the internal content of the '<span class=SpellE>gui</span>' folder that committers are encouraged to use when automating existing manual test suites:</li> <ol style='margin-top:0in' start=1 type=a> <li class=MsoNormal style='mso-list:l26 level2 lfo18;tab-stops:list 1.0in'>The folders that are a direct child of the '<span class=SpellE>gui</span>' folder should correspond exactly to the folders that are a direct child of the 'manual' folder. When structuring the internal organization of the associated test suite folder (for example, <span class=SpellE>gui</span>), create a summary test suite for the subfolder (for example<span class=GramE>,/</span><span class=SpellE>gui/AllTests.testsuite</span>). The summary test suite (for example<span class=GramE>,/</span><span class=SpellE>gui/AllTests.testsuite</span>) will reference all test suites within the current folder. This summary test <span class=GramE>suites</span> is registered with the root-level <span class=SpellE>gui</span> test suite (test-results/platform/org.eclipse.hyades.tests/AllGUITests.testsuite), thereby reducing work when creating and removing plug-in or component test suites.</li> <li class=MsoNormal style='mso-list:l26 level2 lfo18;tab-stops:list 1.0in'>The name of the automated <span class=SpellE><span class=GramE>gui</span></span> test suite should correspond exactly to the name of the manual test suite that is being automated (if applicable).</li> <li class=MsoNormal style='mso-list:l26 level2 lfo18;tab-stops:list 1.0in'>A resource directory should be used to contain the resources required for the verification hooks of a test suite. The name of the directory should be <test-suite-name>.Resources (For example the resource directory for the <span class=SpellE>Monitor.UI.LogSets</span> test suite is <span class=SpellE>Monitor.UI.LogSets.Resources</span>. This directory may contain any number of log files or any other files that the test suite depends on). If a <span class=SpellE>datapool</span> is being associated with a test suite, then include the <span class=SpellE>datapool</span> as part of this directory </li> <li class=MsoNormal style='mso-list:l26 level2 lfo18;tab-stops:list 1.0in'>Use the directory '<span class=SpellE>Common.Resources</span>' to store resources that are shared amongst multiple test suites</li> </ol> </ol> <p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> <div class=MsoNormal align=center style='text-align:center'> <hr size=2 width="100%" align=center> </div> <p class=MsoNormal><b><span style='font-size:14.0pt'>2.0 Creating New TPTP Tests<o:p></o:p></span></b></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><o:p> </o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'>To create new TPTP test suites and cases please follow the documentation in the TPTP Help and AGR documentation.<o:p></o:p></span></p> <p class=MsoNormal><span class=GramE><span style='mso-bidi-font-weight:bold'>For guidelines specific to testing TPTP see the Common Tasks </span><span style='color:red;mso-bidi-font-style:italic'>(need link)</span> <span style='mso-bidi-font-weight:bold'>section below.</span></span><span style='mso-bidi-font-weight:bold'><o:p></o:p></span></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b>2.1 Creating Manual Test Cases and Suites<o:p></o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l21 level1 lfo21;tab-stops:list .5in'><span style='mso-bidi-font-weight:bold'>For TPTP 4.5.0 and greater download and install the Manual Test Tools from the <span class=GramE><b>As-</b></span><b>Is Components</b> section of the TPTP download page.</span></li> <li class=MsoNormal style='mso-list:l21 level1 lfo21;tab-stops:list .5in'><span style='mso-bidi-font-weight:bold'>Detailed steps for creating manual test cases and suites can be found under Help >> Help Contents >> Testing Applications >> Testing Manually </span></li> <li class=MsoNormal style='mso-list:l21 level1 lfo21;tab-stops:list .5in'>Manual tests are created in the manual folder of a test project. Please refer to the naming conventions section of Part 2<span style='color:red'> <span style='mso-bidi-font-style:italic'>(need link)</span></span>.</li> <li class=MsoNormal style='mso-list:l21 level1 lfo21;tab-stops:list .5in'>The <a href="http://www.eclipse.org/tptp/home/documents/process/TPTP_Manual_Test_Case_Generator.html">TPTP Manual Test Case Generator</a> may be used to generate the structure of manual test case descriptions based on the standardized structured manual test case format.</li> <li class=MsoNormal style='mso-list:l21 level1 lfo21;tab-stops:list .5in'>Try to create suites with a number of cases that can be completed in less than one hour. </li> </ol> <p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b>2.2 Creating Junit and Junit Plug-in Test Cases and Suites<o:p></o:p></b></p> <p class=MsoNormal style='margin-left:.25in'><b><o:p> </o:p></b></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l10 level1 lfo24;tab-stops:list .5in'><span style='mso-bidi-font-weight:bold'>JUnit tests are created in the JUnit folder of a test project, Junit Plug-ins tests in the <span class=SpellE>junit_plugin</span> folder. Please refer to the naming conventions section of Part 2<span style='color:red'> </span></span><span style='color:red;mso-bidi-font-style: italic'>(need link)</span><span style='mso-bidi-font-weight:bold'>.<o:p></o:p></span></li> <li class=MsoNormal style='mso-list:l10 level1 lfo24;tab-stops:list .5in'><span style='mso-bidi-font-weight:bold'>Detailed steps for creating new TPTP JUnit tests can be found under Help >> Help Contents >> Testing Applications >> Testing with JUnit<o:p></o:p></span></li> <li class=MsoNormal style='mso-list:l10 level1 lfo24;tab-stops:list .5in'><span style='mso-bidi-font-weight:bold'>Detailed steps for creating new TPTP JUnit Plug-in tests can be found under Help >> Help Contents >> Testing Applications >> Testing plug-ins with JUnit<o:p></o:p></span></li> </ol> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b>2.3 Creating AGR Test Suites<o:p></o:p></b></p> <p class=MsoNormal><o:p> </o:p></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l12 level1 lfo60;tab-stops:list .5in'>For TPTP 4.5.0 and greater download the Automated GUI Recorder from the <span class=GramE><b style='mso-bidi-font-weight:normal'>As-</b></span><b style='mso-bidi-font-weight:normal'>Is Components</b> section of the TPTP download page.</li> </ol> <p class=MsoNormal style='margin-left:.25in'>2. <span style='mso-tab-count: 1'> </span>Detailed steps for creating AGR test cases and suites can be found in the document An Introduction to Using <span class=SpellE>TPTP's</span> Automated GUI Recorder<span class=GramE><span style='mso-bidi-font-weight:bold'> <span style='mso-spacerun:yes'> </span>found</span></span><span style='mso-bidi-font-weight:bold'> at <a href="http://www.eclipse.org/tptp/test/documents/index.php">http://www.eclipse.org/tptp/test/documents/index.php</a><o:p></o:p></span></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><o:p> </o:p></p> <div class=MsoNormal align=center style='text-align:center'> <hr size=2 width="100%" align=center> </div> <p class=MsoNormal><b style='mso-bidi-font-weight:normal'><span style='font-size:14.0pt'>3.0 Executing Tests<o:p></o:p></span></b></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b>3.1 Manual Test Suites<o:p></o:p></b></p> <p class=MsoNormal><o:p> </o:p></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l4 level1 lfo30;tab-stops:list .5in'>Open the Test perspective.</li> <li class=MsoNormal style='mso-list:l4 level1 lfo30;tab-stops:list .5in'>In the Test Navigator view, select the manual test suite to be executed. </li> <li class=MsoNormal style='mso-list:l4 level1 lfo30;tab-stops:list .5in'>Launch the selected test suite by creating a Test configuration in the Run dialog</li> </ol> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Under the Test tab select the test suite</p> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Choose the results folder associated with the selected test suite and deployment platform</p> <p class=MsoNormal style='margin-left:1.5in'><b>Note:</b> The name and directory structure containing the generated execution history file <b>MUST</b> be the same as it will be in CVS in order for generated reports to work correctly.</p> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Click Run</p> <ol style='margin-top:0in' start=4 type=1> <li class=MsoNormal style='mso-list:l2 level1 lfo33;tab-stops:list .5in'>Launch a candidate workbench on the testing platform</li> <li class=MsoNormal style='mso-list:l2 level1 lfo33;tab-stops:list .5in'>Execute each test case as specified in the TPTP Manual Test View on the local host.</li> <li class=MsoNormal style='mso-list:l2 level1 lfo33;tab-stops:list .5in'>Record the result of the test case execution by capturing the status of the test case execution using the following explanation for TPTP Testing Tools Status options: </li> </ol> <table class=MsoNormalTable border=1 cellpadding=0 align=left style='mso-cellspacing: 1.5pt;mso-table-lspace:.5in;margin-left:33.75pt;mso-table-rspace:9.35pt; margin-right:7.1pt;mso-table-tspace:12.15pt;margin-top:9.9pt;mso-table-anchor-vertical: paragraph;mso-table-anchor-horizontal:column;mso-table-left:left;mso-padding-alt: 0in 5.4pt 0in 5.4pt'> <tr style='mso-yfti-irow:0'> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'><b>TPTP Testing Tools Status<o:p></o:p></b></p> </td> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'><b>Explanation<o:p></o:p></b></p> </td> </tr> <tr style='mso-yfti-irow:1'> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>Error</p> </td> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>Do not use.</p> </td> </tr> <tr style='mso-yfti-irow:2'> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>Fail</p> </td> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>The test case could be executed and failed due to a blocking defect. </p> </td> </tr> <tr style='mso-yfti-irow:3'> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>Inconclusive</p> </td> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>The test case was not applicable OR the test case could be executed and failed due to a non-blocking defect. </p> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>A non-blocking defect is defined as a nice-to-have fix that does not degrade the core functionality being tested by the test case. </p> </td> </tr> <tr style='mso-yfti-irow:4;mso-yfti-lastrow:yes'> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>Pass</p> </td> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='margin-left:.25in;mso-element:frame;mso-element-frame-hspace: .5in;mso-element-frame-vspace:12.15pt;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly'>The test case could be executed and passed.</p> </td> </tr> </table> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l30 level1 lfo35; tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol;mso-bidi-font-weight: bold'><span style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span style='mso-bidi-font-weight:bold'>For verdicts of Fail or Inconclusive please provide a defect number and explanation in the test log. <o:p></o:p></span></p> <p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l30 level1 lfo35; tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol;mso-bidi-font-weight: bold'><span style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span style='mso-bidi-font-weight:bold'>For instructions on submitting defects from the test log which will create a link from the test log to <span class=SpellE>bugzilla</span> please see Submitting Defects <span style='color:red'>(need link)</span> in the Common tasks <span style='color:red'>(need link)</span> section.<o:p></o:p></span></p> <p class=MsoNormal style='margin-left:.25in'><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b>3.2 JUnit and JUnit Plug-in Test Suites<o:p></o:p></b></p> <p class=MsoNormal><o:p> </o:p></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l37 level1 lfo38;tab-stops:list .5in'>Open the Test perspective.</li> <li class=MsoNormal style='mso-list:l37 level1 lfo38;tab-stops:list .5in'>In the Test Navigator view, select the JUnit test suite to be executed.</li> <li class=MsoNormal style='mso-list:l37 level1 lfo38;tab-stops:list .5in'>Launch the selected test suite by creating a Test configuration in the Run dialog</li> </ol> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Under the Test tab select the test suite</p> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Select the deployment. </p> <p class=MsoNormal style='margin-left:1.75in;text-indent:-.25in'>To run a test remotely you will need to create and configure a new test deployment</p> <p class=MsoNormal style='margin-left:1.75in;text-indent:-.25in'>For JUnit plug-in tests you also may want to specify deployment on a different workbench location. </p> <p class=MsoNormal style='margin-left:1.75in;text-indent:-.25in'>The steps to create a new location and deployment are in the TPTP Project Documentation under <b>Testing Plugins with JUnit</b> </p> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Choose the results folder associated with the selected test suite and deployment platform</p> <p class=MsoNormal style='margin-left:1.5in'><b>Note:</b> The name and directory structure containing the generated execution history file <b>MUST</b> be the same as it will be in CVS in order for generated reports to work correctly.</p> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Click Run</p> <ol style='margin-top:0in' start=4 type=1> <li class=MsoNormal style='mso-list:l17 level1 lfo41;tab-stops:list .5in'>An execution history will be generated according to the following explanation of TPTP Testing Tools Status options: </li> </ol> <table class=MsoNormalTable border=1 cellpadding=0 align=left style='mso-cellspacing: 1.5pt;mso-table-lspace:.5in;margin-left:33.75pt;mso-table-rspace:9.35pt; margin-right:7.1pt;mso-table-tspace:.1in;margin-top:4.95pt;mso-table-anchor-vertical: paragraph;mso-table-anchor-horizontal:column;mso-table-left:left;mso-table-top: .05pt;mso-padding-alt:0in 5.4pt 0in 5.4pt'> <tr style='mso-yfti-irow:0'> <td style='padding:.7pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'><b>TPTP Testing Tools Status<o:p></o:p></b></p> </td> <td style='padding:.7pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'><b>Explanation<o:p></o:p></b></p> </td> </tr> <tr style='mso-yfti-irow:1'> <td style='padding:.7pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>Error</p> </td> <td style='padding:.7pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>The test case was or could not be executed due to a run time error.</p> </td> </tr> <tr style='mso-yfti-irow:2'> <td style='padding:.7pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>Fail</p> </td> <td style='padding:.7pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>The test case could be executed and failed due to a defect.</p> </td> </tr> <tr style='mso-yfti-irow:3;mso-yfti-lastrow:yes'> <td style='padding:.7pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>Pass</p> </td> <td style='padding:.7pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>The test case could be executed and passed.</p> </td> </tr> </table> <p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l38 level1 lfo43; tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]>The Fail and Error verdict events in the test log will contain a stack trace that can jump to source.</p> <p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l38 level1 lfo43; tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol;mso-bidi-font-weight: bold'><span style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span style='mso-bidi-font-weight:bold'>For instructions on submitting defects from the test log which will create a link from the test log to <span class=SpellE>bugzilla</span> please see Submitting Defects <span style='color:red'>(need link)</span> in the Common tasks <span style='color:red'>(need link)</span> section.<o:p></o:p></span></p> <p class=MsoNormal style='margin-left:.5in'><span style='mso-bidi-font-weight: bold'><o:p> </o:p></span></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><b>3.3 AGR Test Suites</b> <b><o:p></o:p></b></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l33 level1 lfo46;tab-stops:list .5in'>Ensure that the Agent Controller is installed and started.</li> <li class=MsoNormal style='mso-list:l33 level1 lfo46;tab-stops:list .5in'>Open the Test perspective.</li> <li class=MsoNormal style='mso-list:l33 level1 lfo46;tab-stops:list .5in'>In the Test Navigator view, select the Automated GUI Test to be executed.</li> <li class=MsoNormal style='mso-list:l33 level1 lfo46;tab-stops:list .5in'>Execute the test suite by creating a launch configuration item. See Creating Launch Configurations <span style='color:red'>(need link)</span> in the Common Tasks <span style='color:red'>(need link)</span> section of this document. </li> </ol> <p class=MsoNormal style='margin-left:.75in'><b>Important: </b>Using the 'Quick Run' mode will not generate an execution history file. Make sure that a proper launch configuration is used.</p> <ol style='margin-top:0in' start=5 type=1> <li class=MsoNormal style='mso-list:l33 level1 lfo46;tab-stops:list .5in'> The runner will generate an execution history according to the following explanation of TPTP Testing Tools Status options: </li> </ol> <table class=MsoNormalTable border=1 cellpadding=0 align=left style='mso-cellspacing: 1.5pt;mso-table-lspace:.5in;margin-left:33.75pt;mso-table-rspace:9.35pt; margin-right:7.1pt;mso-table-tspace:.1in;margin-top:4.95pt;mso-table-anchor-vertical: paragraph;mso-table-anchor-horizontal:column;mso-table-left:left;mso-table-top: .05pt;mso-padding-alt:0in 5.4pt 0in 5.4pt'> <tr style='mso-yfti-irow:0'> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'><b>TPTP Testing Tools Status<o:p></o:p></b></p> </td> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'><b>Explanation<o:p></o:p></b></p> </td> </tr> <tr style='mso-yfti-irow:1'> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>Error</p> </td> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>The test case was or could not be executed due to a run time error.</p> </td> </tr> <tr style='mso-yfti-irow:2'> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>Fail</p> </td> <td style='padding:.75pt .75pt .75pt .75pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>The test case could be executed and failed due to a defect.</p> </td> </tr> <tr style='mso-yfti-irow:3;mso-yfti-lastrow:yes;height:20.85pt'> <td style='padding:.75pt .75pt .75pt .75pt;height:20.85pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>Pass</p> </td> <td style='padding:.75pt .75pt .75pt .75pt;height:20.85pt'> <p class=MsoNormal style='mso-element:frame;mso-element-frame-hspace:.5in; mso-element-frame-vspace:.1in;mso-element-wrap:around;mso-element-anchor-vertical: paragraph;mso-element-anchor-horizontal:column;mso-element-top:.05pt; mso-height-rule:exactly'>The test case could be executed and passed.</p> </td> </tr> </table> <p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> <p class=MsoNormal style='margin-left:.25in'><o:p> </o:p></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal style='margin-left:.25in;text-indent:.25in'><o:p> </o:p></p> <p class=MsoNormal style='margin-left:.5in'><o:p> </o:p></p> <p class=MsoNormal style='margin-left:.25in;text-indent:.25in'><o:p> </o:p></p> <p class=MsoNormal style='margin-left:.25in;text-indent:.25in'><o:p> </o:p></p> <p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l11 level1 lfo49; tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]>The Fail and Error verdict events in the test log will contain a stack trace that can jump to source.</p> <p class=MsoNormal style='margin-left:.75in;text-indent:-.25in;mso-list:l11 level1 lfo49; tab-stops:list .75in'><![if !supportLists]><span style='font-family:Symbol; mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol;mso-bidi-font-weight: bold'><span style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span style='mso-bidi-font-weight:bold'>For instructions on submitting defects from the test log which will create a link from the test log to <span class=SpellE>bugzilla</span> please see Submitting Defects <span style='color:red'>(need link)</span> in the Common tasks <span style='color:red'>(need link)</span> section.<o:p></o:p></span></p> <p class=MsoNormal style='margin-left:.25in;text-indent:.25in'><o:p> </o:p></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><o:p> </o:p></p> <div class=MsoNormal align=center style='text-align:center'> <hr size=2 width="100%" align=center> </div> <p class=MsoNormal><b style='mso-bidi-font-weight:normal'><span style='font-size:14.0pt'>4.0 Common Tasks<o:p></o:p></span></b></p> <p class=MsoNormal><b style='mso-bidi-font-weight:normal'><span style='font-size:14.0pt'><o:p> </o:p></span></b></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b style='mso-bidi-font-weight:normal'>4.1 Creating Test Suites<o:p></o:p></b></p> <p class=MsoNormal><b style='mso-bidi-font-weight:normal'><o:p> </o:p></b></p> <p class=MsoNormal>General Guidelines for test case creation:</p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l6 level1 lfo52;tab-stops:list .5in'>Create short concise cases that cover identifiable partitions of functionality. This increases reporting accuracy and allows for easy reproduction by testers and fixers.</li> <li class=MsoNormal style='mso-list:l6 level1 lfo52;tab-stops:list .5in'>Comment test cases thoroughly in the description section of the including the manual steps for what the test case is performing.</li> <li class=MsoNormal style='mso-list:l6 level1 lfo52;tab-stops:list .5in'>If any resource (such as a <span class=SpellE>datapool</span>) needs to be modified before the test suite is executed, then include that as part of the description of the test suite. Any other important information that the tester should be aware of needs to be included in the description of the test suite.</li> <li class=MsoNormal style='mso-list:l6 level1 lfo52;tab-stops:list .5in'>If an existing manual test case is being automated, then add '(DEPRECATED - Use <automated test suite name>)' to the beginning of the description of the manual test case.</li> <li class=MsoNormal style='mso-list:l6 level1 lfo52;tab-stops:list .5in'><span style='color:black'>For more guidance creating effective test cases please refer to the best practices section of </span><a href="http://www.eclipse.org/tptp/home/documents/process/TPTP_Testing_Strategy.html#2.2"><span style='color:windowtext;text-decoration:none;text-underline:none'>Part 2</span></a> <span style='color:red'>(need link)</span>.<o:p></o:p></li> </ol> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b style='mso-bidi-font-weight:normal'>4.2 Launching Test Suites<o:p></o:p></b></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal>Creating Test Deployments</p> <p class=MsoNormal><span style='mso-tab-count:1'> </span>Detailed steps for creating test deployments can be found in Help >> Help Contents >> Testing Applications >> Creating a Test Deployment</p> <p class=MsoNormal><span style='color:red'><o:p> </o:p></span></p> <p class=MsoNormal>Create a Test Launch Configuration<o:p></o:p></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l29 level1 lfo62;tab-stops:list .5in'>Create a new launch configuration by selecting the entry Test from the list of configurations in Run >> Run Configurations</li> <li class=MsoNormal style='mso-list:l29 level1 lfo62;tab-stops:list .5in'>Use the Select test to run pane to navigate to and select the test suite you wish to run.</li> <li class=MsoNormal style='mso-list:l29 level1 lfo62;tab-stops:list .5in'>Select the deployment for running the test suite. By default the test will be deployed locally; to change this see the <span style='mso-bidi-font-style: italic'>Creating Test Deployments <span style='color:red'>(need link)</span></span> topic. Manual tests are always run in the local deployment.<o:p></o:p></li> <li class=MsoNormal style='mso-list:l29 level1 lfo62;tab-stops:list .5in'>In the Test Logs tab override the default log configuration to match the desired log directory (for example <span class=SpellE>plugin_results</span>). Please refer to the naming conventions section of Part 2 <span style='color:red'>(need link)</span> for the names of result directories.<o:p></o:p></li> </ol> <p class=MsoNormal><b style='mso-bidi-font-weight:normal'><o:p> </o:p></b></p> <p class=MsoNormal><b style='mso-bidi-font-weight:normal'>4.3 Viewing Test Logs<o:p></o:p></b></p> <p>To open a <span class=resultoftext><span name=resultofMatch>test</span></span> <span class=resultoftext><span name=resultofMatch>log</span></span> file, use the Open File window, or double-click in the <span class=resultoftext><span name=resultofMatch>Test</span></span> Navigator the file with the extension, <span class=filepath>.execution</span>.</p> <ol start=1 type=1> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto; mso-list:l7 level1 lfo55;tab-stops:list .5in'>From the <span class=uicontrol>File</span> menu, click <span class=uicontrol>Open File</span>. </li> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto; mso-list:l7 level1 lfo55;tab-stops:list .5in'>Browse to and select the <span class=resultoftext><span name=resultofMatch>test</span></span> <span class=resultoftext><span name=resultofMatch>log</span></span> file to open. (<span class=resultoftext><span name=resultofMatch>Test</span></span> <span class=resultoftext><span name=resultofMatch>log</span></span> files use the extension, <span class=filepath>.execution</span>.) </li> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto; mso-list:l7 level1 lfo55;tab-stops:list .5in'>Click <span class=uicontrol>OK</span>. </li> </ol> <p class=MsoNormal><b style='mso-bidi-font-weight:normal'>4.4 Reporting Test Results<o:p></o:p></b></p> <p class=MsoNormal><o:p> </o:p></p> <p class=MsoNormal><b>Submitting Execution Histories<o:p></o:p></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <ol style='margin-top:0in' start=1 type=1> <li class=MsoNormal style='mso-list:l27 level1 lfo58;tab-stops:list .5in'>Execution histories should be checked-in to the CVS branch for the release under test. They are checked into a results folder under the associated <span class=SpellE>plugin</span> for the type of test executed (<span class=SpellE>manual_results</span>, <span class=SpellE>junit_results</span>, <span class=SpellE>junit_plugin_results</span>, <span class=SpellE>gui_results</span>). To delineate between test executions on multiple platforms, each results folder contains subfolders for the supported platforms.</li> </ol> <p class=MsoNormal style='margin-left:.75in'><b style='mso-bidi-font-weight: normal'>For Example:</b> The results of executing the manual test <i style='mso-bidi-font-style:normal'>org.eclipse.hyades.use.cases/manual/Profiling_and_Logging/Platform.Communication.Control_Channel_Remote_Profiling.Windows_IA32.testsuite</i> should be generated to and checked into <i style='mso-bidi-font-style:normal'>org.eclipse.hyades.use.cases/manual_results/Profiling_and_Logging/Windows_XP</i></p> <ol style='margin-top:0in' start=2 type=1> <li class=MsoNormal style='mso-list:l27 level1 lfo58;tab-stops:list .5in'>Testers who are not committers should email the execution history files to the committer for the associated component.</li> </ol> <p class=MsoNormal style='margin-left:.75in'>Include the following in your email:</p> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>Name of tester if not same as sender</p> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'><span class=GramE>Deployment platform(s) including name, version and release.</span></p> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'><span class=GramE>Execution specific information including name, version and release.</span></p> <p class=MsoNormal style='margin-left:1.25in;text-indent:-.25in'>TPTP driver build id and test pass identifier.</p> <p class=MsoNormal><o:p> </o:p></p> <div class=MsoNormal align=center style='text-align:center'> <hr size=2 width="100%" align=center> </div> <p class=MsoNormal><b><span style='font-size:14.0pt'>5.0 Help<o:p></o:p></span></b></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><a href="http://www.eclipse.org/tptp/">Eclipse Test & Performance Tools Platform Project Web Site</a><o:p></o:p></span></p> <p class=MsoNormal><b><o:p> </o:p></b></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'>Full current TPTP Test Tools Documentation can be found in the eclipse help under:<span style='mso-spacerun:yes'> </span>Help >> Help Contents >> Testing Applications<o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><o:p> </o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'>AGR Documentation<o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span style='mso-tab-count:1'> </span><a href="http://www.eclipse.org/tptp/test/documents/index.php">http://www.eclipse.org/tptp/test/documents/index.php</a><o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><span style='mso-tab-count:1'> </span>See </span>An Introduction to Using <span class=SpellE>TPTP's</span> Automated GUI Recorder for your TPTP release version.<span style='mso-bidi-font-weight:bold'><o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><o:p> </o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><a href="http://www.eclipse.org/tptp/home/documents/extenders.php">Documentation for TPTP extenders</a><o:p></o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><o:p> </o:p></span></p> <p class=MsoNormal><span style='mso-bidi-font-weight:bold'><a href="http://www.eclipse.org/tptp/home/project_info/general/mailnews.php">TPTP Mailing Lists and Newsgroups</a><o:p></o:p></span></p> </div> </body> </html>
View Attachment As Raw
Actions:
View
Attachments on
bug 211777
:
102509
|
102510
|
104770
|
104771
|
105529
|
105532