Attachment 102510 Details for Bug 211777 – Updated Part 2 document

Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Updated Part 2 document

TPTP_Testing_Strategy_Part2.html (text/html), 84.17 KB, created by Alan Haggarty

on 2008-05-28 16:24:18 EDT

(hide)

Description:

Filename:

MIME Type:

Creator: Alan Haggarty

Created: 2008-05-28 16:24:18 EDT

Size: 84.17 KB

patch

obsolete

><html xmlns:v="urn:schemas-microsoft-com:vml"
>xmlns:o="urn:schemas-microsoft-com:office:office"
>xmlns:w="urn:schemas-microsoft-com:office:word"
>xmlns="http://www.w3.org/TR/REC-html40">
>
><head>
><meta http-equiv=Content-Type content="text/html; charset=windows-1252">
><meta name=ProgId content=Word.Document>
><meta name=Generator content="Microsoft Word 10">
><meta name=Originator content="Microsoft Word 10">
><link rel=File-List href="TPTP_Testing_Strategy_Part2_files/filelist.xml">
><link rel=Edit-Time-Data href="TPTP_Testing_Strategy_Part2_files/editdata.mso">
>
><style>
>
></style>
>
></head>
>
><body lang=EN-US link=blue vlink=purple style='tab-interval:.5in'>
>
><div class=Section1>
>
>normal'>TPTP Testing Strategy Part 2<o:p></o:p>
>
>normal'>Test Conventions and Best Practices
>
><o:p>&nbsp;</o:p>
>
>1.0
>TPTP Test Project Conventions
>
>style='mso-tab-count:1'>               1.1 Naming Conventions
>
>style='mso-tab-count:1'>               1.2 Test Project Detailed Structure
>
>2.0
>Test Creation Best Practices
>
>style='mso-tab-count:1'>               2.1 Creating Manual Test Suites
>
>style='mso-tab-count:1'>               2.2 Creating JUnit and JUnit
>Plug-in Test Suites
>
>style='mso-tab-count:1'>               2.3 Creating AGR Test Suites
>
>3.0
>Test Execution Best Practices
>
>style='mso-tab-count:1'>               3.1 Smoke Testing
>
>4.0
>TPTP Test Project Exceptions
>
>style='mso-tab-count:1'>               4.1 JVMPI Profiler Test Suites
>
>5.0
>The Common Test Infrastructure
>
>style='mso-tab-count:1'>               5.1 Reference Platform
>
>style='mso-tab-count:1'>               5.2 Adding Tests
>
>style='mso-tab-count:1'>               5.3 Installing and Deploying
>
><o:p>&nbsp;</o:p>
>
><o:p>&nbsp;</o:p>
>
>style='mso-bidi-font-weight:normal'>1.0 TPTP
>Test Project Conventions<o:p></o:p>
>
>style='mso-bidi-font-weight:normal'>1.1 Naming conventions: <o:p></o:p>
>
><ol start=1 type=1>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l10 level1 lfo6;tab-stops:list .5in'>All names for testing
> resources and folder names MUST adhere to the following rules: </li>
> <ul type=circle>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
> auto;mso-list:l10 level2 lfo6;tab-stops:list 1.0in'>Upper or lower case
> letter (for example, A-Z or a-z).</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
> auto;mso-list:l10 level2 lfo6;tab-stops:list 1.0in'>Digits (for example,
> 0 - 9).</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
> auto;mso-list:l10 level2 lfo6;tab-stops:list 1.0in'>Underscore (for
> example, _).</li>
> </ul>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l10 level1 lfo6;tab-stops:list .5in'>Names must NOT contain any
> white space characters (for example, tab, space, and new line).</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l10 level1 lfo6;tab-stops:list .5in'>Every name should begin with
> an upper or lower case letter (for example, A-Z or a-z). All other
> characters in the name should be upper or lower case letters, digits, or
> the underscore.</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l10 level1 lfo6;tab-stops:list .5in'>Java keywords (for example,
> import, if, etc.) cannot be used for names of JUnit test resources.</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l10 level1 lfo6;tab-stops:list .5in'>The name of the Deployment
> file (deployment files are often used for remote launch of test suites)
> may contain '.' characters. The name should be meaningful to the project
> and the host that it is associated with. For example, a local deployment
> file for the org.eclipse.hyades.use.cases folder can be
> org.eclipse.hyades.use.cases.localhost.deploy</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l10 level1 lfo6;tab-stops:list .5in'>The name and directory
> structure containing the generated execution history file MUST be the same
> as it will be stored in CVS. If the generated execution history file is
> either moved or renamed, the linkage with the associated test suite will
> break thereby corrupting generated reports. In the event of an existing
> execution history in the same directory, TPTP Testing Tools will append a
> millisecond time stamp to the name of the new execution history file.</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l10 level1 lfo6;tab-stops:list .5in'>Test suite names must start
> with the bugzilla component name (see <a
> href="https://bugs.eclipse.org/bugs/show_bug.cgi?id=104409">bugzilla
> 104409</a>) associated with the plug-in or component under test.</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l10 level1 lfo6;tab-stops:list .5in'>Multiple JRE or platform
> test suite names must end with the name, vendor, and version of the JRE or
> platform under test. These test suites should reference the test suite(s)
> and/or test case(s) for the plug-in or component to avoid redundancy.</li>
></ol>
>
>style='mso-bidi-font-weight:normal'>1.2 Test Project Detailed Structure<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>The
>contents of a test project must follow a defined structure. Table 1 details the
>required structure for contents of a test project, for example, <a
>href="http://dev.eclipse.org/viewcvs/index.cgi/test-results/platform/org.eclipse.hyades.use.cases/?root=TPTP_Project">test-results/platform/org.eclipse.hyades.use.cases</a>.
>
>
><table class=MsoNormalTable border=1 cellpadding=0 width="100%"
> style='width:100.0%;mso-cellspacing:1.5pt;margin-left:.5in;mso-padding-alt:
> 0in 5.4pt 0in 5.4pt'>
> <tr style='mso-yfti-irow:0'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Name<o:p></o:p>
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Purpose<o:p></o:p>
> </td>
> </tr>
> <tr style='mso-yfti-irow:1'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> deployment
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all deployment configurations for
> executing the test suites in the test project.
> </td>
> </tr>
> <tr style='mso-yfti-irow:2'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> gui
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all AGR test suites for the test
> project.
> </td>
> </tr>
> <tr style='mso-yfti-irow:3'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> gui/AllTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> AGR test suite to execute all lower level AGR test suites
> for the test project. Must be referenced by
> test-results/platform/org.eclipse.hyades.tests/AllGUITests.testsuite (see
> Table 2).
> </td>
> </tr>
> <tr style='mso-yfti-irow:4'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> gui/AllSmokeTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> AGR smoke test suite to execute all lower level AGR smoke test
> suites for the test project. Must be referenced by
> test-results/platform/org.eclipse.hyades.tests/AllGUISmokeTests.testsuite
> (see Table 2).
> </td>
> </tr>
> <tr style='mso-yfti-irow:5'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> gui_results
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all execution histories for automated
> GUI test suites for the test project.
> </td>
> </tr>
> <tr style='mso-yfti-irow:6'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> junit_plugin
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all JUnit Plug-in test suites for the
> test project.
> </td>
> </tr>
> <tr style='mso-yfti-irow:7'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> junit_plugin/AllTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> JUnit Plug-in test suite to execute all lower level JUnit Plug-in
> test suites for the test project. Must be referenced by
> test-results/platform/org.eclipse.hyades.tests/AllJUnitPluginTests.testsuite
> (see Table 2).
> </td>
> </tr>
> <tr style='mso-yfti-irow:8'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> junit_plugin/AllSmokeTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> JUnit Plug-in smoke test suite to execute all lower level JUnit
> Plug-in smoke test suites for the test project. Must be referenced by
> test-results/platform/org.eclipse.hyades.tests/AllJUnitPluginSmokeTests.testsuite
> (see Table 2).
> </td>
> </tr>
> <tr style='mso-yfti-irow:9'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> junit_plugin_results
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all execution histories for JUnit Plug-in
> test suites for the test project.
> </td>
> </tr>
> <tr style='mso-yfti-irow:10'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> junit
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all JUnit test suites for the test
> project.
> </td>
> </tr>
> <tr style='mso-yfti-irow:11'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> junit/AllTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> JUnit test suite to execute all lower level JUnit test suites
> for the test project. Must be referenced by
> test-results/platform/org.eclipse.hyades.tests/AllJUnitTests.testsuite (see
> Table 2).
> </td>
> </tr>
> <tr style='mso-yfti-irow:12'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> junit/AllSmokeTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> JUnit smoke test suite to execute all lower level JUnit
> smoke test suites for the test project. Must be referenced by
> test-results/platform/org.eclipse.hyades.tests/AllJUnitSmokeTests.testsuite
> (see Table 2).
> </td>
> </tr>
> <tr style='mso-yfti-irow:13'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> junit_results
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all execution histories for JUnit
> test suites for the test project.
> </td>
> </tr>
> <tr style='mso-yfti-irow:14'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> manual
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all manual test suites for the test
> project.
> </td>
> </tr>
> <tr style='mso-yfti-irow:15'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> manual/AllTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Manual test suite to execute all lower level manual test
> suites for the test project. Must be referenced by
> test-results/platform/org.eclipse.hyades.tests/AllManualTests.testsuite (see
> Table 2).
> </td>
> </tr>
> <tr style='mso-yfti-irow:16'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> manual/AllSmokeTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Manual smoke test suite to execute all lower level manual
> smoke test suites for the test project. Must be referenced by
> test-results/platform/org.eclipse.hyades.tests/AllManualSmokeTests.testsuite
> (see Table 2).
> </td>
> </tr>
> <tr style='mso-yfti-irow:17'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> manual_results
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all execution histories for manual
> test suites for the test project.
> </td>
> </tr>
> <tr style='mso-yfti-irow:18'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> resources
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing any resources required to execute the
> test suites for the test project.
> </td>
> </tr>
> <tr style='mso-yfti-irow:19;mso-yfti-lastrow:yes'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> src
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing generated JUnit Java source code for
> the JUnit and JUnit Plug-in test suites and Java source code corresponding to
> verification hooks of AGR test suites for the test project.
> </td>
> </tr>
></table>
>
>Table
>1: Required structure for contents of a test project. 
>
>Each
>of the subfolders contains a test project named org.eclipse.hyades.use.cases
>for testing functionality that crosses plug-in or component boundaries. 
>
>The
><a
>href="http://dev.eclipse.org/viewcvs/index.cgi/test-results/platform/org.eclipse.hyades.tests/?root=TPTP_Project">test-results/platform/org.eclipse.hyades.tests</a>
>test project contains all root-level test suites for TPTP. Table 2 details the
>required structure for contents of the test-results/platform/org.eclipse.hyades.tests
>test project. 
>
><table class=MsoNormalTable border=1 cellpadding=0 width="100%"
> style='width:100.0%;mso-cellspacing:1.5pt;margin-left:.5in;mso-padding-alt:
> 0in 5.4pt 0in 5.4pt'>
> <tr style='mso-yfti-irow:0'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Name<o:p></o:p>
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Purpose<o:p></o:p>
> </td>
> </tr>
> <tr style='mso-yfti-irow:1'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> deployment
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all deployment configurations for
> executing the root-level test suites in TPTP.
> </td>
> </tr>
> <tr style='mso-yfti-irow:2'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> enablement
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all the TPTP enablement tests.
> </td>
> </tr>
> <tr style='mso-yfti-irow:3'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> TVT
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing all the TPTP Translation Verification
> Tests (TVT).
> </td>
> </tr>
> <tr style='mso-yfti-irow:4'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> src
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Directory containing generated JUnit Java source code for
> the root-level JUnit and JUnit Plug-in test suites in TPTP and Java source
> code corresponding to verification hooks of root-level AGR test suites in
> TPTP.
> </td>
> </tr>
> <tr style='mso-yfti-irow:5'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> AllGUITests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Root-level AGR test suite to execute all lower level AGR
> test suites.
> </td>
> </tr>
> <tr style='mso-yfti-irow:6'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> AllGUISmokeTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Root-level AGR smoke test suite to execute all lower level
> AGR smoke test suites.
> </td>
> </tr>
> <tr style='mso-yfti-irow:7'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> AllJUnitPluginTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Root-level JUnit Plug-in test suite to execute all lower
> level JUnit Plug-in test suites.
> </td>
> </tr>
> <tr style='mso-yfti-irow:8'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> AllJUnitPluginSmokeTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Root-level JUnit Plug-in smoke test suite to execute all
> lower level JUnit Plug-in smoke test suites.
> </td>
> </tr>
> <tr style='mso-yfti-irow:9'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> AllJUnitTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Root-level JUnit test suite to execute all lower level
> JUnit test suites.
> </td>
> </tr>
> <tr style='mso-yfti-irow:10'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> AllJUnitSmokeTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Root-level JUnit smoke test suite to execute all lower
> level JUnit smoke test suites.
> </td>
> </tr>
> <tr style='mso-yfti-irow:11'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> AllManualTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Root-level manual test suite to execute all lower level
> manual test suites.
> </td>
> </tr>
> <tr style='mso-yfti-irow:12;mso-yfti-lastrow:yes'>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> AllManualSmokeTests.testsuite
> </td>
> <td style='padding:.75pt .75pt .75pt .75pt'>
> Root-level manual smoke test suite to execute all lower
> level manual smoke test suites.
> </td>
> </tr>
></table>
>
>Table
>2: Required structure for contents of the
>test-results/platform/org.eclipse.hyades.tests test project.<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>The
>execution history files (*.execution) generated when executing test suites are
>checked-in to the CVS branch for the release under test by the committer for
>the associated plug-in or component. For example, the execution history files
>generated from testing the current full release would be checked in to HEAD.
>Execution history files are checked in to the *_results folder for the type of
>test suite. For example, execution history files generated from executing a
>manual test suite would be checked in the manual_results folder. To delineate
>between test executions on multiple platforms, each *_results folder contains
>the following subfolders for each supported platform: 
>
>margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>AIX
>
>margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>AS_400
>
>margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>HP_UX
>
>margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Linux_390
>
>margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Linux_x86
>
>margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>OS_390
>
>margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Solaris
>
>margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Windows
>
>margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Linux PPC64
>
>Supported
>platform subfolders may be optionally appended with the platform version and
>release: 
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>AIX_5_2_0
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>AS_400_5_2
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>HP_UX_11
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Linux_390_SuSE_ Enterprise_7_0
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Linux_x86_RedHat_Enterprise_2_1
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Linux_x86_SLES_10
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>OS_390_1_6
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Solaris_9
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Windows_2000
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Windows_XP
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Windows_Vista
>
>margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
>mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'>style='mso-list:Ignore'>·&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Linux_PPC64
>
>Test
>execution reports are generated and checked in to CVS by the TPTP Project Lead
>or PMC representative at predetermined milestones in a test pass for public web
>access. Test execution reports are available at: <a
>href="http://www.eclipse.org/tptp/">www.eclipse.org/tptp</a> &gt;&gt;
>Development Plans &gt;&gt; Test Pass Reports 
>
>style='mso-bidi-font-weight:normal'>2.0 Test
>Creation Best Practices<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>Based
>on the previous experiences of test resource creators and testers, the
>following general recommendations will assist testers on creating test cases. Section
>2.1 - 2.3 go into more details about best practices for creating manual, JUnit,
>JUnit Plug-in, and AGR test suites. 
>
><ol start=1 type=1>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l11 level1 lfo13;tab-stops:list .5in'>A test case should always
> have a specific purpose for testing a scenario. Having many test cases in
> a test suite does not necessarily ensure better quality. Each test case
> must be well thought out and have a specific purpose. Simply testing the
> basic functionality of a tool is often not enough to ensure high quality
> standards. Boundary cases are usually considered to be interesting test
> cases. As an example, consider the case of testing a function that removes
> entries from a table. The following test cases should be considered: </li>
> <ul type=circle>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
> auto;mso-list:l11 level2 lfo13;tab-stops:list 1.0in'>Removing the first
> entry (a boundary case)</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
> auto;mso-list:l11 level2 lfo13;tab-stops:list 1.0in'>Removing the second
> entry (tests basic functionality)</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
> auto;mso-list:l11 level2 lfo13;tab-stops:list 1.0in'>Removing the last
> entry (a boundary case)</li>
> </ul>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l11 level1 lfo13;tab-stops:list .5in'>Avoid repeating the same
> set of steps in multiple test cases. If two test cases require the user to
> import a log file, then create three test cases. The first test case will
> only serve as setting the environment for successive test cases and the
> second and third test case will test the specific functionality in mind.</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l11 level1 lfo13;tab-stops:list .5in'>This point provides a basic
> summary of the first two: apply the high cohesion principle to test cases.
> Cohesion means assigning specific responsibilities to test cases. A test
> case requiring a user to import a log file, profile an application, and
> use the Probekit has little common in its responsibilities and thus does
> not follow the high cohesion principle.</li>
> <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
> mso-list:l11 level1 lfo13;tab-stops:list .5in'>Avoid unnecessarily
> complicating test cases that are designed to test functionality and not
> performance. For example, a test case that uses a class with 3 methods to
> test the Java Profiler is likely as good as a test case that uses a class
> with 10 methods.</li>
></ol>
>
><o:p>&nbsp;</o:p>
>
>style='mso-tab-count:1'>               normal'>2.1 Creating Manual Test Suites<o:p></o:p>
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l2 level1 lfo15;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>1.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Create small and terse manual test cases that cover
>well-defined partitions of functionality. Smaller sized test cases provide
>easier units of work for one tester to execute, more realistic reporting
>statistics and concise steps to reproduce defects.
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l2 level1 lfo15;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>2.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Create manual test suites with sufficient test cases
>for one tester to complete in less than an hour. Smaller sized test suites
>provide easier units of work dividing test suites between testers while
>decreasing the risk of lost execution data.
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l2 level1 lfo15;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>3.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>In the event of manual test suites being executed by
>multiple testers, have the tester(s) tabulate the execution histories on paper
>and the tester with largest assigned test cases will record all the execution
>histories in the TPTP Manual Test Client.
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l2 level1 lfo15;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>4.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>When structuring the internal organization as the
>associated test suite folder (for example, manual), create a summary test suite
>for the subfolder (for example,/manual/AllTests.testsuite). The summary test
>suite (for example,/manual/AllTests.testsuite) will reference all test suites
>within the current folder. This summary test suites is registered with the
>root-level manual test suite (for example,
>test-results/platform/org.eclipse.hyades.tests/AllManualTests.testsuite),
>thereby reducing work when creating and removing plug-in or component test
>suites.
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l2 level1 lfo15;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>5.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Although the TPTP Manual Test Client permits recording
>more than one execution verdict per test case, it is recommended to only record
>one execution verdict. Otherwise, TPTP Testing Tools arbitrates the execution
>verdicts based on the following precedence rules (decreasing order) which may
>cause unintended execution histories: 
>
>margin-left:1.5in;text-indent:-.25in;mso-list:l2 level2 lfo15;tab-stops:list 1.5in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
>mso-fareast-font-family:"Courier New"'>ostyle='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Error
>
>margin-left:1.5in;text-indent:-.25in;mso-list:l2 level2 lfo15;tab-stops:list 1.5in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
>mso-fareast-font-family:"Courier New"'>ostyle='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Fail
>
>margin-left:1.5in;text-indent:-.25in;mso-list:l2 level2 lfo15;tab-stops:list 1.5in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
>mso-fareast-font-family:"Courier New"'>ostyle='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Inconclusive
>
>margin-left:1.5in;text-indent:-.25in;mso-list:l2 level2 lfo15;tab-stops:list 1.5in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
>mso-fareast-font-family:"Courier New"'>ostyle='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Pass
>
><o:p>&nbsp;</o:p>
>
>style='mso-tab-count:1'>               normal'>2.2 Creating JUnit and JUnit Plug-in Test Suites<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l3 level1 lfo17;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>1.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Create small and terse unit test cases that cover
>individual methods or sequence of methods. Smaller sized test cases provide
>more realistic reporting statistics and concise steps to reproduce defects.
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l3 level1 lfo17;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>2.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>When structuring the internal organization as the
>associated test suite folders (for example, junit and junit_plugin), create summary
>test suites for each subfolder (for example,/junit/AllTests.testsuite and
>/junit_plugin/AllTests.testsuite). The summary test suites (for
>example,/junit/AllTests.testsuite and /junit_plugin/AllTests.testsuite) will
>reference all test suites within the current folder. These summary test suites
>are registered with the root-level JUnit and JUnit Plug-in test suites (for
>example, test-results/platform/org.eclipse.hyades.tests/AllJUnitTests.testsuite
>and test-results/platform/org.eclipse.hyades.tests/AllJUnitPluginTests.testsuite),
>thereby reducing work when creating and removing plug-in or component test
>suites.
>
>style='mso-tab-count:1'>               normal'>2.3 Creating AGR Test Suites<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>style='mso-tab-count:1'>   The user is expected to have reviewed the
>available user guide document on the AGR before reading the recommendations
>below. The user guide is available on the document section linked from TPTP's
>web site. 
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>1.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Ensure that a recording session is short. Avoid having
>a generated macro for a test case that is longer than 100 lines. 
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>2.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>As mentioned previously make sure that the set of test
>cases included in a test suite don't perform redundant operations. For example,
>if two test cases require launching a process, then launch the process once and
>use it for each of the test cases that follow. At the same time the test cases
>shouldn't be too dependent on the environment setup by previous test cases. A
>test case should easily be executable in quick mode without having to run many
>test cases that precede it. It becomes difficult to debug a test case when it
>is dependent on more than one test case that precedes it. 
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>3.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Avoid using absolute paths in a test case. Absolute
>paths should be replaced with relative paths using one of the available static
>variables (for example, %testsuiteProjectLocation%). Other modifiable fields
>that are dependent on the environment that the test suite is launched in (for
>example, host name) should be linked to a datapool variable. 
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>4.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Use a logger to make it convenient to debug
>verification hooks. See test-results/platform/
>org.eclipse.hyades.use.cases/src/org.eclipse.hyades.use.cases.auto.common/Logger.java
>
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>5.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Comment the test case thoroughly in the description
>section of the test case. Include all manual steps that the test case is
>performing. 
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>6.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>If any resource (such as a datapool) needs to be
>modified before the test suite is executed, then include that as part of the
>description of the test suite. Any other important information that the tester
>should be aware of needs to be included in the description of the test suite. 
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>7.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>If a manual test case is automated, then add
>'(DEPRECATED - Use &lt;automated test suite name&gt;)' to the beginning of the
>description of the manual test case. 
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>8.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Avoid position-based recording as much as possible. If
>position-based recording must be used for a component, then try to include all
>such test cases of the component in a separate test suite. Clearly note the
>resolution that the tester should use as part of the description of the test
>suite. 
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>9.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Verification hooks should verify the value of controls
>rather than their logical representation. For example, if a tree item
>represents object A, then verify the existence of the tree item by testing that
>its text field is the same as the name of object A as opposed to just simply
>testing for the existence of object A. 
>
>There
>is a recommended structure for the internal content of the 'gui' folder that
>committers are encouraged to use when automating existing manual test suites: 
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l1 level1 lfo21;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>1.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>The folders that are a direct child of the 'gui' folder
>should correspond exactly to the folders that are a direct child of the
>'manual' folder. When structuring the internal organization as the associated
>test suite folder (for example, gui), create a summary test suite for the
>subfolder (for example,/gui/AllTests.testsuite). The summary test suite (for
>example,/gui/AllTests.testsuite) will reference all test suites within the
>current folder. This summary test suites is registered with the root-level gui
>test suite (for example,
>test-results/platform/org.eclipse.hyades.tests/AllGUITests.testsuite), thereby
>reducing work when creating and removing plug-in or component test suites.
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l1 level1 lfo21;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>2.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>The name of the automated gui test suite should
>correspond exactly to the name of the manual test suite that is being
>automated.
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l1 level1 lfo21;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>3.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>A resource directory should be used to contain the
>resources required for the verification hooks of a test suite. The name of the
>directory should be &lt;test-suite-name&gt;.Resources (For example the resource
>directory for the Monitor.UI.LogSets test suite is
>Monitor.UI.LogSets.Resources. This directory may contain any number of log
>files or any other files that the test suite depends on). If a datapool is
>being associated with a test suite, then include the datapool as part of this
>directory (see the <a
>href="http://www.eclipse.org/tptp/test/documents/userguides/Intro-Auto-GUI.html">user
>guide</a> document on the AGR for more details).
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l1 level1 lfo21;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>4.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Use the directory 'Common.Resources' to store resources
>that are shared amongst multiple test suites
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l1 level1 lfo21;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>5.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>See figure 1 as an example of how the 'gui' folder can
>be structured. 
> 
><![if !vml]><img border=0 width=441 height=635
>src="TPTP_Testing_Strategy_Part2_files/image001.jpg" v:shapes="_x0000_i1025"><![endif]> 
>Figure 1: The structure of the 'gui' folder of
>org.eclipse.tptp.monitoring.tests 
>
>style='mso-bidi-font-weight:normal'>3.0 Test
>Execution Best Practices<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>style='mso-tab-count:1'>               normal'>3.1 Smoke Testing<o:p></o:p>
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l8 level1 lfo23;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>1.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Smoke testing, or patch/maintenance release testing,
>refers to partial regression test for testing the majority of the functionality
>in less time than a full test pass.
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l8 level1 lfo23;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>2.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Smoke test suites should cover: 
>
>margin-left:1.5in;text-indent:-.25in;mso-list:l8 level2 lfo23;tab-stops:list 1.5in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
>mso-fareast-font-family:"Courier New"'>ostyle='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>All major use cases.
>
>margin-left:1.5in;text-indent:-.25in;mso-list:l8 level2 lfo23;tab-stops:list 1.5in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
>mso-fareast-font-family:"Courier New"'>ostyle='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>All major supported platforms.
>
>margin-left:1.5in;text-indent:-.25in;mso-list:l8 level2 lfo23;tab-stops:list 1.5in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
>mso-fareast-font-family:"Courier New"'>ostyle='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>All major supported JREs.
>
>margin-left:1.5in;text-indent:-.25in;mso-list:l8 level2 lfo23;tab-stops:list 1.5in'><![if !supportLists]>style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
>mso-fareast-font-family:"Courier New"'>ostyle='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>All automated test suites (for example, JUnit,
>JUnit Plug-in, and AGR test suites).
>
>margin-left:1.0in;text-indent:-.25in;mso-list:l8 level1 lfo23;tab-stops:list 1.0in'><![if !supportLists]>style='mso-list:Ignore'>3.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
><![endif]>Smoke test suites should reference the test suite(s)
>and/or test case(s) for the plug-in or component to avoid redundancy.
>
>style='mso-bidi-font-weight:normal'>4.0 TPTP
>Test Project Exceptions<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>Some
>TPTP tests are not manual, AGR or TPTP JUnit/JUnit Plug-in tests as described
>above.
>
><o:p>&nbsp;</o:p>
>
>style='mso-tab-count:1'>               normal'>4.1 JVMPI Profiler Test Suites<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>style='mso-tab-count:1'>   The JVMTI Profiler tests
>(Platform.Agents.JVMPI.*) are run like regular JUnit tests but require manual
>configuration of the local host and installation and configuration of a test
>server on   the remote host. This is
>documented in test-results/platform/org.eclipse.tptp.ac.testautomation/automation-files/notes/ACTestAutomation.doc
>
><o:p>&nbsp;</o:p>
>
><o:p>&nbsp;</o:p>
>
>style='mso-bidi-font-weight:normal'>5.0 The
>Common Test Infrastructure<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>The
>common test infrastructure is used for build verification test.
>
><o:p>&nbsp;</o:p>
>
>style='mso-tab-count:1'>               normal'>5.1 Reference Platform<o:p></o:p>
>
>style='mso-tab-count:1'>               
>
>style='mso-tab-count:1'>               TPTP will use reference
>platforms. New code will be expected to be tested against the reference
>platform before being committed. 
>
>style='mso-tab-count:1'>               The build verification test will
>run on the reference platform.
>
><o:p>&nbsp;</o:p>
>
>style='mso-tab-count:1'>               The current reference platform
>for TPTP is: IBM Java 1.5 (latest SR) and Windows XP/x86.
>
>style='mso-tab-count:1'>               
>
>style='mso-tab-count:1'>               normal'>5.2 Adding Tests<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>style='mso-tab-count:1'>               The BVT test suites are:
>
>style='mso-tab-count:1'>               org.eclipse.hyades.tests\BVT\AllBVTGUITests.testsuite
>
>style='mso-tab-count:1'>               org.eclipse.hyades.tests\BVT\AllBVTJUnitPluginTests.testsuite
>
>style='mso-tab-count:1'>               org.eclipse.hyades.tests\BVT\AllBVTJUnitTests.testsuite<o:p></o:p>
>
><o:p>&nbsp;</o:p>
>
>style='mso-tab-count:1'>               normal'>5.3 Installing and Executing<o:p></o:p>
>
>style='mso-tab-count:1'>               
>
>style='mso-tab-count:1'>               Please refer to the BVT class=SpellE>Readme at org.eclipse.tptp.platform.releng.tools/testautomation/readme.html
>
><o:p>&nbsp;</o:p>
>
><o:p>&nbsp;</o:p>
>
></div>
>
></body>
>
></html>

<html xmlns:v="urn:schemas-microsoft-com:vml"
xmlns:o="urn:schemas-microsoft-com:office:office"
xmlns:w="urn:schemas-microsoft-com:office:word"
xmlns="http://www.w3.org/TR/REC-html40">

<head>
<meta http-equiv=Content-Type content="text/html; charset=windows-1252">
<meta name=ProgId content=Word.Document>
<meta name=Generator content="Microsoft Word 10">
<meta name=Originator content="Microsoft Word 10">
<link rel=File-List href="TPTP_Testing_Strategy_Part2_files/filelist.xml">
<link rel=Edit-Time-Data href="TPTP_Testing_Strategy_Part2_files/editdata.mso">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]--><!--[if gte mso 9]><xml>
 <o:DocumentProperties>
  <o:Author>chng1me</o:Author>
  <o:LastAuthor>chng1me</o:LastAuthor>
  <o:Revision>53</o:Revision>
  <o:TotalTime>5863</o:TotalTime>
  <o:Created>2007-11-13T03:49:00Z</o:Created>
  <o:LastSaved>2008-05-28T20:16:00Z</o:LastSaved>
  <o:Pages>1</o:Pages>
  <o:Words>3043</o:Words>
  <o:Characters>17346</o:Characters>
  <o:Company>IBM</o:Company>
  <o:Lines>144</o:Lines>
  <o:Paragraphs>40</o:Paragraphs>
  <o:CharactersWithSpaces>20349</o:CharactersWithSpaces>
  <o:Version>10.6817</o:Version>
 </o:DocumentProperties>
</xml><![endif]--><!--[if gte mso 9]><xml>
 <w:WordDocument>
  <w:SpellingState>Clean</w:SpellingState>
  <w:GrammarState>Clean</w:GrammarState>
  <w:Compatibility>
   <w:BreakWrappedTables/>
   <w:SnapToGridInCell/>
   <w:WrapTextWithPunct/>
   <w:UseAsianBreakRules/>
  </w:Compatibility>
  <w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel>
 </w:WordDocument>
</xml><![endif]-->
<style>
<!--
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
	{mso-style-parent:"";
	margin:0in;
	margin-bottom:.0001pt;
	mso-pagination:widow-orphan;
	font-size:12.0pt;
	font-family:"Times New Roman";
	mso-fareast-font-family:"Times New Roman";}
a:link, span.MsoHyperlink
	{color:blue;
	text-decoration:underline;
	text-underline:single;}
a:visited, span.MsoHyperlinkFollowed
	{color:purple;
	text-decoration:underline;
	text-underline:single;}
p
	{mso-margin-top-alt:auto;
	margin-right:0in;
	mso-margin-bottom-alt:auto;
	margin-left:0in;
	mso-pagination:widow-orphan;
	font-size:12.0pt;
	font-family:"Times New Roman";
	mso-fareast-font-family:"Times New Roman";}
pre
	{margin:0in;
	margin-bottom:.0001pt;
	mso-pagination:widow-orphan;
	tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt;
	font-size:10.0pt;
	font-family:"Courier New";
	mso-fareast-font-family:"Times New Roman";}
span.SpellE
	{mso-style-name:"";
	mso-spl-e:yes;}
@page Section1
	{size:8.5in 11.0in;
	margin:1.0in 1.25in 1.0in 1.25in;
	mso-header-margin:.5in;
	mso-footer-margin:.5in;
	mso-paper-source:0;}
div.Section1
	{page:Section1;}
 /* List Definitions */
 @list l0
	{mso-list-id:69547719;
	mso-list-template-ids:1603702024;}
@list l0:level1
	{mso-level-number-format:bullet;
	mso-level-text:\F0B7;
	mso-level-tab-stop:.5in;
	mso-level-number-position:left;
	text-indent:-.25in;
	mso-ansi-font-size:10.0pt;
	font-family:Symbol;}
@list l0:level2
	{mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l1
	{mso-list-id:95909452;
	mso-list-template-ids:1015200972;}
@list l1:level1
	{mso-level-tab-stop:.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l1:level2
	{mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l1:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l1:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l1:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l1:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l1:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l1:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l1:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l2
	{mso-list-id:400375797;
	mso-list-template-ids:-665532790;}
@list l2:level1
	{mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	margin-left:1.0in;
	text-indent:-.25in;}
@list l2:level2
	{mso-level-number-format:bullet;
	mso-level-text:o;
	mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	margin-left:1.5in;
	text-indent:-.25in;
	mso-ansi-font-size:10.0pt;
	font-family:"Courier New";
	mso-bidi-font-family:"Times New Roman";}
@list l2:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l2:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l2:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l2:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l2:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l2:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l2:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l3
	{mso-list-id:541407837;
	mso-list-template-ids:-2012820764;}
@list l3:level1
	{mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	margin-left:1.0in;
	text-indent:-.25in;}
@list l3:level2
	{mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l3:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l3:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l3:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l3:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l3:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l3:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l3:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l4
	{mso-list-id:635180561;
	mso-list-template-ids:-2140629550;}
@list l4:level1
	{mso-level-number-format:bullet;
	mso-level-text:\F0B7;
	mso-level-tab-stop:.5in;
	mso-level-number-position:left;
	text-indent:-.25in;
	mso-ansi-font-size:10.0pt;
	font-family:Symbol;}
@list l4:level2
	{mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l4:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l4:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l4:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l4:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l4:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l4:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l4:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l5
	{mso-list-id:777070646;
	mso-list-template-ids:-1381310410;}
@list l5:level1
	{mso-level-tab-stop:.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l5:level2
	{mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l5:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l5:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l5:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l5:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l5:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l5:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l5:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l6
	{mso-list-id:811412001;
	mso-list-template-ids:-1087204518;}
@list l6:level2
	{mso-level-number-format:bullet;
	mso-level-text:o;
	mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;
	mso-ansi-font-size:10.0pt;
	font-family:"Courier New";
	mso-bidi-font-family:"Times New Roman";}
@list l7
	{mso-list-id:826479773;
	mso-list-template-ids:-245719976;}
@list l7:level2
	{mso-level-number-format:bullet;
	mso-level-text:o;
	mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;
	mso-ansi-font-size:10.0pt;
	font-family:"Courier New";
	mso-bidi-font-family:"Times New Roman";}
@list l8
	{mso-list-id:907809366;
	mso-list-template-ids:983603846;}
@list l8:level1
	{mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	margin-left:1.0in;
	text-indent:-.25in;}
@list l8:level2
	{mso-level-number-format:bullet;
	mso-level-text:o;
	mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	margin-left:1.5in;
	text-indent:-.25in;
	mso-ansi-font-size:10.0pt;
	font-family:"Courier New";
	mso-bidi-font-family:"Times New Roman";}
@list l8:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l8:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l8:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l8:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l8:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l8:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l8:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l9
	{mso-list-id:934485737;
	mso-list-template-ids:-264609040;}
@list l9:level1
	{mso-level-number-format:bullet;
	mso-level-text:\F0B7;
	mso-level-tab-stop:.5in;
	mso-level-number-position:left;
	text-indent:-.25in;
	mso-ansi-font-size:10.0pt;
	font-family:Symbol;}
@list l10
	{mso-list-id:1309091084;
	mso-list-template-ids:-298440764;}
@list l10:level1
	{mso-level-tab-stop:.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l10:level2
	{mso-level-number-format:bullet;
	mso-level-text:o;
	mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;
	mso-ansi-font-size:10.0pt;
	font-family:"Courier New";
	mso-bidi-font-family:"Times New Roman";}
@list l10:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l10:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l10:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l10:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l10:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l10:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l10:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l11
	{mso-list-id:1482844397;
	mso-list-template-ids:1324009144;}
@list l11:level1
	{mso-level-tab-stop:.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l11:level2
	{mso-level-number-format:bullet;
	mso-level-text:o;
	mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;
	mso-ansi-font-size:10.0pt;
	font-family:"Courier New";
	mso-bidi-font-family:"Times New Roman";}
@list l11:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l11:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l11:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l11:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l11:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l11:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l11:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l12
	{mso-list-id:2052873204;
	mso-list-template-ids:-279789122;}
@list l12:level1
	{mso-level-number-format:bullet;
	mso-level-text:\F0B7;
	mso-level-tab-stop:.5in;
	mso-level-number-position:left;
	text-indent:-.25in;
	mso-ansi-font-size:10.0pt;
	font-family:Symbol;}
@list l12:level2
	{mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l12:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l12:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l12:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l12:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l12:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l12:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l12:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
ol
	{margin-bottom:0in;}
ul
	{margin-bottom:0in;}
-->
</style>
<!--[if gte mso 10]>
<style>
 /* Style Definitions */
 table.MsoNormalTable
	{mso-style-name:"Table Normal";
	mso-tstyle-rowband-size:0;
	mso-tstyle-colband-size:0;
	mso-style-noshow:yes;
	mso-style-parent:"";
	mso-padding-alt:0in 5.4pt 0in 5.4pt;
	mso-para-margin:0in;
	mso-para-margin-bottom:.0001pt;
	mso-pagination:widow-orphan;
	font-size:10.0pt;
	font-family:"Times New Roman";}
</style>
<![endif]--><!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext="edit" spidmax="2050"/>
</xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext="edit">
  <o:idmap v:ext="edit" data="1"/>
 </o:shapelayout></xml><![endif]-->
</head>

<body lang=EN-US link=blue vlink=purple style='tab-interval:.5in'>

<div class=Section1>

<p class=MsoNormal align=center style='text-align:center'><b style='mso-bidi-font-weight:
normal'><span style='font-size:14.0pt'>TPTP Testing Strategy Part 2<o:p></o:p></span></b></p>

<p class=MsoNormal align=center style='text-align:center'><b style='mso-bidi-font-weight:
normal'>Test Conventions and Best Practices</b></p>

<p class=MsoNormal><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>1.0
TPTP Test Project Conventions</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>1.1 Naming Conventions</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>1.2 Test Project Detailed Structure</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>2.0
Test Creation Best Practices</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>2.1 Creating Manual Test Suites</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>2.2 Creating JUnit and JUnit
Plug-in Test Suites</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>2.3 Creating AGR Test Suites</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>3.0
Test Execution Best Practices</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>3.1 Smoke Testing</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>4.0
TPTP Test Project Exceptions</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>4.1 JVMPI Profiler Test Suites</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>5.0
The Common Test Infrastructure</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>5.1 Reference Platform</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>5.2 Adding Tests</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>5.3 Installing and Deploying</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><b
style='mso-bidi-font-weight:normal'><span style='font-size:14.0pt'>1.0 TPTP
Test Project Conventions<o:p></o:p></span></b></p>

<p style='margin-left:.25in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><b
style='mso-bidi-font-weight:normal'>1.1 Naming conventions: <o:p></o:p></b></p>

<ol start=1 type=1>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l10 level1 lfo6;tab-stops:list .5in'>All names for testing
     resources and folder names MUST adhere to the following rules: </li>
 <ul type=circle>
  <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
      auto;mso-list:l10 level2 lfo6;tab-stops:list 1.0in'>Upper or lower case
      letter (for example, A-Z or a-z).</li>
  <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
      auto;mso-list:l10 level2 lfo6;tab-stops:list 1.0in'>Digits (for example,
      0 - 9).</li>
  <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
      auto;mso-list:l10 level2 lfo6;tab-stops:list 1.0in'>Underscore (for
      example, _).</li>
 </ul>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l10 level1 lfo6;tab-stops:list .5in'>Names must NOT contain any
     white space characters (for example, tab, space, and new line).</li>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l10 level1 lfo6;tab-stops:list .5in'>Every name should begin with
     an upper or lower case letter (for example, A-Z or a-z). All other
     characters in the name should be upper or lower case letters, digits, or
     the underscore.</li>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l10 level1 lfo6;tab-stops:list .5in'>Java keywords (for example,
     import, if, etc.) cannot be used for names of JUnit test resources.</li>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l10 level1 lfo6;tab-stops:list .5in'>The name of the Deployment
     file (deployment files are often used for remote launch of test suites)
     may contain '.' characters. The name should be meaningful to the project
     and the host that it is associated with. For example, a local deployment
     file for the org.eclipse.hyades.use.cases folder can be
     org.eclipse.hyades.use.cases.localhost.deploy</li>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l10 level1 lfo6;tab-stops:list .5in'>The name and directory
     structure containing the generated execution history file MUST be the same
     as it will be stored in CVS. If the generated execution history file is
     either moved or renamed, the linkage with the associated test suite will
     break thereby corrupting generated reports. In the event of an existing
     execution history in the same directory, TPTP Testing Tools will append a
     millisecond time stamp to the name of the new execution history file.</li>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l10 level1 lfo6;tab-stops:list .5in'>Test suite names must start
     with the bugzilla component name (see <a
     href="https://bugs.eclipse.org/bugs/show_bug.cgi?id=104409">bugzilla
     104409</a>) associated with the plug-in or component under test.</li>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l10 level1 lfo6;tab-stops:list .5in'>Multiple JRE or platform
     test suite names must end with the name, vendor, and version of the JRE or
     platform under test. These test suites should reference the test suite(s)
     and/or test case(s) for the plug-in or component to avoid redundancy.</li>
</ol>

<p class=MsoNormal style='margin-left:.25in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><b
style='mso-bidi-font-weight:normal'>1.2 Test Project Detailed Structure<o:p></o:p></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p style='margin-left:.5in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>The
contents of a test project must follow a defined structure. Table 1 details the
required structure for contents of a test project, for example, <a
href="http://dev.eclipse.org/viewcvs/index.cgi/test-results/platform/org.eclipse.hyades.use.cases/?root=TPTP_Project">test-results/platform/org.eclipse.hyades.use.cases</a>.
</p>

<table class=MsoNormalTable border=1 cellpadding=0 width="100%"
 style='width:100.0%;mso-cellspacing:1.5pt;margin-left:.5in;mso-padding-alt:
 0in 5.4pt 0in 5.4pt'>
 <tr style='mso-yfti-irow:0'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal><b>Name<o:p></o:p></b></p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal><b>Purpose<o:p></o:p></b></p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:1'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>deployment</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all deployment configurations for
  executing the test suites in the test project.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:2'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>gui</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all AGR test suites for the test
  project.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:3'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>gui/AllTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>AGR test suite to execute all lower level AGR test suites
  for the test project. Must be referenced by
  test-results/platform/org.eclipse.hyades.tests/AllGUITests.testsuite (see
  Table 2).</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:4'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>gui/AllSmokeTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>AGR smoke test suite to execute all lower level AGR smoke test
  suites for the test project. Must be referenced by
  test-results/platform/org.eclipse.hyades.tests/AllGUISmokeTests.testsuite
  (see Table 2).</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:5'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>gui_results</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all execution histories for automated
  GUI test suites for the test project.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:6'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>junit_plugin</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all JUnit Plug-in test suites for the
  test project.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:7'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>junit_plugin/AllTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>JUnit Plug-in test suite to execute all lower level JUnit Plug-in
  test suites for the test project. Must be referenced by
  test-results/platform/org.eclipse.hyades.tests/AllJUnitPluginTests.testsuite
  (see Table 2).</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:8'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>junit_plugin/AllSmokeTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>JUnit Plug-in smoke test suite to execute all lower level JUnit
  Plug-in smoke test suites for the test project. Must be referenced by
  test-results/platform/org.eclipse.hyades.tests/AllJUnitPluginSmokeTests.testsuite
  (see Table 2).</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:9'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>junit_plugin_results</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all execution histories for JUnit Plug-in
  test suites for the test project.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:10'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>junit</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all JUnit test suites for the test
  project.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:11'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>junit/AllTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>JUnit test suite to execute all lower level JUnit test suites
  for the test project. Must be referenced by
  test-results/platform/org.eclipse.hyades.tests/AllJUnitTests.testsuite (see
  Table 2).</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:12'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>junit/AllSmokeTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>JUnit smoke test suite to execute all lower level JUnit
  smoke test suites for the test project. Must be referenced by
  test-results/platform/org.eclipse.hyades.tests/AllJUnitSmokeTests.testsuite
  (see Table 2).</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:13'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>junit_results</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all execution histories for JUnit
  test suites for the test project.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:14'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>manual</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all manual test suites for the test
  project.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:15'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>manual/AllTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Manual test suite to execute all lower level manual test
  suites for the test project. Must be referenced by
  test-results/platform/org.eclipse.hyades.tests/AllManualTests.testsuite (see
  Table 2).</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:16'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>manual/AllSmokeTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Manual smoke test suite to execute all lower level manual
  smoke test suites for the test project. Must be referenced by
  test-results/platform/org.eclipse.hyades.tests/AllManualSmokeTests.testsuite
  (see Table 2).</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:17'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>manual_results</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all execution histories for manual
  test suites for the test project.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:18'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>resources</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing any resources required to execute the
  test suites for the test project.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:19;mso-yfti-lastrow:yes'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>src</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing generated JUnit Java source code for
  the JUnit and JUnit Plug-in test suites and Java source code corresponding to
  verification hooks of AGR test suites for the test project.</p>
  </td>
 </tr>
</table>

<p class=MsoNormal style='margin-left:.5in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><b>Table
1: Required structure for contents of a test project.</b> </p>

<p style='margin-left:.5in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>Each
of the subfolders contains a test project named org.eclipse.hyades.use.cases
for testing functionality that crosses plug-in or component boundaries. </p>

<p style='margin-left:.5in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>The
<a
href="http://dev.eclipse.org/viewcvs/index.cgi/test-results/platform/org.eclipse.hyades.tests/?root=TPTP_Project">test-results/platform/org.eclipse.hyades.tests</a>
test project contains all root-level test suites for TPTP. Table 2 details the
required structure for contents of the test-results/platform/org.eclipse.hyades.tests
test project. </p>

<table class=MsoNormalTable border=1 cellpadding=0 width="100%"
 style='width:100.0%;mso-cellspacing:1.5pt;margin-left:.5in;mso-padding-alt:
 0in 5.4pt 0in 5.4pt'>
 <tr style='mso-yfti-irow:0'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal><b>Name<o:p></o:p></b></p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal><b>Purpose<o:p></o:p></b></p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:1'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>deployment</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all deployment configurations for
  executing the root-level test suites in TPTP.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:2'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>enablement</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all the TPTP enablement tests.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:3'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>TVT</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing all the TPTP Translation Verification
  Tests (TVT).</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:4'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>src</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Directory containing generated JUnit Java source code for
  the root-level JUnit and JUnit Plug-in test suites in TPTP and Java source
  code corresponding to verification hooks of root-level AGR test suites in
  TPTP.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:5'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>AllGUITests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Root-level AGR test suite to execute all lower level AGR
  test suites.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:6'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>AllGUISmokeTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Root-level AGR smoke test suite to execute all lower level
  AGR smoke test suites.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:7'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>AllJUnitPluginTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Root-level JUnit Plug-in test suite to execute all lower
  level JUnit Plug-in test suites.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:8'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>AllJUnitPluginSmokeTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Root-level JUnit Plug-in smoke test suite to execute all
  lower level JUnit Plug-in smoke test suites.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:9'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>AllJUnitTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Root-level JUnit test suite to execute all lower level
  JUnit test suites.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:10'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>AllJUnitSmokeTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Root-level JUnit smoke test suite to execute all lower
  level JUnit smoke test suites.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:11'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>AllManualTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Root-level manual test suite to execute all lower level
  manual test suites.</p>
  </td>
 </tr>
 <tr style='mso-yfti-irow:12;mso-yfti-lastrow:yes'>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>AllManualSmokeTests.testsuite</p>
  </td>
  <td style='padding:.75pt .75pt .75pt .75pt'>
  <p class=MsoNormal>Root-level manual smoke test suite to execute all lower
  level manual smoke test suites.</p>
  </td>
 </tr>
</table>

<p class=MsoNormal style='margin-left:.5in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><b>Table
2: Required structure for contents of the
test-results/platform/org.eclipse.hyades.tests test project.<o:p></o:p></b></p>

<p class=MsoNormal style='margin-left:.5in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><b><o:p>&nbsp;</o:p></b></p>

<p style='margin-left:.25in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>The
execution history files (*.execution) generated when executing test suites are
checked-in to the CVS branch for the release under test by the committer for
the associated plug-in or component. For example, the execution history files
generated from testing the current full release would be checked in to HEAD.
Execution history files are checked in to the *_results folder for the type of
test suite. For example, execution history files generated from executing a
manual test suite would be checked in the manual_results folder. To delineate
between test executions on multiple platforms, each *_results folder contains
the following subfolders for each supported platform: </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>AIX</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>AS_400</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>HP_UX</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Linux_390</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Linux_x86</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>OS_390</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Solaris</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Windows</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l12 level1 lfo8;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Linux PPC64</p>

<p style='margin-left:.25in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>Supported
platform subfolders may be optionally appended with the platform version and
release: </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>AIX_5_2_0</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>AS_400_5_2</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>HP_UX_11</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Linux_390_SuSE_ Enterprise_7_0</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Linux_x86_RedHat_Enterprise_2_1</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Linux_x86_SLES_10</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>OS_390_1_6</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Solaris_9</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Windows_2000</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Windows_XP</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Windows_Vista</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:.75in;text-indent:-.25in;mso-list:l0 level1 lfo10;tab-stops:list .75in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:Symbol;
mso-fareast-font-family:Symbol;mso-bidi-font-family:Symbol'><span
style='mso-list:Ignore'>·<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Linux_PPC64</p>

<p style='margin-left:.25in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>Test
execution reports are generated and checked in to CVS by the TPTP Project Lead
or PMC representative at predetermined milestones in a test pass for public web
access. Test execution reports are available at: <a
href="http://www.eclipse.org/tptp/">www.eclipse.org/tptp</a> &gt;&gt;
Development Plans &gt;&gt; Test Pass Reports </p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><b
style='mso-bidi-font-weight:normal'><span style='font-size:14.0pt'>2.0 Test
Creation Best Practices<o:p></o:p></span></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>Based
on the previous experiences of test resource creators and testers, the
following general recommendations will assist testers on creating test cases. Section
2.1 - 2.3 go into more details about best practices for creating manual, JUnit,
JUnit Plug-in, and AGR test suites. </p>

<ol start=1 type=1>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l11 level1 lfo13;tab-stops:list .5in'>A test case should always
     have a specific purpose for testing a scenario. Having many test cases in
     a test suite does not necessarily ensure better quality. Each test case
     must be well thought out and have a specific purpose. Simply testing the
     basic functionality of a tool is often not enough to ensure high quality
     standards. Boundary cases are usually considered to be interesting test
     cases. As an example, consider the case of testing a function that removes
     entries from a table. The following test cases should be considered: </li>
 <ul type=circle>
  <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
      auto;mso-list:l11 level2 lfo13;tab-stops:list 1.0in'>Removing the first
      entry (a boundary case)</li>
  <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
      auto;mso-list:l11 level2 lfo13;tab-stops:list 1.0in'>Removing the second
      entry (tests basic functionality)</li>
  <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:
      auto;mso-list:l11 level2 lfo13;tab-stops:list 1.0in'>Removing the last
      entry (a boundary case)</li>
 </ul>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l11 level1 lfo13;tab-stops:list .5in'>Avoid repeating the same
     set of steps in multiple test cases. If two test cases require the user to
     import a log file, then create three test cases. The first test case will
     only serve as setting the environment for successive test cases and the
     second and third test case will test the specific functionality in mind.</li>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l11 level1 lfo13;tab-stops:list .5in'>This point provides a basic
     summary of the first two: apply the high cohesion principle to test cases.
     Cohesion means assigning specific responsibilities to test cases. A test
     case requiring a user to import a log file, profile an application, and
     use the Probekit has little common in its responsibilities and thus does
     not follow the high cohesion principle.</li>
 <li class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
     mso-list:l11 level1 lfo13;tab-stops:list .5in'>Avoid unnecessarily
     complicating test cases that are designed to test functionality and not
     performance. For example, a test case that uses a class with 3 methods to
     test the Java Profiler is likely as good as a test case that uses a class
     with 10 methods.</li>
</ol>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><b style='mso-bidi-font-weight:
normal'>2.1 Creating Manual Test Suites<o:p></o:p></b></p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l2 level1 lfo15;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>1.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Create small and terse manual test cases that cover
well-defined partitions of functionality. Smaller sized test cases provide
easier units of work for one tester to execute, more realistic reporting
statistics and concise steps to reproduce defects.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l2 level1 lfo15;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>2.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Create manual test suites with sufficient test cases
for one tester to complete in less than an hour. Smaller sized test suites
provide easier units of work dividing test suites between testers while
decreasing the risk of lost execution data.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l2 level1 lfo15;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>3.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>In the event of manual test suites being executed by
multiple testers, have the tester(s) tabulate the execution histories on paper
and the tester with largest assigned test cases will record all the execution
histories in the TPTP Manual Test Client.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l2 level1 lfo15;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>4.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>When structuring the internal organization as the
associated test suite folder (for example, manual), create a summary test suite
for the subfolder (for example,/manual/AllTests.testsuite). The summary test
suite (for example,/manual/AllTests.testsuite) will reference all test suites
within the current folder. This summary test suites is registered with the
root-level manual test suite (for example,
test-results/platform/org.eclipse.hyades.tests/AllManualTests.testsuite),
thereby reducing work when creating and removing plug-in or component test
suites.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l2 level1 lfo15;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>5.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Although the TPTP Manual Test Client permits recording
more than one execution verdict per test case, it is recommended to only record
one execution verdict. Otherwise, TPTP Testing Tools arbitrates the execution
verdicts based on the following precedence rules (decreasing order) which may
cause unintended execution histories: </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.5in;text-indent:-.25in;mso-list:l2 level2 lfo15;tab-stops:list 1.5in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
mso-fareast-font-family:"Courier New"'><span style='mso-list:Ignore'>o<span
style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Error</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.5in;text-indent:-.25in;mso-list:l2 level2 lfo15;tab-stops:list 1.5in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
mso-fareast-font-family:"Courier New"'><span style='mso-list:Ignore'>o<span
style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Fail</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.5in;text-indent:-.25in;mso-list:l2 level2 lfo15;tab-stops:list 1.5in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
mso-fareast-font-family:"Courier New"'><span style='mso-list:Ignore'>o<span
style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Inconclusive</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.5in;text-indent:-.25in;mso-list:l2 level2 lfo15;tab-stops:list 1.5in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
mso-fareast-font-family:"Courier New"'><span style='mso-list:Ignore'>o<span
style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>Pass</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><b style='mso-bidi-font-weight:
normal'>2.2 Creating JUnit and JUnit Plug-in Test Suites<o:p></o:p></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l3 level1 lfo17;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>1.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Create small and terse unit test cases that cover
individual methods or sequence of methods. Smaller sized test cases provide
more realistic reporting statistics and concise steps to reproduce defects.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l3 level1 lfo17;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>2.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>When structuring the internal organization as the
associated test suite folders (for example, junit and junit_plugin), create summary
test suites for each subfolder (for example,/junit/AllTests.testsuite and
/junit_plugin/AllTests.testsuite). The summary test suites (for
example,/junit/AllTests.testsuite and /junit_plugin/AllTests.testsuite) will
reference all test suites within the current folder. These summary test suites
are registered with the root-level JUnit and JUnit Plug-in test suites (for
example, test-results/platform/org.eclipse.hyades.tests/AllJUnitTests.testsuite
and test-results/platform/org.eclipse.hyades.tests/AllJUnitPluginTests.testsuite),
thereby reducing work when creating and removing plug-in or component test
suites.</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><b style='mso-bidi-font-weight:
normal'>2.3 Creating AGR Test Suites<o:p></o:p></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='margin-left:.5in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>   </span>The user is expected to have reviewed the
available user guide document on the AGR before reading the recommendations
below. The user guide is available on the document section linked from TPTP's
web site. </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>1.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Ensure that a recording session is short. Avoid having
a generated macro for a test case that is longer than 100 lines. </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>2.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>As mentioned previously make sure that the set of test
cases included in a test suite don't perform redundant operations. For example,
if two test cases require launching a process, then launch the process once and
use it for each of the test cases that follow. At the same time the test cases
shouldn't be too dependent on the environment setup by previous test cases. A
test case should easily be executable in quick mode without having to run many
test cases that precede it. It becomes difficult to debug a test case when it
is dependent on more than one test case that precedes it. </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>3.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Avoid using absolute paths in a test case. Absolute
paths should be replaced with relative paths using one of the available static
variables (for example, %testsuiteProjectLocation%). Other modifiable fields
that are dependent on the environment that the test suite is launched in (for
example, host name) should be linked to a datapool variable. </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>4.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Use a logger to make it convenient to debug
verification hooks. See test-results/platform/
org.eclipse.hyades.use.cases/src/org.eclipse.hyades.use.cases.auto.common/Logger.java
</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>5.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Comment the test case thoroughly in the description
section of the test case. Include all manual steps that the test case is
performing. </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>6.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>If any resource (such as a datapool) needs to be
modified before the test suite is executed, then include that as part of the
description of the test suite. Any other important information that the tester
should be aware of needs to be included in the description of the test suite. </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>7.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>If a manual test case is automated, then add
'(DEPRECATED - Use &lt;automated test suite name&gt;)' to the beginning of the
description of the manual test case. </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>8.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Avoid position-based recording as much as possible. If
position-based recording must be used for a component, then try to include all
such test cases of the component in a separate test suite. Clearly note the
resolution that the tester should use as part of the description of the test
suite. </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l5 level1 lfo19;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>9.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Verification hooks should verify the value of controls
rather than their logical representation. For example, if a tree item
represents object A, then verify the existence of the tree item by testing that
its text field is the same as the name of object A as opposed to just simply
testing for the existence of object A. </p>

<p class=MsoNormal style='margin-left:.5in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>There
is a recommended structure for the internal content of the 'gui' folder that
committers are encouraged to use when automating existing manual test suites: </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l1 level1 lfo21;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>1.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>The folders that are a direct child of the 'gui' folder
should correspond exactly to the folders that are a direct child of the
'manual' folder. When structuring the internal organization as the associated
test suite folder (for example, gui), create a summary test suite for the
subfolder (for example,/gui/AllTests.testsuite). The summary test suite (for
example,/gui/AllTests.testsuite) will reference all test suites within the
current folder. This summary test suites is registered with the root-level gui
test suite (for example,
test-results/platform/org.eclipse.hyades.tests/AllGUITests.testsuite), thereby
reducing work when creating and removing plug-in or component test suites.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l1 level1 lfo21;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>2.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>The name of the automated gui test suite should
correspond exactly to the name of the manual test suite that is being
automated.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l1 level1 lfo21;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>3.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>A resource directory should be used to contain the
resources required for the verification hooks of a test suite. The name of the
directory should be &lt;test-suite-name&gt;.Resources (For example the resource
directory for the Monitor.UI.LogSets test suite is
Monitor.UI.LogSets.Resources. This directory may contain any number of log
files or any other files that the test suite depends on). If a datapool is
being associated with a test suite, then include the datapool as part of this
directory (see the <a
href="http://www.eclipse.org/tptp/test/documents/userguides/Intro-Auto-GUI.html">user
guide</a> document on the AGR for more details).</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l1 level1 lfo21;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>4.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Use the directory 'Common.Resources' to store resources
that are shared amongst multiple test suites</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l1 level1 lfo21;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>5.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>See figure 1 as an example of how the 'gui' folder can
be structured. <br>
<br>
<!--[if gte vml 1]><v:shapetype id="_x0000_t75" coordsize="21600,21600" o:spt="75"
 o:preferrelative="t" path="m@4@5l@4@11@9@11@9@5xe" filled="f" stroked="f">
 <v:stroke joinstyle="miter"/>
 <v:formulas>
  <v:f eqn="if lineDrawn pixelLineWidth 0"/>
  <v:f eqn="sum @0 1 0"/>
  <v:f eqn="sum 0 0 @1"/>
  <v:f eqn="prod @2 1 2"/>
  <v:f eqn="prod @3 21600 pixelWidth"/>
  <v:f eqn="prod @3 21600 pixelHeight"/>
  <v:f eqn="sum @0 0 1"/>
  <v:f eqn="prod @6 1 2"/>
  <v:f eqn="prod @7 21600 pixelWidth"/>
  <v:f eqn="sum @8 21600 0"/>
  <v:f eqn="prod @7 21600 pixelHeight"/>
  <v:f eqn="sum @10 21600 0"/>
 </v:formulas>
 <v:path o:extrusionok="f" gradientshapeok="t" o:connecttype="rect"/>
 <o:lock v:ext="edit" aspectratio="t"/>
</v:shapetype><v:shape id="_x0000_i1025" type="#_x0000_t75" alt="" style='width:330.75pt;
 height:476.25pt'>
 <v:imagedata src="TPTP_Testing_Strategy_Part2_files/image001.jpg" o:href="http://www.eclipse.org/tptp/home/documents/process/TPTP_Testing_Strategy_files/gui-folder-structure.JPG"/>
</v:shape><![endif]--><![if !vml]><img border=0 width=441 height=635
src="TPTP_Testing_Strategy_Part2_files/image001.jpg" v:shapes="_x0000_i1025"><![endif]><br>
<b>Figure 1: The structure of the 'gui' folder of
org.eclipse.tptp.monitoring.tests </b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><b
style='mso-bidi-font-weight:normal'><span style='font-size:14.0pt'>3.0 Test
Execution Best Practices<o:p></o:p></span></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><b style='mso-bidi-font-weight:
normal'>3.1 Smoke Testing<o:p></o:p></b></p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l8 level1 lfo23;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>1.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Smoke testing, or patch/maintenance release testing,
refers to partial regression test for testing the majority of the functionality
in less time than a full test pass.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l8 level1 lfo23;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>2.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Smoke test suites should cover: </p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.5in;text-indent:-.25in;mso-list:l8 level2 lfo23;tab-stops:list 1.5in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
mso-fareast-font-family:"Courier New"'><span style='mso-list:Ignore'>o<span
style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>All major use cases.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.5in;text-indent:-.25in;mso-list:l8 level2 lfo23;tab-stops:list 1.5in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
mso-fareast-font-family:"Courier New"'><span style='mso-list:Ignore'>o<span
style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>All major supported platforms.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.5in;text-indent:-.25in;mso-list:l8 level2 lfo23;tab-stops:list 1.5in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
mso-fareast-font-family:"Courier New"'><span style='mso-list:Ignore'>o<span
style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>All major supported JREs.</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.5in;text-indent:-.25in;mso-list:l8 level2 lfo23;tab-stops:list 1.5in'><![if !supportLists]><span
style='font-size:10.0pt;mso-bidi-font-size:12.0pt;font-family:"Courier New";
mso-fareast-font-family:"Courier New"'><span style='mso-list:Ignore'>o<span
style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span></span><![endif]>All automated test suites (for example, JUnit,
JUnit Plug-in, and AGR test suites).</p>

<p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;
margin-left:1.0in;text-indent:-.25in;mso-list:l8 level1 lfo23;tab-stops:list 1.0in'><![if !supportLists]><span
style='mso-list:Ignore'>3.<span style='font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></span><![endif]>Smoke test suites should reference the test suite(s)
and/or test case(s) for the plug-in or component to avoid redundancy.</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><b
style='mso-bidi-font-weight:normal'><span style='font-size:14.0pt'>4.0 TPTP
Test Project Exceptions<o:p></o:p></span></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>Some
TPTP tests are not manual, AGR or TPTP JUnit/JUnit Plug-in tests as described
above.</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><b style='mso-bidi-font-weight:
normal'>4.1 JVMPI Profiler Test Suites<o:p></o:p></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='margin-left:.5in;tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>   </span>The JVMTI Profiler tests
(Platform.Agents.JVMPI.*) are run like regular JUnit tests but require manual
configuration of the local host and installation and configuration of a test
server on<span style='mso-spacerun:yes'>   </span>the remote host. This is
documented in test-results/platform/org.eclipse.tptp.ac.testautomation/automation-files/notes/ACTestAutomation.doc</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><b
style='mso-bidi-font-weight:normal'><span style='font-size:14.0pt'>5.0 The
Common Test Infrastructure<o:p></o:p></span></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'>The
common test infrastructure is used for build verification test.</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><b style='mso-bidi-font-weight:
normal'>5.1 Reference Platform<o:p></o:p></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>TPTP will use reference
platforms. New code will be expected to be tested against the reference
platform before being committed. </p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>The build verification test will
run on the reference platform.</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>The current reference platform
for TPTP is: IBM Java 1.5 (latest SR) and Windows XP/x86.</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><b style='mso-bidi-font-weight:
normal'>5.2 Adding Tests<o:p></o:p></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>The BVT test suites are:</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><span class=SpellE>org.eclipse.hyades.tests\BVT\AllBVTGUITests.testsuite</span></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><span class=SpellE>org.eclipse.hyades.tests\BVT\AllBVTJUnitPluginTests.testsuite</span></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><span class=SpellE>org.eclipse.hyades.tests\BVT\AllBVTJUnitTests.testsuite</span><o:p></o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span><b style='mso-bidi-font-weight:
normal'>5.3 Installing and Executing<o:p></o:p></b></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><span
style='mso-tab-count:1'>               </span>Please refer to the BVT <span
class=SpellE>Readme</span> at org.eclipse.tptp.platform.releng.tools/testautomation/readme.html</p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

<p class=MsoNormal style='tab-stops:45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt'><o:p>&nbsp;</o:p></p>

</div>

</body>

</html>

Actions: View

Attachments on bug 211777: 102509 | 102510 | 104770 | 104771 | 105529 | 105532