Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 172064

Summary: Automate the Stand-alone GLA testsuites
Product: z_Archived Reporter: Dave Smith <smith>
Component: TPTP.monitoringAssignee: Dave Smith <smith>
Status: CLOSED FIXED QA Contact:
Severity: major    
Priority: P1 CC: rohit.shetty
Version: unspecifiedKeywords: plan
Target Milestone: ---   
Hardware: PC   
OS: Windows 2000   
Whiteboard: closed460
Attachments:
Description Flags
Code\Benchmar files\Artifact file\resources
none
patch for org.eclipse.tptp.monitoring.auto.tests.util
none
User Guide update none

Description Dave Smith CLA 2007-01-29 16:07:51 EST
Some of the Stand-alone GLA testsuites are not automated.  They should be automated if possible.  The following testsuites in monitor/org.eclipse.tptp.monitoring.test/manual/AllTests.testsuite are
candidates for automation:

Monitor.Analysis.StandaloneGLA.*
Monitor.Analysis.StandaloneGLA_Windows_*_Event_Logs
Monitor.Execution
Comment 1 Dave Smith CLA 2007-01-29 16:08:52 EST
Given the focus on test automation in 4.4, increasing the priority.
Comment 2 Dave Smith CLA 2007-02-06 02:40:16 EST
Targetting to complete in i2.
Comment 3 Rohit Shetty CLA 2007-02-27 07:28:16 EST
Dave,
For the Monitor.Execution test suite automation there would still be quite a few manual steps .i.e. setting up the logging agent part of it ....

What can be automated is the LTA profiling operations through the Auto GUI recorder .... Do you agree?

Comment 4 Rohit Shetty CLA 2007-03-10 08:44:42 EST
There seems to be a problem with the Windows adapters test cases. These test cases never execute the adapter .i.e. the batch files are never invoked ... Will be using this defect to fix this problem too.
Comment 5 Rohit Shetty CLA 2007-03-10 08:50:05 EST
Plan for this defect as discussed with Dave:

Monitor.Analysis.StandaloneGLA_Windows_*_Event_Logs - Develop a parser to parse the CSV format that can be exported from the viewer and use the CBE's generated from these to perform validation of the CBE's from our parsers.

Monitor.Analysis.StandaloneGLA.* - Attempt automation of the GLA Install and validation using the existing jUnit tests. Also try to reuse of this install of the GLA for performing the Log parser tests.

Monitor.Execution - No Action, As discussed with Dave it is not worthwhile doing just GUI automation for this test case alone.
Comment 6 Rohit Shetty CLA 2007-03-10 08:54:23 EST
While Automating the Windows parser tests i found two problems:
1) see bugzilla 176476
2)https://bugs.eclipse.org/bugs/show_bug.cgi?id=172064#c4
Comment 7 Rohit Shetty CLA 2007-03-22 15:20:44 EDT
Created attachment 61727 [details]
Code\Benchmar files\Artifact file\resources

The Zip file contains:
1) Source Code
2) Test Suites
3) Artifact Files
4) Benchmark files
5) New folders (ZipFiles in resources)
Comment 8 Rohit Shetty CLA 2007-03-22 15:23:01 EDT
Created attachment 61729 [details]
patch for org.eclipse.tptp.monitoring.auto.tests.util

Patch for org.eclipse.tptp.monitoring.auto.tests.util code updates.
Comment 9 Rohit Shetty CLA 2007-03-22 15:25:00 EDT
Created attachment 61731 [details]
User Guide update

Updated User Guide org.eclipse.tptp.monitoring.auto.tests.util\AutomatedGLAUserGuide.doc
Comment 10 Dave Smith CLA 2007-03-27 18:53:29 EDT
I committed Rohit's patches and changes.  However, I added a fix to org.eclipse.tptp.monitoring.auto.tests.utils.WindowsLogParser to accomodate parsing Windows event logs in CSV format that have time and data values with single digits (eg. 3/3/2007).  I change the regular expression for matching the start of the record in getLogRecord to 

"\\d{1,2}/\\d{1,2}/\\d{4},\\d{1,2}:\\d{1,2}:\\d{1,2}[^,]*,[^,]*,[^,]*,[^,]*,[^,]*,.*"
Comment 11 Paul Slauenwhite CLA 2009-06-30 09:50:47 EDT
As of TPTP 4.6.0, TPTP is in maintenance mode and focusing on improving quality by resolving relevant enhancements/defects and increasing test coverage through test creation, automation, Build Verification Tests (BVTs), and expanded run-time execution. As part of the TPTP Bugzilla housecleaning process (see http://wiki.eclipse.org/Bugzilla_Housecleaning_Processes), this enhancement/defect is verified/closed by the Project Lead since this originator of this enhancement/defect has an inactive Bugzilla account and considered to be fixed. If this enhancement/defect is still unresolved and reproducible in the latest TPTP release (http://www.eclipse.org/tptp/home/downloads/), please re-open.