Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 359976

Summary: support excluding fixtures from Bugzilla test suite
Product: z_Archived Reporter: Frank Becker <eclipse>
Component: MylynAssignee: Frank Becker <eclipse>
Status: RESOLVED FIXED QA Contact: Frank Becker <eclipse>
Severity: enhancement    
Priority: P3 CC: steffen.pingel
Version: unspecified   
Target Milestone: 3.7   
Hardware: Macintosh   
OS: Mac OS X   
Whiteboard:
Attachments:
Description Flags
mylyn/context/zip
none
mylyn/context/zip none

Description Frank Becker CLA 2011-10-05 09:03:08 EDT
During the setup of my new local Sever i found some small places that we should change
Comment 1 Frank Becker CLA 2011-10-06 04:15:00 EDT
Here the first part of the changes!
Comment 2 Frank Becker CLA 2011-10-06 04:15:02 EDT
Created attachment 204653 [details]
mylyn/context/zip
Comment 3 Frank Becker CLA 2011-10-06 15:30:51 EDT
Steffen,

I create review http://review.mylyn.org/#change,74, please can you check this before we commit this.

Now every fixture execute all test and I add an System Property mylyn.test.exclude. This is an list of fixture URLs that should not be executed.

Example for do not execute bugs34 and bugshead of instance mylyn.org
http://mylyn.org/Bugzilla/bugs34,http://mylyn.org/Bugzilla/bugshead

Thoughts!
Comment 4 Frank Becker CLA 2011-10-06 15:30:54 EDT
Created attachment 204710 [details]
mylyn/context/zip
Comment 5 Steffen Pingel CLA 2011-10-08 06:42:08 EDT
(In reply to comment #3)
> Steffen,
> 
> I create review http://review.mylyn.org/#change,74, please can you check this
> before we commit this.
> 
> Now every fixture execute all test and I add an System Property
> mylyn.test.exclude. This is an list of fixture URLs that should not be executed.

This look okay to me but I don't fully understand the use case for this. 

> Example for do not execute bugs34 and bugshead of instance mylyn.org
> http://mylyn.org/Bugzilla/bugs34,http://mylyn.org/Bugzilla/bugshead

Why would we not include these tests on mylyn.org? We have setup Bugzilla instances on mylyn.org and we should run tests against these versions or are you suggesting to not run against these if you are in a different environment?
Comment 6 Frank Becker CLA 2011-10-14 07:43:30 EDT
(In reply to comment #5)
> > Example for do not execute bugs34 and bugshead of instance mylyn.org
> > http://mylyn.org/Bugzilla/bugs34,http://mylyn.org/Bugzilla/bugshead
> 
> Why would we not include these tests on mylyn.org? We have setup Bugzilla
> instances on mylyn.org and we should run tests against these versions or are you
> suggesting to not run against these if you are in a different environment?
Sorry, this was an bad example  in my local environment I did not have an Bugzilla 3.4 installed, because 3.4 is near end of life (4.2 has release date November 4, 2011).
On other point is that we now did not have the four 3.6. specific instances that only execute some tests. We now execute all tests so we maybe no longer need all four instances.

The default flag now only execute the Default fixture so if you want get the same result you now should use
-Dorg.eclipse.mylyn.tests.all=true -Dmylyn.test.exclude=http://mylyn.org/bugs34,http://mylyn.org/bugs36,http://mylyn.org/bugs36-custom-wf,http://mylyn.org/bugs36-custom-wf-and-status,http://mylyn.org/bugs36-xml-rpc-disabled,http://mylyn.org/bugshead

Should I commit this this head?
Comment 7 Steffen Pingel CLA 2011-10-14 08:13:22 EDT
Can you update the code review with your latest changes? I still believe we should generalize this mechanism.
Comment 8 Steffen Pingel CLA 2011-10-14 09:35:01 EDT
I have pushed a change review wiht some additional suggestions: http://review.mylyn.org/#change,82

We need to document this at http://wiki.eclipse.org/Mylyn/FAQ#System_Properties before resolving.
Comment 9 Frank Becker CLA 2011-10-14 10:09:30 EDT
I have add documentation for

* mylyn.test.server
* mylyn.test.exclude

if the documentation is OK you can close this bug.
Comment 10 Steffen Pingel CLA 2011-10-14 10:20:01 EDT
Thanks!