Comment 1 Frank Becker 2011-10-06 04:15:00 EDT

Here the first part of the changes!

Comment 2 Frank Becker 2011-10-06 04:15:02 EDT

Created attachment 204653 [details]
mylyn/context/zip

Comment 3 Frank Becker 2011-10-06 15:30:51 EDT

Steffen,

I create review http://review.mylyn.org/#change,74, please can you check this before we commit this.

Now every fixture execute all test and I add an System Property mylyn.test.exclude. This is an list of fixture URLs that should not be executed.

Example for do not execute bugs34 and bugshead of instance mylyn.org
http://mylyn.org/Bugzilla/bugs34,http://mylyn.org/Bugzilla/bugshead

Thoughts!

Comment 4 Frank Becker 2011-10-06 15:30:54 EDT

Created attachment 204710 [details]
mylyn/context/zip

Comment 5 Steffen Pingel 2011-10-08 06:42:08 EDT

(In reply to comment #3)
> Steffen,
> 
> I create review http://review.mylyn.org/#change,74, please can you check this
> before we commit this.
> 
> Now every fixture execute all test and I add an System Property
> mylyn.test.exclude. This is an list of fixture URLs that should not be executed.

This look okay to me but I don't fully understand the use case for this. 

> Example for do not execute bugs34 and bugshead of instance mylyn.org
> http://mylyn.org/Bugzilla/bugs34,http://mylyn.org/Bugzilla/bugshead

Why would we not include these tests on mylyn.org? We have setup Bugzilla instances on mylyn.org and we should run tests against these versions or are you suggesting to not run against these if you are in a different environment?

Comment 6 Frank Becker 2011-10-14 07:43:30 EDT

(In reply to comment #5)
> > Example for do not execute bugs34 and bugshead of instance mylyn.org
> > http://mylyn.org/Bugzilla/bugs34,http://mylyn.org/Bugzilla/bugshead
> 
> Why would we not include these tests on mylyn.org? We have setup Bugzilla
> instances on mylyn.org and we should run tests against these versions or are you
> suggesting to not run against these if you are in a different environment?
Sorry, this was an bad example  in my local environment I did not have an Bugzilla 3.4 installed, because 3.4 is near end of life (4.2 has release date November 4, 2011).
On other point is that we now did not have the four 3.6. specific instances that only execute some tests. We now execute all tests so we maybe no longer need all four instances.

The default flag now only execute the Default fixture so if you want get the same result you now should use
-Dorg.eclipse.mylyn.tests.all=true -Dmylyn.test.exclude=http://mylyn.org/bugs34,http://mylyn.org/bugs36,http://mylyn.org/bugs36-custom-wf,http://mylyn.org/bugs36-custom-wf-and-status,http://mylyn.org/bugs36-xml-rpc-disabled,http://mylyn.org/bugshead

Should I commit this this head?

Comment 7 Steffen Pingel 2011-10-14 08:13:22 EDT

Can you update the code review with your latest changes? I still believe we should generalize this mechanism.

Comment 8 Steffen Pingel 2011-10-14 09:35:01 EDT

I have pushed a change review wiht some additional suggestions: http://review.mylyn.org/#change,82

We need to document this at http://wiki.eclipse.org/Mylyn/FAQ#System_Properties before resolving.

Comment 9 Frank Becker 2011-10-14 10:09:30 EDT

I have add documentation for

* mylyn.test.server
* mylyn.test.exclude

if the documentation is OK you can close this bug.

Comment 10 Steffen Pingel 2011-10-14 10:20:01 EDT

Thanks!