This Bugzilla instance is deprecated, and most Eclipse projects now use GitHub or Eclipse GitLab. Please see the deprecation plan for details.
Bug 474328 - [Tests] Enable tests for the Tycho build for all Eclipse platform projects
Summary: [Tests] Enable tests for the Tycho build for all Eclipse platform projects
Status: RESOLVED FIXED
Alias: None
Product: Platform
Classification: Eclipse Project
Component: Releng (show other bugs)
Version: 4.6   Edit
Hardware: All All
: P3 enhancement (vote)
Target Milestone: 4.8 M7   Edit
Assignee: Dani Megert CLA
QA Contact:
URL:
Whiteboard:
Keywords:
: 416904 (view as bug list)
Depends on: 416904 417026 417258 458199 460982 468461 474887 477229 481896 486480
Blocks: 493776
  Show dependency tree
 
Reported: 2015-08-05 09:47 EDT by Lars Vogel CLA
Modified: 2018-06-15 03:28 EDT (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Lars Vogel CLA 2015-08-05 09:47:07 EDT
Master bug for all components to enable their tests during the Tycho build. This will include them into the Gerrit build trigger.
Comment 1 David Williams CLA 2015-08-05 10:51:26 EDT
As I understood the discussion in status meeting, after everyone has a chance to try to implement/fix tests to run during the build, then we will change the default in the parent pom. Not sure if the intent was to change the default for M2, or after M2 for M3. So, let me know. Once that default is changed, components should remove explicit enablement of tests, but some will have to add explicit disablement of tests in their component poms. 

Once that default is changed, I am not sure if during production builds, we should still disable it? (So, we at least get a build, even if a test would fail) or just go ahead and fail whole build, if any test fails? In the past our philosophy has been to "produce a build", in any case, since some teams might be able to "start testing it" even if there is another component that will have to make a fix and re-spin. That's still my preference, but happy to change to "always fail" approach, if there is consensus to do so.
Comment 2 Szymon Ptaszkiewicz CLA 2015-08-05 11:08:07 EDT
(In reply to David Williams from comment #1)
> Once that default is changed, I am not sure if during production builds, we
> should still disable it? (So, we at least get a build, even if a test would
> fail) or just go ahead and fail whole build, if any test fails? In the past
> our philosophy has been to "produce a build", in any case, since some teams
> might be able to "start testing it" even if there is another component that
> will have to make a fix and re-spin. That's still my preference, but happy
> to change to "always fail" approach, if there is consensus to do so.

This can be problematic because we have a few tests across different components that are known to fail randomly for unknown reason and it would be bad to fail the whole build because of such test failure.
Comment 3 Dani Megert CLA 2015-08-05 11:36:14 EDT
(In reply to David Williams from comment #1)
> Once that default is changed, I am not sure if during production builds, we
> should still disable it? (So, we at least get a build, even if a test would
> fail) or just go ahead and fail whole build, if any test fails? In the past
> our philosophy has been to "produce a build", in any case, since some teams
> might be able to "start testing it" even if there is another component that
> will have to make a fix and re-spin. That's still my preference, but happy
> to change to "always fail" approach, if there is consensus to do so.

Well, until we move the official build to Tycho and run our tests, we want to skip the test. Otherwise our build will take double the time.

And I agree that we always want to produce the build despite of any test failures.
Comment 4 David Williams CLA 2015-10-21 10:56:03 EDT
Untargeting for a specific milestone, since not sure which milestone this will be finished in. (But from the number of open "depends on" bugs it doesn't look like M3).
Comment 5 Mickael Istria CLA 2016-01-25 10:15:15 EST
Isn't it a dup of bug 416904 ?
Comment 6 Lars Vogel CLA 2016-01-25 10:27:22 EST
*** Bug 416904 has been marked as a duplicate of this bug. ***
Comment 7 Dani Megert CLA 2016-01-25 12:06:00 EST
*** Bug 416904 has been marked as a duplicate of this bug. ***
Comment 8 Dani Megert CLA 2016-05-01 09:41:24 EDT
Most of the projects have their tests enabled. The remaining ones will be done during 4.7.
Comment 9 Lars Vogel CLA 2018-06-15 03:28:37 EDT
Lets mark this aggregator bug as fixed. AFAIK most tests are now enabled.