Bugzilla – Full Text Bug Listing
| Summary: | investigating existing queuing software to load balance builds and or tests across multiple machines | ||
|---|---|---|---|
| Product: | z_Archived | Reporter: | Kim Moir <kim.moir> |
| Component: | Dash Athena | Assignee: | Common Build Inbox <dash.commonbuilder-inbox> |
| Status: | RESOLVED FIXED | QA Contact: | |
| Severity: | enhancement | ||
| Priority: | P3 | CC: | d_a_carver, wayne.beaton |
| Version: | unspecified | ||
| Target Milestone: | --- | ||
| Hardware: | PC | ||
| OS: | Windows XP | ||
| Whiteboard: | |||
| Bug Depends on: | |||
| Bug Blocks: | 251933 | ||
|
Description
Kim Moir
I wonder if we could get some in the user community to provide some additional Slave/Swarms for the main build server. This would effectively allow more builds to run, at little cost to the foundation. Just takes some hardware from eclipse members. (In reply to comment #0) >Also, would be useful to nice different builds > based on the priority of the build. I.e. I-build has greater priority than an > N-build. Kim, might want to investigate the Locks and Latches plugin for hudson. Apparently allows you keep builds from running in parallel. So you might be able to do some control using that plugin. I don't think that Hudson is really that busy right now. https://build.eclipse.org/hudson/load-statistics?type=hour Note: The statistics also looked like this before the history was erased last week. However, having more hardware to support the future expansion would be great. It would also be good to have more machines to run tests on. For instance, linux, mac, windows etc. Hudson has an EC2 plugin that supports provisioning in the cloud but Amazon doesn't support Windows or Mac desktops, so these platforms have to be run on VMWare or similar which isn't ideal for testing platform specific issues. One thing to keep in mind is that not everybody is currently using Hudson. Like WTP still uses CruiseControl, and various other projects use other ways to build. Most are using build.eclipse.org for the machine, so what would be interesting is some stats from the webmasters about the ovarall load of the build.eclipse.org. One of the things that I think we as a community should do is encourage projects to migrate their builds to Hudson managed builds. This would start to give us a good oversight into what the actual build load is like, at any one time. Right now it's just a quarter of the projects using Hudson. > stats from the webmasters about the ovarall load of the > build.eclipse.org. If you're logged into the Portal, go to: https://dev.eclipse.org/committers/help/status.php Then click on the link for build in the Server Load Average section. I think we can reasonably assert that Hudson is the winner here (though, I'm not sure if we've strictly met the priority aspect from comment 0). If I've made an error in judgement, please reopen and re-categorize this bug ("Dash Athena" is going to be removed as part of the Termination/Archive of Athena). |