Bugzilla – Full Text Bug Listing
| Summary: | Consider separate Hudson instance for Performance tests | ||
|---|---|---|---|
| Product: | Community | Reporter: | Denis Roy <denis.roy> |
| Component: | CI-Jenkins | Assignee: | Thanh Ha <thanh.ha> |
| Status: | RESOLVED FIXED | QA Contact: | |
| Severity: | normal | ||
| Priority: | P2 | CC: | david_williams, denis.roy, john.arthorne, konstantin, matthias.mailaender, webmaster, winston.prakash |
| Version: | unspecified | ||
| Target Milestone: | --- | ||
| Hardware: | PC | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Bug Depends on: | 427908 | ||
| Bug Blocks: | 389857 | ||
|
Description
Denis Roy
Sounds fine by me, if not down right prudent. Some of the performance tests are hanging on the production Hudson instance, whereas they are not hanging in a single-master setup. I'll get going on this. I've set up a performance tests Hudson instance at: https://hudson.eclipse.org/perftests It has 1 executor, 4G RAM and 2 dedicated CPU cores. It is operating on a different physical host than all all the other husdon infra. I've created a job for David: https://hudson.eclipse.org/perftests/job/ep4-perf-lin64/ Anything else we need here? > https://hudson.eclipse.org/perftests
Error 503: access denied :(
It is back to life. That looks pretty convenient with the browsable HTML result pages. May I ask for the Hudson scripts/configuration that run these jobs? It seems you need an account to have a look at them. I could then try to get them working on my own laptop for testing and I also have access to another dedicated machine https://build.vogella.com/ci/ where we may want them setup for comparison. This is part of my https://github.com/Mailaender/Eclipse-Performance-GSoC2014/issues/6 which is about getting them up and running again and documenting it so others can do so themselves. If this instance is setup with Hudson 3.1.2 & Team management, then it would be easy to allow public to view job configuration. http://hudson.eclipse.org/perftests is back online so I guess we are done here. The Hudson version is 3.0.0-RC3 but the old job configuration has been attached to Bug 435045 and everything has been set to be accessible by anonymous users. I will also post and document those scripts during the renovation. Can we get this Hudson instance updated to 3.1.2? See any downside to that, Matthias? Seems we should "start" with the latest ... and, uh, would be easier for me if matched the version I'm using on my personal test machines :/ The build is currently running well on https://build.vogella.com/ci/job/C-MASTER-TESTING-org.eclipse.test.performance/ which is Jenkins version 1.565 so changing the CI environment does not seem to break anything. +1 for a Hudson update. http://hudson.eclipse.org/perftests is down again. As I did not run anything there yet, maybe it is some kind of "shutdown after 48 hours of idleness" setting? > http://hudson.eclipse.org/perftests is down again. As I did not run anything
> there yet, maybe it is some kind of "shutdown after 48 hours of idleness"
> setting?
There's no such thing. I think it's the java process that keeps dying.
Thanh, can you have a look at this?
Hudson is back up. I checked all the logs that I could find but I could not figure out why it crashed... I did notice this version of Hudson is running using a jetty instance rather than how we deploy HIPP instances where we call the hudson.war directly. If we are to upgrade this I think we will need to make some changes so that it doesn't use Jetty and also probably port over the HIPP version of the Hudson init scripts because the current init script seems to be very old. +1 We need this thing to be stable The VM is running on has dedicated CPU resources to make perf tests repeatable. (In reply to Denis Roy from comment #14) > +1 We need this thing to be stable > > The VM is running on has dedicated CPU resources to make perf tests > repeatable. Agreed, and we did want the Hudson version upgraded anyway (comment 9) so just as well do it all at same time, as far as I'm concerned). Alright I'm going to shutdown perftests for a bit while I backup and upgrade Hudson. (In reply to Thanh Ha from comment #16) > Alright I'm going to shutdown perftests for a bit while I backup and upgrade > Hudson. It's backup again this time at Hudson version 3.1.2 (and all plugins updated too) and booting using HIPP init scripts rather than the outdated scripts it was using before. I also had to re-arrange the directories a bit due to it using HIPP scripts. Hudson is now located in the path "/home/hudson/hudsonbuild" rather than /opt/users/hudsonbuild. I left the old location as a backup. Hopefully it works better for you all with the updates. It is running stable at https://hudson.eclipse.org/perftests/job/ep4-perf-lin64/ (In reply to Matthias Mailänder from comment #18) > It is running stable at > https://hudson.eclipse.org/perftests/job/ep4-perf-lin64/ And by "running stable", you mean that the Hudson server is "up and running". It appear there hasn't been a "new job" ran since 2012. (Well, until the failed one I just tried.). Webmasters, is there a place where I can "copy configs" to and from (i.e. what's location and do I have write access? ... and "admin" access? I'd like to get the "test job" up to speed with our "new" way of running tests, and would be easier to copy some configs into place, rather than web-edit them all -- but ... it's only 3 or 4, so, can do the latter if not already set up for access. Mattias, Since you withdrew from the Google of Summer of Code program (for good reason :) I believe you no longer need access and an id on this system, right? Naturally, you'd be welcome to make contributions via patches, etc., and if this becomes your favorite hobby you'd be welcome back as as 'releng' committer ... but, I think without the GSoC assignment, your "rights" should be earned, as it is for other committers. Let me know if I've misunderstood, but otherwise will remove your name from this job soon. I don't think commits or submit requests as seen on http://openbuildservice.org/ are possible on Hudson. Maybe you could create a new empty job on https://hudson.eclipse.org/perftests/ so I don't overwrite the old one when fiddeling around. I would still like to port https://build.vogella.com/ci/job/C-MASTER-TESTING-org.eclipse.test.performance/ to the Eclipse Hudson instance, but I can't promise I find the free time to do so. (In reply to David Williams from comment #19) > Webmasters, is there a place where I can "copy configs" to and from (i.e. > what's location and do I have write access? ... and "admin" access? > No, you will have to web edit them as far as I'm aware but if they are similar jobs you can always edit 1 and create the additional jobs as copies of the original one. From what I can tell you already have full Admin access on the perftests box or are we talking about another server? Are you sure I have full admin access on the whole Hudson instance? https://hudson.eclipse.org/perftests/user/mmailnder/ I can't see the new job nor configuration button. However full access to https://hudson.eclipse.org/perftests/job/ep4-perf-lin64/. (In reply to Matthias Mailänder from comment #22) > Are you sure I have full admin access on the whole Hudson instance? > https://hudson.eclipse.org/perftests/user/mmailnder/ I can't see the new job > nor configuration button. However full access to > https://hudson.eclipse.org/perftests/job/ep4-perf-lin64/. You wouldn't have full admin access, I was responding to David Williams with that comment. (In reply to Matthias Mailänder from comment #20) > Maybe you could create a new empty job on https://hudson.eclipse.org/perftests/ so I don't > overwrite the old one when fiddeling around. I created a copy of the job for you and gave you access. https://hudson.eclipse.org/perftests/job/mmailnder-ep4-perf-lin64/ Closing as fixed as the perftests instance seems to be ticking along fine. -M. |