Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 409030

Summary: Reconfigure mirage8, 9 and 10 as non-virtualized hosts
Product: Community Reporter: Denis Roy <denis.roy>
Component: ServersAssignee: Denis Roy <denis.roy>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: P3 CC: thanh.ha, webmaster
Version: unspecified   
Target Milestone: ---   
Hardware: PC   
OS: Linux   
Whiteboard:
Bug Depends on:    
Bug Blocks: 403843    

Description Denis Roy CLA 2013-05-24 15:11:32 EDT
Three of our servers currently sitting idle in our cabinet are configured as virtual server hosts.  As we plan on moving forward with HIPP, there's no need to add the virtualization overhead.  Let's re-convert them back to bare iron.
Comment 1 Denis Roy CLA 2013-05-29 16:23:39 EDT
I've started on m9, will do m10 then m8 when Matt is done with it.
Comment 2 Denis Roy CLA 2013-05-29 16:26:28 EDT
So far:

- reboot with non-xen kernel
- copy hosts from build
- connect to ldap
- mount same FS's as build
- install git, run updates, install other tools needed for building


Thanh, let's talk about a concrete plan for starting HIPP.  I'll likely be deploying the private TCK hudsons this way.
Comment 3 Denis Roy CLA 2013-06-06 14:12:47 EDT
I've setup hipp1.eclipse.org ~ hipp9.eclipse.org in our internal DNS.  I'll just run some quick validations that hipp1 is configured comparatively to hudson master, then I'll image it to mirage10.

Let's keep mirage8 as-is (virtual host) since we'll eventually need more vservers for other things.
Comment 4 Thanh Ha CLA 2013-07-04 10:32:16 EDT
I'd like to start deploying HIPP instances sometime this month. Using the Hudson image we have. I was thinking of provisioning about 2 or so projects at a time to start and seeing if there's any tweaks we should do to the image before deploying more rapidly.

I guess at this point when will these servers be ready for the first few instances?

Also will they be sharing a mounted /home/hudson fs-file like the forges?
Comment 5 Denis Roy CLA 2013-07-04 11:47:05 EDT
> I guess at this point when will these servers be ready for the first few
> instances?

hipp1.eclipse.org should already be set up.  I'd just need to validate that it contains everything needed to run a hipp instance, then I'll clone it to hipp2.

Both of these are (or will be) bare iron boxes that we'll use to run java on them.  No virtualization.  Each has 64G of RAM as a starting point.

> Also will they be sharing a mounted /home/hudson fs-file like the forges?

I don't know.  We definitely want the Hudson app to be running on the NFS-mounted home directory of each hipp user account.  The workspace could use the local drive array, however.  But if we decide to move a hipp instance to a new server, that workspace would obviously not follow (or, we'd have to incorporate some rsync mechanism).
Comment 6 Denis Roy CLA 2013-07-05 13:44:39 EDT
Thanh, 

Go ahead and use hipp1.eclipse.org to deploy the first HIPP instance at Eclipse.org.  When creating the Hudson user for the project, please make sure that user's $HOME directory is in /opt/public/hipp/homes/$uid

That's an NFS mount on Wilma.


> Also will they be sharing a mounted /home/hudson fs-file like the forges?

/home/hudson is a directory on the local disk. I guess the hipp instance startup script should check for the presence of a workspace directory and create one if needed?
Comment 7 Thanh Ha CLA 2013-07-05 14:19:47 EDT
(In reply to comment #6)
> Go ahead and use hipp1.eclipse.org to deploy the first HIPP instance at
> Eclipse.org.  When creating the Hudson user for the project, please make
> sure that user's $HOME directory is in /opt/public/hipp/homes/$uid

Just to be clear, unix user's $HOME will be /opt/public/hipp/homes/$uid but $HUDSON_HOME will still be /home/hudson/$project ?


> > Also will they be sharing a mounted /home/hudson fs-file like the forges?
> 
> /home/hudson is a directory on the local disk. I guess the hipp instance
> startup script should check for the presence of a workspace directory and
> create one if needed?

I usually create this manually and copy the hudson.war file here but that's a good point. We could definitely improve the script to auto create the directory and copy the relevant files. I will look into this next week.

I also just got another idea based on this, I think I will create a /home/hudson/war directory where I will place all the different Hudson version wars here and have the script create symlinks. This way we don't have duplicate war files and each HIPP instance can still run on different wars.
Comment 8 Denis Roy CLA 2013-07-16 14:10:27 EDT
m9 is reconfigured as hipp1.  m10 will become hipp2 with the help of puppet.  I'll open a second bug to track that effort.
Comment 9 Denis Roy CLA 2013-07-16 14:14:18 EDT
Bug 413100.