Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 549120

Summary: Move orionhub.org vserver to the Eclipse Foundations cloud provider
Product: [ECD] Orion Reporter: Eclipse Webmaster <webmaster>
Component: OrionHubAssignee: Project Inbox <orion.releng-inbox>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: P3 CC: denis.roy, Michael_Rennie, Silenio_Quarti
Version: unspecified   
Target Milestone: ---   
Hardware: PC   
OS: Linux   
See Also: https://bugs.eclipse.org/bugs/show_bug.cgi?id=515258
Whiteboard:
Bug Depends on:    
Bug Blocks: 549119, 562567    

Description Eclipse Webmaster CLA 2019-07-09 15:24:16 EDT
As part of cleaning up shell access I'd like us to finish moving the remaining project vservers to our cloud provider.

Our usual process is that we provide access to the new host and the project handles the actual move.  Does someone on the Orion team have time to work on this over the summer?

-M.
Comment 1 Michael Rennie CLA 2019-07-10 12:32:04 EDT
(In reply to Eclipse Webmaster from comment #0)
> As part of cleaning up shell access I'd like us to finish moving the
> remaining project vservers to our cloud provider.
> 
> Our usual process is that we provide access to the new host and the project
> handles the actual move.  Does someone on the Orion team have time to work
> on this over the summer?
> 
> -M.

What would be the steps here? Is there some doc somewhere on what would be involved?
Comment 2 Eclipse Webmaster CLA 2019-07-15 11:41:08 EDT
I need to know what size of machine you need, and what ports (aside from 22 and 443) that you need opened.  After that I just need someones ssh public key and I can provision the instance.  We are using Azure, so if you need a specific OS, it needs to be one they support.

Once the new server is spun up, you can login and configure it as you require.  When you're ready you can let me know and we'll update the orionhub DNS records to point at the new machine.

After that we'll hold the old instance for a few weeks and then delete it once you confirm the new system is working.

So I'd like to think this should be relatively pain free for everyone involved.

-M.
Comment 3 Michael Rennie CLA 2019-07-17 10:12:10 EDT
(In reply to Eclipse Webmaster from comment #2)
> I need to know what size of machine you need, and what ports (aside from 22
> and 443) that you need opened.  After that I just need someones ssh public
> key and I can provision the instance.  We are using Azure, so if you need a
> specific OS, it needs to be one they support.
> 
> Once the new server is spun up, you can login and configure it as you
> require.  When you're ready you can let me know and we'll update the
> orionhub DNS records to point at the new machine.
> 
> After that we'll hold the old instance for a few weeks and then delete it
> once you confirm the new system is working.
> 
> So I'd like to think this should be relatively pain free for everyone
> involved.
> 
> -M.

Sounds good, a couple of questions though (to see if we are going to do the move or just get rid of orionhub)
1. what size of disk can we have - our current disk is 500GB and almost full
2. how do we migrate the data from eclipse to Azure
3. can we have an Ubuntu 18 machine (with at a min the same spec as what we have in the foundation)
4. we would need ports 8000 and 9000 open for the hosts - we are actually running two servers currently, orion.eclipse.org and orionhub.org
5. how do we handle the certs for the two hosts in Azure? Currently we have two wildcard certs from the foundation
Comment 4 Eclipse Webmaster CLA 2019-07-18 10:58:02 EDT
> a couple of questions though (to see if we are going to do the
> move or just get rid of orionhub)

For me this is a more important question for the project to answer. If the project isn't getting enough value out of having(and maintaining) the current instance then let's just shut it down.

> 1. what size of disk can we have - our current disk is 500GB and almost full

While outside our our normal sizing for project vservers, I think we can provide at least the same amount of space.

> 2. how do we migrate the data from eclipse to Azure

You could use something like rysnc, but I don't know how your data is actually stored or structured. 

> 3. can we have an Ubuntu 18 machine (with at a min the same spec as what we
> have in the foundation)

While Ubuntu 18 shouldn't be a problem, we would be cutting down on the amount of cpus and ram from what your current vserver has.

> 4. we would need ports 8000 and 9000 open for the hosts - we are actually
> running two servers currently, orion.eclipse.org and orionhub.org

Opening these ports should be possible.

> 5. how do we handle the certs for the two hosts in Azure? Currently we have
> two wildcard certs from the foundation

Per bug 549359 we are going to start moving project vservers into the eclipseprojects.io domain, so that will require projects make use of something like Lets Encrypt for SSL certs.  That will also apply to custom domains that we currently provide SSL certs for, at least once those certificates expire. 

-M.
Comment 5 Denis Roy CLA 2020-04-06 11:26:57 EDT
Can we bring this to the top of the pile? Either we provide a VM on Azure for the project to move orionhub.org or we don't. Either way, we have to take this off our infra by the end of April.
Comment 6 Eclipse Webmaster CLA 2020-06-01 11:59:43 EDT
As it's the 1st of June and there was no movement, I've shutdown the orion vserver and tagged it for deletion.

-M.
Comment 7 Michael Rennie CLA 2020-06-08 12:21:15 EDT
Everything is alive again, and we are ready to change the redirects so that it can all be removed.

How do we change the redirects happening from www.eclipse.org/orion (and other places in our project page / web site)? I recall we used to be able to make edits to the Orion website repo, but ever since it was migrated from https://git.eclipse.org/c/www.eclipse.org/orion to https://github.com/eclipse/orion it seems any changes we make to not propagated back to our site?
Comment 8 Denis Roy CLA 2020-06-08 13:52:33 EDT
(In reply to Michael Rennie from comment #7)
> Everything is alive again, and we are ready to change the redirects so that
> it can all be removed.
> 
> How do we change the redirects happening from www.eclipse.org/orion (and
> other places in our project page / web site)? I recall we used to be able to
> make edits to the Orion website repo, but ever since it was migrated from
> https://git.eclipse.org/c/www.eclipse.org/orion to
> https://github.com/eclipse/orion it seems any changes we make to not
> propagated back to our site?

Typically you'd have a website repo here:
https://git.eclipse.org/c/www.eclipse.org/

But I'm not seeing one. We can add the redirects at the server level if you provide them.

Also, let us know what you want orionhub.org to redirect to, and we'll set that up too.
Comment 9 Silenio Quarti CLA 2020-06-12 12:35:29 EDT
The orion website repo got moved here https://github.com/eclipse/orion, is there a configuration missing?
Comment 10 Denis Roy CLA 2020-06-12 13:29:39 EDT
We don't pull websites from GitHub; only from Eclipse Git.

Matt, can you create an orion repository for their website that would go to www.eclipse.org/orion?

Thanks
Comment 11 Eclipse Webmaster CLA 2020-06-15 12:01:06 EDT
Done, the repo is here: https://git.eclipse.org/r/#/admin/projects/www.eclipse.org/orion .

As with all our website repo, anything pushed to that repo shuld be published to www.eclipse.org/orion within 5 minutes.

-M.
Comment 12 Silenio Quarti CLA 2020-06-22 10:56:53 EDT
(In reply to Eclipse Webmaster from comment #11)
> Done, the repo is here:
> https://git.eclipse.org/r/#/admin/projects/www.eclipse.org/orion .
> 
> As with all our website repo, anything pushed to that repo shuld be
> published to www.eclipse.org/orion within 5 minutes.
> 
> -M.

We tried to make changes to repo, but noting seems to make a difference.  If I curl http://eclipse.org/orion, I still get a redirect to https://orionhub.org/.


---------------
Silenios-MacBook-Pro:clusters_readiness squarti$ curl http://www.eclipse.org/orion -v
*   Trying 198.41.30.198...
* TCP_NODELAY set
* Connected to www.eclipse.org (198.41.30.198) port 80 (#0)
> GET /orion HTTP/1.1
> Host: www.eclipse.org
> User-Agent: curl/7.64.1
> Accept: */*
> 
< HTTP/1.1 302 Found
< Server: nginx
< Date: Mon, 22 Jun 2020 14:53:06 GMT
< Content-Type: text/html; charset=iso-8859-1
< Content-Length: 205
< Connection: keep-alive
< Location: https://orionhub.org/
< Cache-Control: max-age=86400
< Expires: Tue, 23 Jun 2020 14:53:06 GMT
< X-Proxy-Cache: MISS
< 
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>302 Found</title>
</head><body>
<h1>Found</h1>
<p>The document has moved <a href="https://orionhub.org/">here</a>.</p>
</body></html>
* Connection #0 to host www.eclipse.org left intact
* Closing connection 0
--------------------
Comment 13 Denis Roy CLA 2020-06-23 08:21:28 EDT
I need to undo bug 515258.  I've pushed a fix; that should solve the redirection in about 15 minutes.
Comment 14 Silenio Quarti CLA 2020-06-29 14:59:25 EDT
(In reply to Denis Roy from comment #13)
> I need to undo bug 515258.  I've pushed a fix; that should solve the
> redirection in about 15 minutes.

After I pushed a change to the repo, http://eclipse.org/orion redirects to the project page now.  Thank you.

Please could you redirect orionhub.org to https://eclipse.github.io/orion.client/ ?

We would like to keep the VM (and data) running orionhub.org up for 2 weeks in case we need to retrieve data for users.  Is that reasonable?
Comment 15 Denis Roy CLA 2020-06-30 08:27:17 EDT
> Please could you redirect orionhub.org to
> https://eclipse.github.io/orion.client/ ?

I've just set that up; it should work in a few hours, as we've made DNS changes.


> We would like to keep the VM (and data) running orionhub.org up for 2 weeks
> in case we need to retrieve data for users.  Is that reasonable?

Sure, that's reasonable. After that, we'll keep the powered-off server image for about 6 months in case you need anything else.
Comment 16 Eclipse Webmaster CLA 2020-09-01 09:59:00 EDT
I've cleaned up the orion DNS entries, and the vserver has been shutdown and tagged for removal in 6 months.

-M.