Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 501194 - git.eclipse.org seems down
Summary: git.eclipse.org seems down
Status: RESOLVED FIXED
Alias: None
Product: Community
Classification: Eclipse Foundation
Component: Git (show other bugs)
Version: unspecified   Edit
Hardware: PC Mac OS X
: P3 blocker (vote)
Target Milestone: ---   Edit
Assignee: Eclipse Webmaster CLA
QA Contact:
URL:
Whiteboard:
Keywords:
: 501205 (view as bug list)
Depends on:
Blocks:
 
Reported: 2016-09-11 11:18 EDT by Martin Oberhuber CLA
Modified: 2016-09-14 16:51 EDT (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Martin Oberhuber CLA 2016-09-11 11:18:25 EDT
This URL doesn't react -- blocking me since don't get access to the TCF repo:
http://git.eclipse.org/c/tcf/org.eclipse.tcf.agent.git/
Comment 1 Denis Roy CLA 2016-09-12 08:35:21 EDT
cGit is killing us again.  I'll write up some rules today to prevent that.
Comment 2 Denis Roy CLA 2016-09-12 10:12:11 EDT
*** Bug 501205 has been marked as a duplicate of this bug. ***
Comment 3 Denis Roy CLA 2016-09-12 11:55:45 EDT
I've re-enabled the cGit cache.  It has a tendency to break, so I added a cron to clear the cache 2x daily.

cGit can't live without it anymore.
Comment 4 Dani Megert CLA 2016-09-12 12:40:32 EDT
Why are we seeing this now? We did not have issues in the past.
Comment 5 Martin Oberhuber CLA 2016-09-12 14:37:10 EDT
To be clear, I think only cgit (git web access) was down.

Gerrit was up, though it seemed slightly degraded (out of 10 push/pull, I saw 2 timeouts approximately).
Comment 6 Dani Megert CLA 2016-09-13 02:06:47 EDT
(In reply to Martin Oberhuber from comment #5)
> To be clear, I think only cgit (git web access) was down.

No, that is not true. Pull via SSH also failed.
Comment 8 Denis Roy CLA 2016-09-13 10:01:18 EDT
> Why are we seeing this now? We did not have issues in the past.

We've seen it before, in the past months.  When the Oomph installer cannot reach certain files on www.eclipse.org, it pings those files on cGit. It's just too much.

We've re-enabled cGit cache. However, bug 453438 is still problematic.
Comment 9 Dani Megert CLA 2016-09-13 13:15:29 EDT
(In reply to Denis Roy from comment #8)
> > Why are we seeing this now? We did not have issues in the past.
> 
> We've seen it before, in the past months.  When the Oomph installer cannot
> reach certain files on www.eclipse.org, it pings those files on cGit. It's
> just too much.

Can we stop this?
Comment 10 Denis Roy CLA 2016-09-13 13:17:32 EDT
See bug 463967.  It's resolved/fixed but I would suggest it is not.
Comment 11 Ed Merks CLA 2016-09-14 04:19:53 EDT
(In reply to Denis Roy from comment #10)
> See bug 463967.  It's resolved/fixed but I would suggest it is not.

Of course fixes are only fixed in the code with the fix. 

I would suggest that the problem last time was that www.eclipse.org returned 404 (incorrectly) and that it's currently returning 403 incorrectly/inappropriately.  This new problem is not as severe a problem because the code that's out in the wild will use the locally cached version in this case, unlike the 404, which did consult gitc, but will no longer do that ever in new installations and new installers.  But for first time users with older installations or installers that they don't update, the 403 will also lead to gitc usage.
Comment 12 Denis Roy CLA 2016-09-14 15:05:30 EDT
Embarassingly, we had a commit in August to block java clients to specific data types, and this affected old oomph clients. Through the magic of an unintentional merge commit, that code made its way in, which triggered the entire thing.

We've reverted the commit and we've also kept the cgit cache mechanism. This will make cgit much, much more robust when faced with massive amounts of requests.
Comment 13 Ed Merks CLA 2016-09-14 16:51:26 EDT
Yes, I can confirm that the problem is gone!

I found the gitc caching a bit annoying because without the caching the log would immediately show my commit:

http://git.eclipse.org/c/oomph/org.eclipse.oomph.git/log

Previously, with caching, I'd often have to wait for 10 minutes for a link to the commit...