Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 321883 - New Hudson can't see outside *.eclipse.org
Summary: New Hudson can't see outside *.eclipse.org
Status: RESOLVED FIXED
Alias: None
Product: Community
Classification: Eclipse Foundation
Component: CI-Jenkins (show other bugs)
Version: unspecified   Edit
Hardware: PC Linux
: P3 normal (vote)
Target Milestone: ---   Edit
Assignee: CI Admin Inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2010-08-05 10:28 EDT by David Carver CLA
Modified: 2010-08-10 14:28 EDT (History)
1 user (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description David Carver CLA 2010-08-05 10:28:01 EDT
Maven based builds and Athena based builds need the ability to access repos outside of eclipse.org.   We went through this same issue when build2 was first brought online.  P2 even will go through and try to download from other mirrors instead of always fetching from download.eclipse.org.

This is causing issues currently with the WTP based builds unless all the artifacts are already there.
Comment 1 David Carver CLA 2010-08-05 10:29:33 EDT
More info:

Downloading: http://repo1.maven.org/maven2/org/sonatype/tycho/tycho-maven-plugin/0.8.0/tycho-maven-plugin-0.8.0.jar
[WARNING] Unable to get artifact org.sonatype.tycho:tycho-maven-plugin:maven-plugin:0.8.0 from repository central (http://repo1.maven.org/maven2): Error transferring file: Connection timed out [ERROR] The build could not read 1 project -> [Help 1] [ERROR] The project org.eclipse.wst.xquery:org.eclipse.wst.xquery_parent:0.7.0-SNAPSHOT (/opt/public/jobs/cbi-wtp-inc-xquery/workspace/sourceediting/development/org.eclipse.wst.xquery.releng/pom.xml) has 1 error [ERROR] Unresolveable build extension: Plugin org.sonatype.tycho:tycho-maven-plugin:0.8.0 or one of its dependencies could not be resolved: Error transferring file: Connection timed out org.sonatype.tycho:tycho-maven-plugin:maven-plugin:0.8.0 from the specified remote repositories: central (http://repo1.maven.org/maven2, releases=true, snapshots=false) -> [Help 2] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException [ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
Comment 2 Eclipse Webmaster CLA 2010-08-05 11:52:19 EDT
The issue here seems to be this build isn't using our proxy.  Does maven have it's own proxy settings?

-M
Comment 3 David Carver CLA 2010-08-05 12:19:51 EDT
(In reply to comment #2)
> The issue here seems to be this build isn't using our proxy.  Does maven have
> it's own proxy settings?
> 
> -M

I can specify it to use a particular proxy port and server, if you let me know what it is.  But on build2 and the original master this isn't necessary.
Comment 4 Eclipse Webmaster CLA 2010-08-05 14:12:17 EDT
Build and Build2 are on a different network from the 'new' Hudson master.  The proxy is: 206.191.52.34 port 9898.

-M.
Comment 5 David Carver CLA 2010-08-05 14:45:15 EDT
Okay, I think you need to create an appropriate entry in the ~/.m2/settings.xml file for the hudson user on each machine then to set the proxy port to be used.

http://maven.apache.org/settings.html#Proxies

I tried from the properties but that didn't seem to work.
Comment 6 Eclipse Webmaster CLA 2010-08-05 15:56:58 EDT
I created the .m2/settings file and that seems to have done the trick.

-M.
Comment 7 David Carver CLA 2010-08-05 16:52:42 EDT
I don't think we can resolve this one just yet.  There still are some issues.

1. Tycho 0.8 - 0.9 don't correctly resolve the proxy.  There is a work around I need to tests.  (One option is using tycho 0.10.0-SNAPSHOT)

2. There still appear to be some timeouts happening during the builds.
Comment 8 David Carver CLA 2010-08-05 17:13:14 EDT
(In reply to comment #7)
> I don't think we can resolve this one just yet.  There still are some issues.
> 
> 1. Tycho 0.8 - 0.9 don't correctly resolve the proxy.  There is a work around I
> need to tests.  (One option is using tycho 0.10.0-SNAPSHOT)
> 
> 2. There still appear to be some timeouts happening during the builds.

Okay, now this can be resolved. In addition to the settings.xml, the following needed to be added to the JVM_OPTS:

-Dhttp.proxyHost=206.191.52.34 -Dhttp.proxyPort=9898

If we could add those settings to the Hudson->Manage Hudson->Configure: GLOBAL Maven OPTS, that should take care of it for Maven 3 builds until tycho 0.10.0 is released.
Comment 9 Eclipse Webmaster CLA 2010-08-06 09:22:46 EDT
I've updated the MAVEN_OPTS.  Can you confirm that fixes the issue?

-M.
Comment 10 David Carver CLA 2010-08-09 12:11:51 EDT
The proxy settings also need to be added to the GLOBAL JVM_OPTS.  Otherwise Ant based builds like Athena that need to access some items from the Internet can't download their dependencies.  This will be critical for the Virgo project as well, since they use Ivy to download dependencies.
Comment 11 Eclipse Webmaster CLA 2010-08-09 13:47:41 EDT
I've added the JVM_OPTS and ANT_OPTS global vars.  Can you confirm that Ant is happy?

-M.
Comment 12 David Carver CLA 2010-08-09 15:52:18 EDT
(In reply to comment #11)
> I've added the JVM_OPTS and ANT_OPTS global vars.  Can you confirm that Ant is
> happy?
> 
> -M.

No, I still had to add this manually to the Job's JVM Opts advanced setting for both Ant and Maven.
Comment 13 Eclipse Webmaster CLA 2010-08-10 10:00:45 EDT
I note the Ant docs suggest setting ANT_ARGS (rather than ANT_OPTS) so I added the ANT_ARGS global and removed the proxy config from the Xquery build and it seems to have built fine.  

David can you confirm?

-M.
Comment 14 David Carver CLA 2010-08-10 14:28:40 EDT
Yes that seems to be working.

Best way to test this in the forture is to click on the Workspace, and the select Wipe Workspace.  This will clear all the cached artifacts, and force the system redownload everything.  Otherwise you get a false positive that this is working.