Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.

Bug 273240

Summary: numerous "unable to unpack" errors when building remotely
Product: Community Reporter: David Williams <david_williams>
Component: Cross-ProjectAssignee: Cross-Project issues <cross-project.inbox>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: P3 CC: oisin.hurley, thomas
Version: unspecified   
Target Milestone: ---   
Hardware: Macintosh   
OS: Mac OS X   
Whiteboard:
Bug Depends on: 273519    
Bug Blocks:    
Attachments:
Description Flags
full log from "east coast" run
none
second log none

Description David Williams CLA 2009-04-22 07:59:26 EDT
Created attachment 132751 [details]
full log from "east coast" run

I'll attach full log, but running from my home machine, (and not disabling use of mirrors), I get numerous errors in the bucky build log. I ran again on build machine (not using mirrors) and got none of these errors. 

Is this a sign of bad content on (some) mirrors? 

Unable to unpack artifact org.eclipse.update.feature,org.eclipse.epp.usagedata.feature,1.0.1.R200809220400
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse,3.1.0.v200902011800-7L5A78wsg8z0FURcLMNfAGPngfQ8
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.core,3.1.0.v200902102200-7a7ADHFC7sRTLSBankBy0
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.dstore,3.1.0.v200902011800-7L4BhEVVFGJFjK8HORO
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.ftp,3.0.100.v200902082200-794AGAkF77e7J8_BSII
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.local,2.1.100.v200812041630-7B48ZBgJ99mAZ9T2741
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.remotecdt,2.2.0.v200902082200-53-8s733L393D5593
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.ssh,3.0.0.v200902011800-7A2BgAkF77g7H9RDTFH
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.telnet,2.2.0.v200902102200-787778BgJ99p9N9cDZJM
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.terminals,1.0.0.v200902020100-77--9uC6FSAG8SBLED3352
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.useractions,1.1.100.v200902102200-31A78s733L37537733
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.b2j.feature,1.0.0.200903191021-2--7733K395K5375
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.bpmn.feature,1.1.0.200903191021-43-7E77g7IAgA7EA
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.im.feature,1.0.1.200903191021-7B--7kMO1Mwa1YMkY
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.policy.feature,1.0.0.200903191021-78--8MGFCMZSDLEYM7
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.sca.feature,1.1.0.200903191021-7H7D287Yb2ZNt2qZ6q
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.sca.feature.frascati,1.1.0.200903191021-53-7E77g7IAgA7EA
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.sca.feature.tuscany,1.1.0.200903191021-42-7A55V5D8V85A8
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.sca.feature.xmleditor,1.1.0.200903191021-21-7733K395K5375
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal,3.0.0.v200902011800-4--7w311A14162241
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal.sdk,3.0.0.v200902082200-7N-FBVC5OpbOz0hOk0qcTNJfHB
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal.serial,2.0.100.v200902011800-3-8Z7w311A13122911
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal.ssh,2.0.100.v200902011800-3-8Z7w311A13122911
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal.telnet,2.0.100.v200902011800-3-8Z7w311A14162241
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal.view,2.0.100.v200902011800-3-8Z7w311A13122911
Unable to unpack artifact osgi.bundle,org.eclipse.net4j.buddies.chat.ui,2.0.0.v200904020311 
Unable to unpack artifact osgi.bundle,org.eclipse.ocl.ecore,1.3.0.v200902010223
Comment 1 David Williams CLA 2009-04-22 23:16:00 EDT
I re-ran on my local home machine (so going through normal mirroring system) and used "updateOnly" and tried 4 different JDKs ... but similar results each time. 

The list is slightly smaller than the original one I posted, but still could not get 25 bundles, from 3 or 4 different projects. Seems kind of odd since, at least with a pure P2 solution, should always go back to eclipse.org, which apparently works ok, since the build succeeds there. 


Unable to unpack artifact org.eclipse.update.feature,org.eclipse.epp.usagedata.feature,1.0.1.R200809220400
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse,3.1.0.v200902011800-7L5A78wsg8z0FURcLMNfAGPngfQ8
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.core,3.1.0.v200902102200-7a7ADHFC7sRTLSBankBy0
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.dstore,3.1.0.v200902011800-7L4BhEVVFGJFjK8HORO
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.ftp,3.0.100.v200902082200-794AGAkF77e7J8_BSII
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.local,2.1.100.v200812041630-7B48ZBgJ99mAZ9T2741
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.remotecdt,2.2.0.v200902082200-53-8s733L393D5593
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.ssh,3.0.0.v200902011800-7A2BgAkF77g7H9RDTFH
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.telnet,2.2.0.v200902102200-787778BgJ99p9N9cDZJM
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.terminals,1.0.0.v200902020100-77--9uC6FSAG8SBLED3352
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.rse.useractions,1.1.100.v200902102200-31A78s733L37537733
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.b2j.feature,1.0.0.200903191021-2--7733K395K5375
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.bpmn.feature,1.1.0.200903191021-43-7E77g7IAgA7EA
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.im.feature,1.0.1.200903191021-7B--7kMO1Mwa1YMkY
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.policy.feature,1.0.0.200903191021-78--8MGFCMZSDLEYM7
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.sca.feature,1.1.0.200903191021-7H7D287Yb2ZNt2qZ6q
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.sca.feature.frascati,1.1.0.200903191021-53-7E77g7IAgA7EA
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.sca.feature.tuscany,1.1.0.200903191021-42-7A55V5D8V85A8
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.stp.sca.feature.xmleditor,1.1.0.200903191021-21-7733K395K5375
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal,3.0.0.v200902011800-4--7w311A14162241
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal.sdk,3.0.0.v200902082200-7N-FBVC5OpbOz0hOk0qcTNJfHB
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal.serial,2.0.100.v200902011800-3-8Z7w311A13122911
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal.ssh,2.0.100.v200902011800-3-8Z7w311A13122911
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal.telnet,2.0.100.v200902011800-3-8Z7w311A14162241
Unable to unpack artifact org.eclipse.update.feature,org.eclipse.tm.terminal.view,2.0.100.v200902011800-3-8Z7w311A13122911
Comment 2 David Williams CLA 2009-04-22 23:19:47 EDT
Created attachment 132872 [details]
second log

This log is from same geographic region, using a different VM (Sun's version 6) and was the last in 10 or so attempts using '-updateOnly'. 

I'm at a loss.
Comment 3 David Williams CLA 2009-04-22 23:21:01 EDT
And, to document it, these results were on windows, using eclipse-SDK-I20090416-1053-win32. 

Comment 4 Thomas Hallgren CLA 2009-04-23 14:04:07 EDT
I just uploaded a new version that probes a bit deeper into the exception info that is passed from P2. Hopefully that will shed some light on what the actual problem is here.
Comment 5 Oisin Hurley CLA 2009-04-23 15:58:00 EDT
A visual inspection suggests that we are at least congruent on the bundles that are giving us grief about unpacking. I'll update the builder app and see if I can get this new information that Thomas mentions.
Comment 6 Thomas Hallgren CLA 2009-04-23 17:50:27 EDT
I found a bug that causes the majority of the unpack problems (see bug 273519). I will add a workaround for it the builder.
Comment 7 Thomas Hallgren CLA 2009-04-23 19:13:56 EDT
Workaround applied and new version uploaded. The Hudson builder is updated and the last run was successful.
Comment 8 Oisin Hurley CLA 2009-04-24 07:03:48 EDT
A funny thing happened on the way to the Galileo Build. I updated my Eclipse install using the Galileo Builder update site and ran a headless build:

54% eclipse -nosplash -application org.eclipse.buckminster.galileo.builder.app -buildRoot    ~/Projects/osstools/galileo/buckbuilder-tryout/build -buildModel ~/Projects/osstools/galileo/workspaces/buckybuild/org.eclipse.galileo.build/galileo.build

And you never guess what happened --

Last login: Wed Jun  4 12:33:02 2008 from 216.105.107.241


				dev.eclipse.org
                              download.eclipse.org                    
 
                                      ***
Please be aware that these servers must be used for purposes approved by the 
Eclipse Management Organization (EMO) and/or an Eclipse Project Management 
Committee (PMC).

Using these servers to establish outbound connections or to open ports on 
remote systems is PROHIBITED. Please contact webmaster@eclipse.org for info. 

Installing and running software applications or services on these servers
must be approved by the webmaster. Please contact webmaster@eclipse.org.
                                      ***

- To access the downloads area, type: cd downloads
- To change your password, please log in to http://portal.eclipse.org/
- Everything you need is in:
  - /home/data/httpd/download.eclipse.org
  - /home/data/httpd/archive.eclipse.org
  - /cvsroot and /svnroot

ohurley@node5:~> 

Huh??

This happens on each run :)

Comment 9 Thomas Hallgren CLA 2009-04-24 07:08:13 EDT
Sorry, I don't understand. Are you saying that the builder causes an ssh login to dev.eclipse.org ?! If so, where did it obtain your password?
Comment 10 David Williams CLA 2009-04-24 07:23:25 EDT
Not that I understand all the steps in interpretation, but I seemed to have had problems using the tilde shorthand such as 
-buildRoot  ~/Projects/osstools/galileo/buckbuilder-tryout/build 
And used full spelled outpath names, instead. 

I'm probably mistaken, just thought I'd mention it. 

Comment 11 Thomas Hallgren CLA 2009-04-24 08:35:11 EDT
(In reply to comment #10)
> Not that I understand all the steps in interpretation, but I seemed to have had
> problems using the tilde shorthand such as 
> -buildRoot  ~/Projects/osstools/galileo/buckbuilder-tryout/build 
> And used full spelled outpath names, instead. 
> 
> I'm probably mistaken, just thought I'd mention it. 
> 
I don't think this is what happens. The MacOS X shell will perform shell expansion on things like the '~' which means that it's expanded before it reaches the app. Windows, with its somewhat brain dead cmd.exe, is another matter. It will only expand the %var% stuff and wildcard expansion and such is left to each program. The builder does not take that into consideration.
Comment 12 Oisin Hurley CLA 2009-04-24 08:37:42 EDT
>Are you saying that the builder causes an ssh login
>to dev.eclipse.org ?! If so, where did it obtain your password?

Yes, that's what has happened. I've a passwordless setup
with ssh and b.e.o - I don't recall doing anything like that
for d.e.o.

> Not that I understand all the steps in interpretation, but I seemed to have had
> problems using the tilde shorthand such as 
> -buildRoot  ~/Projects/osstools/galileo/buckbuilder-tryout/build 

The ~ shorthand should be expanded by the bash shell, but it
turns out it's not relevant, because the same login effect happened
when I used full path names.

It's strange. I'll do a from-scratch download using instructions at

http://wiki.eclipse.org/Buckminster_Galileo_Builder

and see what happens.

Oh - BTW I am running this on a Mac. I'll try it on Windows.
Comment 13 Thomas Hallgren CLA 2009-04-24 08:42:29 EDT
Are you running with the -brandingContribution option? If so, can you try without it just to see if the same thing happens? The only thing I can think of that would attempt to access dev.eclipse.org is the CVS authenticator (although all CVS repos are pserver so that shouldn't really happen either).
Comment 14 Oisin Hurley CLA 2009-04-24 08:48:26 EDT
(In reply to comment #13)
> Are you running with the -brandingContribution option? If so, can you try
> without it just to see if the same thing happens? The only thing I can think of
> that would attempt to access dev.eclipse.org is the CVS authenticator (although
> all CVS repos are pserver so that shouldn't really happen either).

No, I'm just using -buildRoot, -buildModel and -logLevel.

eclipse 
    -nosplash 
    -application org.eclipse.buckminster.galileo.builder.app 
    -buildRoot /Users/ohurley/Projects/osstools/galileo/buckbuilder-tryout/build
    -buildModel /Users/ohurley/Projects/osstools/galileo/workspaces/buckybuild/org.eclipse.galileo.build/galileo.build 
    -logLevel DEBUG

Currently downloading windows integration build to try it on that
platform. Coming down at an awesome 85kB/sec.  I don't have any
ssh setup on this windows box.
Comment 15 Oisin Hurley CLA 2009-04-24 11:47:06 EDT
Just keeping this bug up to date.  The windows version doesn't
exhibit this strange issue.