This Bugzilla instance is deprecated, and most Eclipse projects now use GitHub or Eclipse GitLab. Please see the deprecation plan for details.
Bug 553205 - Mac signing failing: http://172.30.206.146:8282/macosx-signing-service/1.0.1-SNAPSHOT
Summary: Mac signing failing: http://172.30.206.146:8282/macosx-signing-service/1.0.1-...
Status: CLOSED FIXED
Alias: None
Product: CBI
Classification: Technology
Component: signing-service (show other bugs)
Version: unspecified   Edit
Hardware: PC Windows 7
: P3 blocker (vote)
Target Milestone: ---   Edit
Assignee: CBI Inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords:
: 553213 (view as bug list)
Depends on:
Blocks: 551175 553200
  Show dependency tree
 
Reported: 2019-11-19 02:43 EST by Ed Merks CLA
Modified: 2019-11-19 11:28 EST (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ed Merks CLA 2019-11-19 02:43:19 EST
My builds are failing at this step:

Repackaging org.eclipse.oomph.setup.installer.product-macosx.cocoa.x86_64.zip
  Signing Eclipse Installer.app

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0curl: (7) Failed to connect to 172.30.206.146 port 8282: No route to host
Build step 'Execute shell' marked build as failure

I think the host is down or some other routing problem:

> ping 172.30.206.146
PING 172.30.206.146 (172.30.206.146) 56(84) bytes of data.
From 198.41.30.195: icmp_seq=1 Destination Host Unreachable
Comment 1 Lars Vogel CLA 2019-11-19 04:57:22 EST
Platform builds are failing too with Mac signer down
Comment 2 Mikaël Barbero CLA 2019-11-19 05:12:01 EST
*** Bug 553213 has been marked as a duplicate of this bug. ***
Comment 3 Mikaël Barbero CLA 2019-11-19 05:35:38 EST
There has been a mixed up with ip addresses while moving the macOS services to more robust machines. Please update the signerUrl to use IP 172.30.206.145.

Note that we're working on providing more stable URI shortly.
Comment 4 Ed Merks CLA 2019-11-19 05:38:49 EST
Well, that's a complete nightmare. :-(

I suppose this impacts the following as well?

http://172.30.206.146:8383/macos-notarization-service/notarize
Comment 5 Mikaël Barbero CLA 2019-11-19 05:39:49 EST
Indeed.

I may be able to restore the service on the .146 IP, but I may need another 45min.
Comment 6 Ed Merks CLA 2019-11-19 05:44:17 EST
Hunting down and changing these in scripts in Git and in build configurations (not sure there is any) is painful and error prone...

If it could be restored that would be very helpful and is worth the wait.

Thanks.
Comment 7 Mikaël Barbero CLA 2019-11-19 06:26:36 EST
All services are back available from .146. Thanks for your patience.
Comment 8 Dani Megert CLA 2019-11-19 10:36:15 EST
This is NOT fixed. Latest build says:

[ERROR] Failed to execute goal org.eclipse.cbi.maven.plugins:eclipse-macsigner-plugin:1.1.8-SNAPSHOT:sign (default) on project org.eclipse.rt.osgistarterkit.product: [Tue Nov 19 10:28:50 EST 2019] Signing of OS X application '/opt/public/eclipse/builds/4I/gitCache/eclipse.platform.releng.aggregator/eclipse.platform.releng.tychoeclipsebuilder/equinox.starterkit.product/target/products/org.eclipse.rt.osgistarterkit.product/macosx/cocoa/x86_64/Rt.app' failed. Activate debug (-X, --debug) to see why. -> [Help 1]


We have M3 this week and are currently blocked by this!
Comment 9 Mikaël Barbero CLA 2019-11-19 10:37:11 EST
Dani, please add some links to failing builds. Thanks.
Comment 12 Mikaël Barbero CLA 2019-11-19 10:55:31 EST
The signing service is fixed (I just double checked), but the timestamp authority from Apple is actually failing:

10:27:34 Caused by: java.io.IOException: The 'codesign' command on 'Rt.app' exited with value '1'
10:27:34 'codesign' command output:
10:27:34 /usr/local/webservice/eclipse.org/signing/tmp/Codesigner-7938502760962846198/Rt.app: replacing existing signature
10:27:34 /usr/local/webservice/eclipse.org/signing/tmp/Codesigner-7938502760962846198/Rt.app: A timestamp was expected but was not found.

There is not much we can do. It happens from time to time and usually it resolves within 1 hour. We've tried to report this issue in the past to Apple, but it always stayed unanswered. 

I'm running a signing test job every couple of minutes and will keep you posted once the service is back to normal.
Comment 13 Mikaël Barbero CLA 2019-11-19 11:28:45 EST
Service has been stable for the last 15/20 min. Feel free to reopen if you still face issues.