Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 574462 - git.eclipse.org snapshot zips corrupted
Summary: git.eclipse.org snapshot zips corrupted
Status: RESOLVED FIXED
Alias: None
Product: Community
Classification: Eclipse Foundation
Component: Git (show other bugs)
Version: unspecified   Edit
Hardware: All All
: P3 blocker (vote)
Target Milestone: ---   Edit
Assignee: Eclipse Webmaster CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks: 574521 574527
  Show dependency tree
 
Reported: 2021-06-25 07:25 EDT by Kit Lo CLA
Modified: 2021-07-01 01:32 EDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Kit Lo CLA 2021-06-25 07:25:22 EDT
Many of the git.eclipse.org snapshot zips are corrupted. Received message saying the zips are not valid archives when zips are downloaded and opened. Here are just a few example links for DataTools, EMF, and Eclipse:

https://git.eclipse.org/c/datatools/org.eclipse.datatools.git/snapshot/org.eclipse.datatools-1.14.100.201805031905.zip

https://git.eclipse.org/c/emf/org.eclipse.emf.git/snapshot/org.eclipse.emf-R2_26_0.zip

https://git.eclipse.org/c/equinox/rt.equinox.bundles.git/snapshot/rt.equinox.bundles-R4_20.zip
https://git.eclipse.org/c/equinox/rt.equinox.framework.git/snapshot/rt.equinox.framework-R4_20.zip
https://git.eclipse.org/c/equinox/rt.equinox.p2.git/snapshot/rt.equinox.p2-R4_20.zip
https://git.eclipse.org/c/jdt/eclipse.jdt.core.git/snapshot/eclipse.jdt.core-R4_20.zip
https://git.eclipse.org/c/jdt/eclipse.jdt.debug.git/snapshot/eclipse.jdt.debug-R4_20.zip
https://git.eclipse.org/c/jdt/eclipse.jdt.git/snapshot/eclipse.jdt-R4_20.zip
https://git.eclipse.org/c/jdt/eclipse.jdt.ui.git/snapshot/eclipse.jdt.ui-R4_20.zip
https://git.eclipse.org/c/pde/eclipse.pde.build.git/snapshot/eclipse.pde.build-R4_20.zip
https://git.eclipse.org/c/pde/eclipse.pde.ui.git/snapshot/eclipse.pde.ui-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.common.git/snapshot/eclipse.platform.common-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.debug.git/snapshot/eclipse.platform.debug-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.git/snapshot/eclipse.platform-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.resources.git/snapshot/eclipse.platform.resources-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.runtime.git/snapshot/eclipse.platform.runtime-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.swt.git/snapshot/eclipse.platform.swt-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.team.git/snapshot/eclipse.platform.team-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.text.git/snapshot/eclipse.platform.text-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.ua.git/snapshot/eclipse.platform.ua-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.ui.git/snapshot/eclipse.platform.ui-R4_20.zip
https://git.eclipse.org/c/platform/eclipse.platform.ui.tools.git/snapshot/eclipse.platform.ui.tools-R4_20.zip
Comment 1 Kit Lo CLA 2021-06-26 10:37:05 EDT
The Babel project downloads source zips for different Eclipse projects to extract translatable files for translation. The Babel database is currently broken and blocked because these git.eclipse.org snapshot zips are corrupted. Please investigate.
Comment 2 Jakub Mazanek CLA 2021-06-28 11:50:45 EDT
Hello Kit,

Can you please retry?
If the issue persists, can you please copy paste an exact error message?

Thanks
Comment 3 Kit Lo CLA 2021-06-28 12:57:42 EDT
I still have the same problem. Here are the commands I tried:

wget -O rt.equinox.bundles-R4_20.zip https://git.eclipse.org/c/equinox/rt.equinox.bundles.git/snapshot/rt.equinox.bundles-R4_20.zip
unzip rt.equinox.bundles-R4_20.zip

Here is the error message:

Archive:  rt.equinox.bundles-R4_20.zip
  End-of-central-directory signature not found.  Either this file is not
  a zipfile, or it constitutes one disk of a multi-part archive.  In the
  latter case the central directory and zipfile comment will be found on
  the last disk(s) of this archive.
unzip:  cannot find zipfile directory in one of rt.equinox.bundles-R4_20.zip or
        rt.equinox.bundles-R4_20.zip.zip, and cannot find rt.equinox.bundles-R4_20.zip.ZIP, period.
Comment 4 Denis Roy CLA 2021-06-28 17:27:53 EDT
We are still looking into this.
Comment 5 Sravan Kumar Lakkimsetti CLA 2021-06-29 06:58:13 EDT
I see that only 64KB of the file is getting downloaded. Is there a limit imposed by cgit?
Comment 6 Matthias Sohn CLA 2021-06-29 10:21:57 EDT
You can also download content of a version using Gerrit's gitiles plugin:

curl -O https://git.eclipse.org/r/plugins/gitiles/equinox/rt.equinox.bundles/+archive/R4_20.tar.gz

In the gitiles UI there is a link to download the selected version/folder.
For this version of rt.equinox.bundles that's the [tgz] link on this page:

https://git.eclipse.org/r/plugins/gitiles/equinox/rt.equinox.bundles/+/refs/tags/R4_20
Comment 8 Denis Roy CLA 2021-06-29 11:35:33 EDT
(In reply to Sravan Kumar Lakkimsetti from comment #5)
> I see that only 64KB of the file is getting downloaded. Is there a limit
> imposed by cgit?

We're seeing that as well, and not only with snapshots. The cgit home page is also 64K. We're trying to trace to where that limit is.


(In reply to Matthias Sohn from comment #6)
> You can also download content of a version using Gerrit's gitiles plugin:
> 
> curl -O
> https://git.eclipse.org/r/plugins/gitiles/equinox/rt.equinox.bundles/
> +archive/R4_20.tar.gz

That's a great workaround, and likely more robust than cgit's.
Comment 9 Denis Roy CLA 2021-06-29 14:23:17 EDT
I've implemented a workaround to make cgit function again. Please try now.
Comment 10 Kit Lo CLA 2021-06-29 14:56:43 EDT
I was implementing a workaround in Babel using Gerrit's gitiles, but Denis beat me! Thanks, Denis! Babel's issue is resolve and is back to normal.