| Summary: | aggregator fails silently, in some cases | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [Technology] CBI | Reporter: | David Williams <david_williams> | ||||
| Component: | CBI p2 Repository Aggregator | Assignee: | CBI Inbox <cbi-inbox> | ||||
| Status: | RESOLVED WORKSFORME | QA Contact: | David Williams <david_williams> | ||||
| Severity: | normal | ||||||
| Priority: | P3 | CC: | Ed.Merks, filip.hrbek, stephan.herrmann | ||||
| Version: | unspecified | ||||||
| Target Milestone: | --- | ||||||
| Hardware: | PC | ||||||
| OS: | Windows 7 | ||||||
| Whiteboard: | |||||||
| Attachments: |
|
||||||
|
Description
David Williams
I doubt that the version="" pattern caused any problems. This one is translated as a version range of "0.0.0" which means "any version" and the planner chooses the latest version that is compatible with all other requirements in the provisioning plan. We discovered a different problem in the aggregator. If p2 metadata describes an artifact that is finally missing in the artifact repository, the artifact is silently skipped (unless you require maven result - in that case maven metadata generator complains about that missing artifact). This may happen if a) the metadata and its respective artifact repository are inconsistent b) the artifact repository changes after the metadata repository is fetched (it takes some time until aggregator gets to actual mirroring) This problem has been discussed here: https://bugs.eclipse.org/bugs/show_bug.cgi?id=312656#c21 We have already fixed this in case that the artifacts are mirrored. It would be a good idea to check artifact and metadata repository consistency even for non-mirrored repositories (so called "trusted contributions") but it has not been implemented yet. The recent fixes have not been published though. There are more minor changes than this and we don't want to break things incidentally at this late stage of Helios release. The very latest aggregator (containing all the fixes) is available here: https://build.eclipse.org/hudson/view/Modeling/job/emft-b3-build/lastSuccessfulBuild/artifact/site/headless I have an aggregation involving kepler artefacts which works fine with the 4.2 version of b3 and silently fails with the 4.3 version, giving the infamous: "Not all artifacts could be mirrored, see log for details" with nothing in the logs. While I was hacking on b3 anyway, I gave it a try to put more into the logs right when MirrorGenerator.run() detects errors.size() > 0. Result: The list 'errors' contains a few empty strings, nothing more. This seems to indicate that Builder.getExceptionMessages(e) can produce an empty string, for which I could not see any simple explanation. I'll put in a bit more logging to see what really happens. Is it only me having trouble to use the 4.3 aggregator? (In reply to Stephan Herrmann from comment #2) > Is it only me having trouble to use the 4.3 aggregator? xref: bug 419402 (In reply to Stephan Herrmann from comment #2) > I have an aggregation involving kepler artefacts which works fine with the > 4.2 version of b3 and silently fails with the 4.3 version, giving the > infamous: > "Not all artifacts could be mirrored, see log for details" > with nothing in the logs. > > While I was hacking on b3 anyway, I gave it a try to put more into the logs > right when MirrorGenerator.run() detects errors.size() > 0. Result: The list > 'errors' contains a few empty strings, nothing more. > > This seems to indicate that Builder.getExceptionMessages(e) can produce an > empty string, for which I could not see any simple explanation. > > I'll put in a bit more logging to see what really happens. > > > Is it only me having trouble to use the 4.3 aggregator? I've put some comments in bug 419402 comment 2 that might help? Is this for you making a contribution to Sim. Release ... or, using for something else? I ask since if "for something else", may have to point to specific SR1 repo ... sadly, sometimes our "SR1" and "SR0" are not always "compatible". Created attachment 237284 [details] make error messages visible when using console logging (In reply to Stephan Herrmann from comment #2) > While I was hacking on b3 anyway, I gave it a try to put more into the logs > [...] Here's a trivial patch to ensure that errors are logged at the end of mirroring. This is relevant when running b3 on the command line which uses console logging. When the final error is displayed the root causes have typically long scrolled out of the console's buffer. With this patch they're simply repeated to make sure they're visible. (My ponderings in comment 2 about empty error strings were bogus :-/ ) (In reply to David Williams from comment #4) > (In reply to Stephan Herrmann from comment #2) > > Is it only me having trouble to use the 4.3 aggregator? > > I've put some comments in bug 419402 comment 2 that might help? Yes it did, thanks. > Is this for you making a contribution to Sim. Release ... or, using for > something else? I ask since if "for something else", may have to point to > specific SR1 repo ... sadly, sometimes our "SR1" and "SR0" are not always > "compatible". It's "for something else" (my day job). In fact I'm already using (a mirror of) SR1. So I can't tell if that was relevant or not :) [Bookkeeping change only. Moving bugs to the new "home" of aggregator, CBI.] This seems stale. I'd need to be able to reproduce it... |