#6277 Cannot download repomd.xml for ppc64le architecture
Closed: Fixed None Opened 8 years ago by msuchy.

All Copr builds for PPC64LE are currently failing after this step:

LC_ALL=C /usr/bin/dnf --installroot /var/lib/mock/fedora-23-ppc64le-root-723/root/ --releasever 23 install @buildsys-build --setopt=tsflags=nocontexts

Error: Failed to synchronize cache for repo 'fedora' from 'https://mirrors.fedoraproject.org/metalink?repo=fedora-23&arch=ppc64le': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried


Was this on the copr builders in the fedorainfracloud? or the remote ppc builder in cz?

That link loads ok here...

It is the builder in .cz

The real cause seems to be:
error: Downloading successful, but checksum doesn't match.

Here is full output:
{{{
LC_ALL=C /usr/bin/dnf -vvv --installroot ~/foo/ --releasever 23 install @buildsys-build --setopt=tsflags=nocontexts
cachedir: /var/tmp/dnf-msuchy-QrlsfJ/ppc64/23
Loaded plugins: migrate
DNF version: 1.0.0
error: Downloading successful, but checksum doesn't match. Calculated: 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) Expected: 517fba0cb84771bf4ccc532f9cfd1aa358f1a2e6bb72b4368b8f36b30081e17420a455d65ec693837242eda89ec6612245d8d1e28ddb7a2adadcad4ffeb1d6e6(sha512) b67427bb6a09da5ea8a7ff366f0113dee4574103e169615131444ece22c02c085889ac46f70309a58b2d7e5cdcdf00a9569d2a4fd4b8f1834d43e989d4e7bda7(sha512) (http://mirrors.nic.cz/fedora-secondary/development/23/ppc64/os/repodata/repomd.xml).
error: Downloading successful, but checksum doesn't match. Calculated: 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) Expected: 517fba0cb84771bf4ccc532f9cfd1aa358f1a2e6bb72b4368b8f36b30081e17420a455d65ec693837242eda89ec6612245d8d1e28ddb7a2adadcad4ffeb1d6e6(sha512) b67427bb6a09da5ea8a7ff366f0113dee4574103e169615131444ece22c02c085889ac46f70309a58b2d7e5cdcdf00a9569d2a4fd4b8f1834d43e989d4e7bda7(sha512) (ftp://mirrors.nic.cz/pub/fedora-secondary/development/23/ppc64/os/repodata/repomd.xml).
error: Downloading successful, but checksum doesn't match. Calculated: 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) Expected: 517fba0cb84771bf4ccc532f9cfd1aa358f1a2e6bb72b4368b8f36b30081e17420a455d65ec693837242eda89ec6612245d8d1e28ddb7a2adadcad4ffeb1d6e6(sha512) b67427bb6a09da5ea8a7ff366f0113dee4574103e169615131444ece22c02c085889ac46f70309a58b2d7e5cdcdf00a9569d2a4fd4b8f1834d43e989d4e7bda7(sha512) (ftp://ftp.icm.edu.pl/pub/Linux/dist/fedora-secondary/development/23/ppc64/os/repodata/repomd.xml).
error: Downloading successful, but checksum doesn't match. Calculated: 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) Expected: 517fba0cb84771bf4ccc532f9cfd1aa358f1a2e6bb72b4368b8f36b30081e17420a455d65ec693837242eda89ec6612245d8d1e28ddb7a2adadcad4ffeb1d6e6(sha512) b67427bb6a09da5ea8a7ff366f0113dee4574103e169615131444ece22c02c085889ac46f70309a58b2d7e5cdcdf00a9569d2a4fd4b8f1834d43e989d4e7bda7(sha512) (http://ftp.icm.edu.pl/pub/Linux/dist/fedora-secondary/development/23/ppc64/os/repodata/repomd.xml).
error: Downloading successful, but checksum doesn't match. Calculated: 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) Expected: 517fba0cb84771bf4ccc532f9cfd1aa358f1a2e6bb72b4368b8f36b30081e17420a455d65ec693837242eda89ec6612245d8d1e28ddb7a2adadcad4ffeb1d6e6(sha512) b67427bb6a09da5ea8a7ff366f0113dee4574103e169615131444ece22c02c085889ac46f70309a58b2d7e5cdcdf00a9569d2a4fd4b8f1834d43e989d4e7bda7(sha512) (http://ftp-stud.hs-esslingen.de/pub/fedora-secondary/development/23/ppc64/os/repodata/repomd.xml).
error: Downloading successful, but checksum doesn't match. Calculated: 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) Expected: 517fba0cb84771bf4ccc532f9cfd1aa358f1a2e6bb72b4368b8f36b30081e17420a455d65ec693837242eda89ec6612245d8d1e28ddb7a2adadcad4ffeb1d6e6(sha512) b67427bb6a09da5ea8a7ff366f0113dee4574103e169615131444ece22c02c085889ac46f70309a58b2d7e5cdcdf00a9569d2a4fd4b8f1834d43e989d4e7bda7(sha512) (ftp://ftp-stud.hs-esslingen.de/pub/fedora-secondary/development/23/ppc64/os/repodata/repomd.xml).
error: Downloading successful, but checksum doesn't match. Calculated: 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) Expected: 517fba0cb84771bf4ccc532f9cfd1aa358f1a2e6bb72b4368b8f36b30081e17420a455d65ec693837242eda89ec6612245d8d1e28ddb7a2adadcad4ffeb1d6e6(sha512) b67427bb6a09da5ea8a7ff366f0113dee4574103e169615131444ece22c02c085889ac46f70309a58b2d7e5cdcdf00a9569d2a4fd4b8f1834d43e989d4e7bda7(sha512) (http://fr2.rpmfind.net/linux/fedora-secondary/development/23/ppc64/os/repodata/repomd.xml).
error: Downloading successful, but checksum doesn't match. Calculated: 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) 9e8e0185eca210dc57520292ab7b494ddd1a9c7fc4469036eb6b61d48c2de3882e133a856d48d027f40238bb5486bfef6a7ea792c5fcdad147add0ba92e65a8e(sha512) Expected: 517fba0cb84771bf4ccc532f9cfd1aa358f1a2e6bb72b4368b8f36b30081e17420a455d65ec693837242eda89ec6612245d8d1e28ddb7a2adadcad4ffeb1d6e6(sha512) b67427bb6a09da5ea8a7ff366f0113dee4574103e169615131444ece22c02c085889ac46f70309a58b2d7e5cdcdf00a9569d2a4fd4b8f1834d43e989d4e7bda7(sha512) (ftp://fr2.rpmfind.net/linux/fedora-secondary/development/23/ppc64/os/repodata/repomd.xml).
Error: Failed to synchronize cache for repo 'fedora' from 'https://mirrors.fedoraproject.org/metalink?repo=fedora-23&arch=ppc64': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried
}}}

Looks something is really broken ...

{{{
[dan@eagle check_metalink]$ ./check_metalink --repo fedora-23 --arch ppc64le :master
Client IP: 88.101.155.72
Testing repo=fedora-23, arch=ppc64le
Metalink provided by: proxy05.fedoraproject.org
Server date: Fri, 16 Oct 2015 09:41:37 GMT
Failed: http://ftp-stud.hs-esslingen.de/pub/fedora-secondary/development/23/ppc64le/os/repodata/repomd.xml
Failed: http://mirrors.nic.cz/fedora-secondary/development/23/ppc64le/os/repodata/repomd.xml
Failed: http://ftp.icm.edu.pl/pub/Linux/dist/fedora-secondary/development/23/ppc64le/os/repodata/repomd.xml
Failed: http://mirror.chpc.utah.edu/pub/fedora-secondary/development/23/ppc64le/os/repodata/repomd.xml
Failed: http://fr2.rpmfind.net/linux/fedora-secondary/development/23/ppc64le/os/repodata/repomd.xml
Failed: http://dl.fedoraproject.org/pub/fedora-secondary/development/23/ppc64le/os/repodata/repomd.xml
OK metalinks (0):
Bad metalinks (1): fedora-23.ppc64le
Exception metalinks (0):
OK metalink means that at least one mirror is valid
[dan@eagle check_metalink]$ ./check_metalink --repo fedora-23 --arch ppc64le --check-master :master
Client IP: 88.101.155.72
Testing repo=fedora-23, arch=ppc64le
Metalink provided by: proxy05.fedoraproject.org
Server date: Fri, 16 Oct 2015 09:41:49 GMT
OK metalinks (0):
Bad metalinks (1): fedora-23.ppc64le
Exception metalinks (0):
}}}

This seems to have been a temporary problem. The mirrors could have been updated faster than the MirrorManager database. As the MirrorManager information is updated by a fedmsg trigger I had a look at the logs but everything looks "normal" with update-master-directory-listing script which updates the MirrorManager database during the last few days. As the database upgrade is fedmsg triggered the duration in which the mirrors can be newer than the MirrorManager database is as low as possible right now. One additional step to ensure this does not happen in the future would be to 'hide' the updates on the master mirror until the MirrorManager database is updated. (Whatever hide might mean in this context).

Exact time and content of the broken metalink would help in the future to debug this in more detail.

Right now it seems to work correctly but it could be that there is still a bug somewhere in the repomd.xml handling.

Metadata Update from @msuchy:
- Issue set to the milestone: Fedora 23 Beta

7 years ago

Login to comment on this ticket.

Metadata