#11870 Disable HTTP caches for repomd.xml files for Koji buildroots
Opened 4 months ago by praiskup. Modified 4 months ago

This report is a follow-up for the report from @fweimer against Copr:

My i386 builds frequently fail in COPR like this one:
https://download.copr.fedorainfracloud.org/results/fweimer/relr/fedora-rawhide-i386/06855813-redhat-rpm-config/builder-live.log.gz

Copr repository                                  36 kB/s | 1.5 kB     00:00    
local                                            53 MB/s |  17 MB     00:00    
Errors during downloading metadata for repository 'local':
  - Status code: 404 for https://kojipkgs.fedoraproject.org/repos/rawhide/latest/x86_64/repodata/5bd2946e7430ca4ed38e9d4b800b6978d73ac1ecaf20d13bde53d5d7929a54b5-filelists.xml.gz (IP: 38.145.60.21)
Error: Failed to download metadata for repo 'local': Yum repo downloading error: Downloading error(s): repodata/5bd2946e7430ca4ed38e9d4b800b6978d73ac1ecaf20d13bde53d5d7929a54b5-filelists.xml.gz - Cannot download, all mirrors were already tried without success

Is there anything I can do to avoid this?

This seems that repomd.xml is often inconsistent. This could be becauase of broken createrepo, a race (but Copr re-runs dnf to re-download metadata in case of failure like this) or caching problems. I bet on the latest, becase the http headers do not seem to suggest that caching is disabled. Compare curl -v for:

What we do in Fedora Copr repository hosting is that we provide cache-control: no-cache header for the repomd.xml files (and only for those! All the other metadata files can be safely cached).
Could we do the same for kojipkgs.fedoraproject.org/repos?


Hmm, now I recall the old issue https://pagure.io/fedora-infrastructure/issue/10531 where we (among others) applied this patch.

Does the following configuration have any effect actually?

+    if (req.url ~ "/repomd.xml") {
+        return (pipe);
+    }

Metadata Update from @phsmoura:
- Issue tagged with: low-gain, low-trouble, ops

4 months ago

Metadata Update from @jnsamyak:
- Issue untagged with: low-trouble
- Issue tagged with: investigation, medium-trouble

4 months ago

Example s390x:
https://copr.fedorainfracloud.org/coprs/psimovec/openblas-0.3.23/build/6940689/

Additional repo http_kojipkgs_fedoraproject_org 226 MB/s |  52 MB     00:00    
Errors during downloading metadata for repository 'http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch':
  - Status code: 404 for https://kojipkgs.fedoraproject.org/repos/rawhide/latest/s390x/repodata/7ea5d60a860c857599e3ea6a936272eae2e76e7e0ef6a3d71948120ebc2c93da-primary.xml.gz (IP: 38.145.60.21)
Error: Failed to download metadata for repo 'http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch': Yum repo downloading error: Downloading error(s): repodata/7ea5d60a860c857599e3ea6a936272eae2e76e7e0ef6a3d71948120ebc2c93da-primary.xml.gz - Cannot download, all mirrors were already tried without success

I can now confirm that this is a generic issue that is visible outside of COPR as well.

It does not impact Koji because it does not use the /latest/ repository, the numbered buildroots are immutable and not affected by this issue.

Login to comment on this ticket.

Metadata
Boards 1
Ops Status: Backlog