#12314 fedora:41 and fedora:42 images out of date in the registry.fedoraproject.org
Closed: Fixed with Explanation a month ago by kevin. Opened 3 months ago by petersen.

~$ skopedate fedora:42
registry.fedoraproject.org           2024-08-22 15:35:31 +0800
candidate-registry.fedoraproject.org 2024-08-22 15:35:31 +0800
quay.io/fedora                       2024-08-22 15:35:31 +0800
~$ skopedate fedora:41
registry.fedoraproject.org           2024-09-03 17:28:47 +0800
candidate-registry.fedoraproject.org 2024-09-03 17:28:47 +0800
quay.io/fedora                       2024-09-03 17:28:47 +0800
~$ skopedate fedora:40
registry.fedoraproject.org           2024-09-09 13:48:34 +0800
candidate-registry.fedoraproject.org 2024-09-09 13:48:34 +0800
quay.io/fedora                       2024-09-09 13:48:34 +0800
~$ skopedate fedora:39
registry.fedoraproject.org           2024-09-09 15:50:13 +0800
candidate-registry.fedoraproject.org 2024-09-09 15:50:13 +0800
quay.io/fedora                       2024-09-09 15:50:13 +0800

Kevin told the the images are being built okay apparently - so not clear why they aren't appearing

(skopedate is available in my copr for those curious)


Metadata Update from @phsmoura:
- Issue tagged with: medium-gain, medium-trouble, ops

3 months ago

I don't see any errors or anything... but it seems like it's updating it to the existing/old tag?

"rawhide was moved to SHA256 04ec299e44ec from SHA256 04ec299e44ec"

Well, I see this:

xz: Fedora-Container-Toolbox.aarch64-Rawhide-20240917.n.1.oci.tar.xz: No such file or directory
time="2024-09-17T22:30:01Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.aarch64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.aarch64-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:30:01Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.aarch64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.aarch64-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:30:01Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.aarch64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.aarch64-Rawhide-20240917.n.1.oci.tar""
xz: Fedora-Container-Toolbox.ppc64le-Rawhide-20240917.n.1.oci.tar.xz: No such file or directory
time="2024-09-17T22:30:01Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.ppc64le-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.ppc64le-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:30:01Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.ppc64le-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.ppc64le-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:30:01Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.ppc64le-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.ppc64le-Rawhide-20240917.n.1.oci.tar""
xz: Fedora-Container-Toolbox.s390x-Rawhide-20240917.n.1.oci.tar.xz: No such file or directory
time="2024-09-17T22:30:01Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.s390x-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.s390x-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:30:01Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.s390x-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.s390x-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:30:01Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.s390x-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.s390x-Rawhide-20240917.n.1.oci.tar""
xz: Fedora-Container-Toolbox.x86_64-Rawhide-20240917.n.1.oci.tar.xz: No such file or directory
time="2024-09-17T22:30:02Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.x86_64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.x86_64-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:30:02Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.x86_64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.x86_64-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:30:02Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Toolbox.x86_64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8oEbkIj7Ph/Fedora-Container-Toolbox.x86_64-Rawhide-20240917.n.1.oci.tar""

that doesn't look right. investigating.

Ah. We changed/fixed the filenames. The stupid script doesn't get the filenames from the koji task, it just 'knows' what they are, so its knowledge needs updating.

I didn't see any errors like those from the base/minimal? but I guess it's just uploading the one with the old name over and over and over again.

@kevin yeah...the fact we don't see xz errors for those is weird for sure. I can't explain exactly what's going on for the other flavors, which irritates me. but the filename format at least definitely needs fixing.

oh wait no, those errors are present. they just come earlier. there's a whole block of download, xz errors, push for each flavor. further up you can see:

xz: Fedora-Container-Base-Generic-Minimal.aarch64-Rawhide-20240917.n.1.oci.tar.xz: No such file or directory
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.aarch64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.aarch64-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.aarch64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.aarch64-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.aarch64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.aarch64-Rawhide-20240917.n.1.oci.tar""
xz: Fedora-Container-Base-Generic-Minimal.ppc64le-Rawhide-20240917.n.1.oci.tar.xz: No such file or directory
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.ppc64le-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.ppc64le-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.ppc64le-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.ppc64le-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.ppc64le-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.ppc64le-Rawhide-20240917.n.1.oci.tar""
xz: Fedora-Container-Base-Generic-Minimal.s390x-Rawhide-20240917.n.1.oci.tar.xz: No such file or directory
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.s390x-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.s390x-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.s390x-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.s390x-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.s390x-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.s390x-Rawhide-20240917.n.1.oci.tar""
xz: Fedora-Container-Base-Generic-Minimal.x86_64-Rawhide-20240917.n.1.oci.tar.xz: No such file or directory
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.x86_64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.x86_64-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.x86_64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.x86_64-Rawhide-20240917.n.1.oci.tar""
time="2024-09-17T22:29:42Z" level=fatal msg="initializing source oci-archive:Fedora-Container-Base-Generic-Minimal.x86_64-Rawhide-20240917.n.1.oci.tar:: creating temp directory: archive file not found: "/tmp/tmp.8EHQxJPCt4/Fedora-Container-Base-Generic-Minimal.x86_64-Rawhide-20240917.n.1.oci.tar""

and the same for base.

I think the reason we keep pushing back the same images is probably the manifest creation step that happens after the failed push of the individual images.

Running it now and it looks much better, but I see:

Error: 1 error occurred:                                                                      
        * quay.io/fedora/fedora-minimal:42: image not known

for all the images... might be we need to do something there to make 42 a valid image?

uh, maybe? that's outside my knowledge.

The only errors related to container sync in the last branched were:

error: Refspec 'fedora/41/ppc64le/sericea' not found
error: Refspec 'fedora/41/ppc64le/onyx' not found
error: Refspec 'fedora/41/aarch64/onyx' not found
error: No such branch 'fedora/41/ppc64le/sericea' in repository summary

The image not known thing seems all sorted...

ok, I think this is all sorted now, closing.

Metadata Update from @kevin:
- Issue close_status updated to: Fixed with Explanation
- Issue status updated to: Closed (was: Open)

a month ago

Log in to comment on this ticket.

Metadata
Boards 1
Ops Status: Backlog