#11917 epel 8 and epel9 using zst breaks rhel packages functionality (createrepo_c and koji)
Closed: Fixed with Explanation 8 months ago by kevin. Opened 8 months ago by jppialasse.

Describe what you would like us to do:


I want you to reverse to legacy gz compression your mirror metadata, particularly primary.xml on epel 8 and epel 9.

since May 8 I see my local koji instance unable to regen-repo for my builds against el8 including epel 8 as external repo. I get this message :
C_CREATEREPOLIB: Critical: cr_metadata_load_xml: Error encountered while parsing
Critical: Cannot load repo: "http://mirror.in2p3.fr/pub/epel/8/Everything/x86_64/" : Error encountered while parsing:primary.xml parsing: Cannot open /tmp/createrepo_c_tmp_repo_tf3hag/repodata/638550a2f5c26d650a2c3b1dc1aceb5dc079144aaf5e2136c46fe50277c359f5-primary.xml.zst: Cannot detect compression type

from searching I see that createrepo_c >1 is needed to support zst, and rhel 9-9 provides only =<0.2
I see that you kept filelists.xml.gz for epel 7 but also for fedora 37

When do you need this to be done by? (YYYY/MM/DD)


asap


I pushed a possible fix to epel8-testing. Do you have any way to pull that and test with it?
(ie, do you/can you setup an external repo for epel8-testing?)

This looks somewhat related to https://pagure.io/releng/issue/12097

sounds related,d id not found it searching. thanks

I pushed a possible fix to epel8-testing. Do you have any way to pull that and test with it?
(ie, do you/can you setup an external repo for epel8-testing?)

I tried a manual mergerepo_c copied from an usual task , you can see before/after, seems to fix it!

# /usr/bin/mergerepo_c --pkgorigins --all -a x86_64 -o /tmp/koji/tasks/9172/19172/repo --arch-expand -g /mnt/koji/repos/dist-sme11-build/16040/groups/comps.xml  -r https://dl.rockylinux.org/pub/rocky/8/BaseOS/x86_64/os/ -r http://rpms.remirepo.net/enterprise/8/safe/x86_64/ -r http://rpms.remirepo.net/enterprise/8/modular/x86_64/ -r https://dl.rockylinux.org/pub/rocky/8/AppStream/x86_64/os/ -r https://dl.rockylinux.org/pub/rocky/8/PowerTools/x86_64/os/ -r http://mirror.in2p3.fr/pub/epel/8/Everything/x86_64/ -r http://repo.openfusion.net/centos8-x86_64/ -r http://download1.rpmfusion.org/free/el/updates/8/x86_64/ -r http://rpms.remirepo.net/enterprise/8/remi/x86_64/
[...]
type group added to list from path: http://mirror.in2p3.fr/pub/epel/8/Everything/x86_64/repodata/38c120578e1f49b9074c3469a7eb9e366e4d2daf3e1d978d10d51a8a369287b3-comps-Everything.x86_64.xml.xz 
type prestodelta added to list from path: http://mirror.in2p3.fr/pub/epel/8/Everything/x86_64/repodata/6d76698cfae12e13910abe54c2992372e070a6105acd9af8147dd2fa5b2807b8-prestodelta.xml.xz 
type updateinfo added to list from path: http://mirror.in2p3.fr/pub/epel/8/Everything/x86_64/repodata/57cda6fc48fe4eddc986aa0455ac28d7846b9ff383c00e6ac0adad562b71b61e-updateinfo.xml.bz2 
[...]

C_CREATEREPOLIB: Critical: cr_metadata_load_xml: Error encountered while parsing
Critical: Cannot load repo: "http://mirror.in2p3.fr/pub/epel/8/Everything/x86_64/" : Error encountered while parsing:primary.xml parsing: Cannot open /tmp/createrepo_c_tmp_repo_tf3hag/repodata/638550a2f5c26d650a2c3b1dc1aceb5dc079144aaf5e2136c46fe50277c359f5-primary.xml.zst: Cannot detect compression type

with the epel-test

# /usr/bin/mergerepo_c --pkgorigins --all -a x86_64 -o /tmp/koji/tasks/9172/19172/repo --arch-expand -g /mnt/koji/repos/dist-sme11-build/16040/groups/comps.xml  -r https://dl.rockylinux.org/pub/rocky/8/BaseOS/x86_64/os/ -r http://rpms.remirepo.net/enterprise/8/safe/x86_64/ -r http://rpms.remirepo.net/enterprise/8/modular/x86_64/ -r https://dl.rockylinux.org/pub/rocky/8/AppStream/x86_64/os/ -r https://dl.rockylinux.org/pub/rocky/8/PowerTools/x86_64/os/ -r https://mirror.cpsc.ucalgary.ca/mirror/fedora-epel/testing/8/Everything/x86_64 -r http://repo.openfusion.net/centos8-x86_64/ -r http://download1.rpmfusion.org/free/el/updates/8/x86_64/ -r http://rpms.remirepo.net/enterprise/8/remi/x86_64/
[...]
type group added to list from path: https://mirror.cpsc.ucalgary.ca/mirror/fedora-epel/testing/8/Everything/x86_64/repodata/38c120578e1f49b9074c3469a7eb9e366e4d2daf3e1d978d10d51a8a369287b3-comps-Everything.x86_64.xml.xz 
type prestodelta added to list from path: https://mirror.cpsc.ucalgary.ca/mirror/fedora-epel/testing/8/Everything/x86_64/repodata/3c24479b245948d7a740adf19fe8dbb82b2bffb0f45680db9db3dcea9dddf6fb-prestodelta.xml.xz 
type updateinfo added to list from path: https://mirror.cpsc.ucalgary.ca/mirror/fedora-epel/testing/8/Everything/x86_64/repodata/f891e010ffe287779a979e40310bf78f0e8195025d70e19dc916669cfb1ec6a4-updateinfo.xml.bz2 

no error repo created

Metadata Update from @kevin:
- Issue assigned to kevin

8 months ago

So, both epel8 and epel8-testing repos should be using xz now and work for everything.

I note that you mention epel9 in the title here, but... epel9 has always had/continues to have gz repodata, so I don't know how it could have been affected.

I'm going to close this now, but if you still see any issues, please re-open or file a new ticket.

Metadata Update from @kevin:
- Issue close_status updated to: Fixed with Explanation
- Issue status updated to: Closed (was: Open)

8 months ago

Log in to comment on this ticket.

Metadata