I have a "batch" script for tagging something to infra or infra-stg repos. Today I did: $ ./releng/koji-tag-move-prod copr-cli-1.91-1.fc32 python-copr-1.107-1.fc32 python-copr-common-0.11-1.fc32 copr-rpmbuild-0.44-1.fc32
Which generated several task in Koji that all succeeded. That in turn generated several distRepo tasks, which also seem they succeeded. E.g.: https://koji.fedoraproject.org/koji/taskinfo?taskID=56522470
Particular x86_64 createrepo run says there's copr-rpmbuild-0.44: https://kojipkgs.fedoraproject.org//work/tasks/2547/56522547/createrepo.log 14:25:44: Adding pkg: /var/tmp/koji/tasks/2547/56522547/repo/Packages/c/copr-rpmbuild-0.44-1.fc32.x86_64.rpm
14:25:44: Adding pkg: /var/tmp/koji/tasks/2547/56522547/repo/Packages/c/copr-rpmbuild-0.44-1.fc32.x86_64.rpm
But still, after some time - I can't find the package in the /latest/ repo:
# curl https://kojipkgs.fedoraproject.org/repos-dist/f32-infra/latest/x86_64/pkglist 2>/dev/null | grep copr-rpmbuild Packages/c/copr-rpmbuild-0.39-1.fc32.x86_64.rpm Packages/c/copr-rpmbuild-0.42-1.fc32.x86_64.rpm
What you can see here is a race condition in Koji. You tagged 4 builds, which resulted in 4 competing distRepo tasks. The last distRepo task to complete "wins" - the repo produced by it is marked as latest.
Metadata Update from @mizdebsk: - Issue assigned to mizdebsk - Issue priority set to: Waiting on Assignee (was: Needs Review) - Issue tagged with: ops
Fixed with koji tag --force f32-infra copr-rpmbuild-0.44-1.fc32 https://koji.fedoraproject.org/koji/taskinfo?taskID=56530242
koji tag --force f32-infra copr-rpmbuild-0.44-1.fc32
Metadata Update from @mizdebsk: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
I thought it's not racy anymore: https://pagure.io/koji/issue/1630
It looks like the issue is still not fixed. I'm adding more information in case someone wants to forward it upstream.
tagBuild tasks:
Corresponding distRepo tasks:
At the end, after all the above tasks completed, repo 506547 was the latest while 506549 should be the latest.
Metadata Update from @mizdebsk: - Issue tagged with: koji
Login to comment on this ticket.