The url https://kojipkgs.fedoraproject.org/repos-dist/f30-infra/ says there's no sub-directory.
$ lftp https://kojipkgs.fedoraproject.org/repos-dist/f30-infra/ cd ok, cwd=/repos-dist/f30-infra lftp kojipkgs.fedoraproject.org:/repos-dist/f30-infra> ls drwxr-xr-x -- ..
This breaks at least copr builders (copr uses older copr-builder.rpm package than expected).
Confirmed. This is caused by removal of dist-repo-regen cron job from Bodhi, which was ran on decommissioned bodhi-backend02. We need to re-add the cron job somewhere, likely to one of Koji hosts.
bodhi-backend02
Metadata Update from @mizdebsk: - Issue priority set to: Waiting on Assignee (was: Needs Review) - Issue tagged with: koji
Any idea how long it could take to make it working? (I can use temporarily copr as a source for hot-fixes, but I'm not sure it is worth it).
I've manually generated them now, so they should be there for a day or so.
Hopefully we can fix this soon.
This should be fixed now.
Metadata Update from @kevin: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Reopening:
$ koji tag-build f30-infra-candidate mock-1.4.16-2.fc30 Created task 35636237 Watching tasks (this may be safely interrupted)... 35636237 tagBuild (noarch): closed 35636237 tagBuild (noarch) completed successfully
... though https://kojipkgs.fedoraproject.org/repos-dist/f30-infra-stg/latest/ doesn't seem to react...
Metadata Update from @praiskup: - Issue status updated to: Open (was: Closed)
So, if you look at the dist-repo task that was spawned, you can see that it failed due to some packages not having signed copies. This is due to us keeping all the versions in the infra-tags repos, not just the latest and them being cleaned up by a prune cron job (that only keeps the latest one in each tag).
I've set it up to now not prune signed copies in any of the active infra tags, this should prevent it from happening again.
https://koji.fedoraproject.org/koji/taskinfo?taskID=35636211
➜ koji git:(master) koji write-signed-rpm 47dd8ef9 koji-1.17.0-6.fc30.infra [1/16] python2-koji-1.17.0-6.fc30.infra.noarch [2/16] python3-koji-hub-plugins-1.17.0-6.fc30.infra.noarch [3/16] python3-koji-web-1.17.0-6.fc30.infra.noarch [4/16] python3-koji-1.17.0-6.fc30.infra.noarch [5/16] koji-hub-plugins-1.17.0-6.fc30.infra.noarch [6/16] koji-1.17.0-6.fc30.infra.noarch [7/16] python3-koji-cli-plugins-1.17.0-6.fc30.infra.noarch [8/16] koji-web-1.17.0-6.fc30.infra.noarch [9/16] koji-hub-1.17.0-6.fc30.infra.noarch [10/16] koji-utils-1.17.0-6.fc30.infra.noarch [11/16] python2-koji-cli-plugins-1.17.0-6.fc30.infra.noarch [12/16] koji-vm-1.17.0-6.fc30.infra.noarch [13/16] koji-builder-plugins-1.17.0-6.fc30.infra.noarch [14/16] koji-builder-1.17.0-6.fc30.infra.noarch [15/16] python3-koji-hub-1.17.0-6.fc30.infra.noarch [16/16] koji-1.17.0-6.fc30.infra.src ➜ koji git:(master) koji write-signed-rpm 47dd8ef9 oz-0.17.0-0.2.fc30 [1/2] oz-0.17.0-0.2.fc30.noarch [2/2] oz-0.17.0-0.2.fc30.src ➜ koji git:(master) koji dist-repo --noinherit f30-infra-stg 47dd8ef9 Creating dist repo for tag f30-infra-stg Watching tasks (this may be safely interrupted)... 35638570 distRepo (f30-infra-stg): free 35638570 distRepo (f30-infra-stg): free -> open (buildhw-02.phx2.fedoraproject.org) 35638576 createdistrepo (1193581, x86_64): closed 35638575 createdistrepo (1193581, s390x): closed 35638574 createdistrepo (1193581, aarch64): closed 35638571 createdistrepo (1193581, i386): closed 35638573 createdistrepo (1193581, armhfp): closed 35638577 createdistrepo (1193581, ppc64): open (buildvm-aarch64-09.arm.fedoraproject.org) 35638572 createdistrepo (1193581, ppc64le): closed 35638577 createdistrepo (1193581, ppc64): open (buildvm-aarch64-09.arm.fedoraproject.org) -> closed 0 free 1 open 7 done 0 failed 35638570 distRepo (f30-infra-stg): open (buildhw-02.phx2.fedoraproject.org) -> closed 0 free 0 open 8 done 0 failed 35638570 distRepo (f30-infra-stg) completed successfully
Let us know if you see any further issues with it.
Same with moving from infra-stg to infra: https://kojipkgs.fedoraproject.org//work/tasks/2082/35642082/missing_files.log
Can you please sign also the packages in f30-infra then?
This is just more fallout from the already fixed issue. :)
I asked koji to write out every package that was infra-sig signed. Overkill, but it should clean up the non current ones after a bit.
So, all of them should be working now, but please let me know if you see anything else.