It seems that get_sources.sh uses git.centos.org URLs that do not work:
get_sources.sh
git.centos.org
Retrieving https://git.centos.org/sources/glibc/c9s/15252affd9ef4523a8001db16d497f4fdcb3ddf4cde7fe80e075df0bd3cc6524dc29fbe20229dbf5f97af580556e6b1fac0de321a5fe25322bc3e72f93beb624 + url=https://git.centos.org/sources/glibc/c9s/15252affd9ef4523a8001db16d497f4fdcb3ddf4cde7fe80e075df0bd3cc6524dc29fbe20229dbf5f97af580556e6b1fac0de321a5fe25322bc3e72f93beb624 + echo 'Retrieving https://git.centos.org/sources/glibc/c9s/15252affd9ef4523a8001db16d497f4fdcb3ddf4cde7fe80e075df0bd3cc6524dc29fbe20229dbf5f97af580556e6b1fac0de321a5fe25322bc3e72f93beb624' ++ curl -L -H Pragma: -o ./glibc-2.34.tar.xz -R -S --fail --retry 5 https://git.centos.org/sources/glibc/c9s/15252affd9ef4523a8001db16d497f4fdcb3ddf4cde7fe80e075df0bd3cc6524dc29fbe20229dbf5f97af580556e6b1fac0de321a5fe25322bc3e72f93beb624 --write-out '%{http_code}' % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 8271 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (22) The requested URL returned error: 404
https://cbs.centos.org/kojifiles/work/tasks/9038/3409038/mock_output.log
The official builders use this URL: https://sources.stream.rdu2.redhat.com/sources/rpms/glibc/glibc-2.34.tar.xz/sha512/15252affd9ef4523a8001db16d497f4fdcb3ddf4cde7fe80e075df0bd3cc6524dc29fbe20229dbf5f97af580556e6b1fac0de321a5fe25322bc3e72f93beb624/glibc-2.34.tar.xz
I'm going to work around this for glibc by uploading the tarball to the SIG lookaside cache because glibc takes a bit to build, and I want to see how far I can get today (so the issue might not reproduce anymore for glibc).
yes, cbs will only use what SIGs are pushing to git.centos.org and nothing else ? keep in mind that cbs is public and Stream infra is "private" (well, read-only from external) All that is documented on https://sigs.centos.org/guide/git/ (the cbs part, which is what you target)
Metadata Update from @arrfab: - Issue tagged with: cbs, need-more-info
Uh-oh. Can this be fixed at all?
well, that has never been the plan for SIGs .. something to discuss/propose at the board level and then that would be something to implement/maintain
Would it be okay to copy over the tarballs manually, or would the storage requirements be prohibitive?
This is actually something we want to encourage with CentOS Stream (we did not want folks to recreate large parts of CentOS Linux in CBS in the past).
I built a new copy of centpkg-minimal that can pull from the Stream lookaside and tagged it into the isa buildroots. Let's test that out and see if we can use that in other places too.
Metadata Update from @bstinson: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Sorry, this version glitches on sources files in the old MD5 format: https://gitlab.com/redhat/centos-stream/rpms/libtool/-/blob/c9s/sources
sources
DEBUG util.py:446: + read -r _ filename _ hash DEBUG util.py:446: + [[ -n '' ]] DEBUG util.py:446: + 1bfb9b923f2c1339b4d2ce1807064aa5sum -c sources DEBUG util.py:444: /usr/bin/get_sources.sh: line 184: 1bfb9b923f2c1339b4d2ce1807064aa5sum: command not found
https://cbs.centos.org/kojifiles/work/tasks/9244/3409244/root.log
EDIT c9s scratch build for comparison: https://kojihub.stream.rdu2.redhat.com/kojifiles/work/tasks/3841/2323841/root.log
Metadata Update from @fweimer: - Issue status updated to: Open (was: Closed)
And SHA-512 does not yet work, either:
DEBUG util.py:446: + url='https://git.centos.org/sources/bash/HEAD -> c9s/c44a0ce381469219548a3a27589af3fea4f22eda1ca4e9434b59fc16da81b471c29ce18e31590e0860a6a251a664b68c2b45e3a17d22cfc02799ffd9a208390c' DEBUG util.py:446: Retrieving https://git.centos.org/sources/bash/HEAD -> c9s/c44a0ce381469219548a3a27589af3fea4f22eda1ca4e9434b59fc16da81b471c29ce18e31590e0860a6a251a664b68c2b45e3a17d22cfc02799ffd9a208390c DEBUG util.py:446: + echo 'Retrieving https://git.centos.org/sources/bash/HEAD -> c9s/c44a0ce381469219548a3a27589af3fea4f22eda1ca4e9434b59fc16da81b471c29ce18e31590e0860a6a251a664b68c2b45e3a17d22cfc02799ffd9a208390c' DEBUG util.py:446: + curl -L -f 'https://git.centos.org/sources/bash/HEAD -> c9s/c44a0ce381469219548a3a27589af3fea4f22eda1ca4e9434b59fc16da81b471c29ce18e31590e0860a6a251a664b68c2b45e3a17d22cfc02799ffd9a208390c' -o bash-5.1.tar.gz DEBUG util.py:444: % Total % Received % Xferd Average Speed Time Time Time Current DEBUG util.py:444: Dload Upload Total Spent Left Speed DEBUG util.py:444: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 226 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 DEBUG util.py:444: curl: (22) The requested URL returned error: 400 DEBUG util.py:446: + for br in "${branches[@]}" DEBUG util.py:444: ++ echo c9s DEBUG util.py:444: ++ sed -e 's|remotes/origin/||' DEBUG util.py:446: + br=c9s DEBUG util.py:446: + url=https://git.centos.org/sources/bash/c9s/c44a0ce381469219548a3a27589af3fea4f22eda1ca4e9434b59fc16da81b471c29ce18e31590e0860a6a251a664b68c2b45e3a17d22cfc02799ffd9a208390c DEBUG util.py:446: Retrieving https://git.centos.org/sources/bash/c9s/c44a0ce381469219548a3a27589af3fea4f22eda1ca4e9434b59fc16da81b471c29ce18e31590e0860a6a251a664b68c2b45e3a17d22cfc02799ffd9a208390c DEBUG util.py:446: + echo 'Retrieving https://git.centos.org/sources/bash/c9s/c44a0ce381469219548a3a27589af3fea4f22eda1ca4e9434b59fc16da81b471c29ce18e31590e0860a6a251a664b68c2b45e3a17d22cfc02799ffd9a208390c' DEBUG util.py:446: + curl -L -f https://git.centos.org/sources/bash/c9s/c44a0ce381469219548a3a27589af3fea4f22eda1ca4e9434b59fc16da81b471c29ce18e31590e0860a6a251a664b68c2b45e3a17d22cfc02799ffd9a208390c -o bash-5.1.tar.gz DEBUG util.py:444: % Total % Received % Xferd Average Speed Time Time Time Current DEBUG util.py:444: Dload Upload Total Spent Left Speed DEBUG util.py:444: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 8271 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 DEBUG util.py:444: curl: (22) The requested URL returned error: 404 DEBUG util.py:446: + read -r _ filename _ hash DEBUG util.py:446: + [[ -n '' ]] DEBUG util.py:446: + sha512sum -c sources DEBUG util.py:444: sha512sum: bash-5.1.tar.gz: No such file or directory DEBUG util.py:446: bash-5.1.tar.gz: FAILED open or read DEBUG util.py:444: sha512sum: WARNING: 1 listed file could not be read DEBUG util.py:598: Child return code was: 1
This looks like a separate issue I wanted to bring up. You tagged it:
$ koji -p cbs latest-build isa9s-packages-baseline-el9sbase-build centpkg-minimal Build Tag Built by ---------------------------------------- -------------------- ---------------- centpkg-minimal-2.0.0-6.el9 isa9s-packages-baseline-el9sbase-build bstinson
But we still install this:
DEBUG util.py:446: centpkg-minimal noarch 2.1.0-3.el9 build 11 k
The version-release is higher in the external repo. With the current configuration, we cannot override external builds through tagging. This is a problem because in some cases, the dist tag change makes the NVR smaller, so we cannot build against the correct (rebuilt) version in cases where this is required (some SELinux policy packages I believe).
This makes the original MD5 failure a bit mysterious. Checking to see if that reproduce in c9s proper as well.
We got a couple of builds past the buildsrpm stage: https://cbs.centos.org/koji/taskinfo?taskID=3409422 https://cbs.centos.org/koji/taskinfo?taskID=3409424
This looks like we're in better shape now.
Log in to comment on this ticket.