fedora-ci / general

Clone
Source Code
GIT

#252 PR tests for python3.x don't install python3.10 (Fedora CI - dist-git test)
Closed 2 years ago by mvadkert. Opened 2 years ago by churchyard.

Closed
Reopen Issue

In this PR:

https://src.fedoraproject.org/rpms/python3.10/pull-request/58

The test failures are all because the built package is not installed.

In this PR:

https://src.fedoraproject.org/rpms/python3.9/pull-request/71

The test failures are all because the built package is not installed.

I suspect this is related to the recent Python 3.10 rebuild, but I don't know how to debug the problem. If the installation of the test subject fails, the tests should IMHO not carry on.

I suspect this is related to the recent Python 3.10 rebuild, but I don't know how to debug the problem. If the installation of the test subject fails, the tests should IMHO not carry on.

We try to be dead sure we installed the correct builds :( even cases like downgrade (NVR lower), reinstall (same NVR), should work :(

Speaking about Fedora CI, this is log which should verify correct packages installed:

http://artifacts.dev.testing-farm.io/43ac6f7c-955d-4175-846c-c8d3d3b8278c/guest-setup-bd6829b6-cab2-47ad-a84d-1278d18282cf/artifact-installation-bd6829b6-cab2-47ad-a84d-1278d18282cf/5-Verify-all-packages-installed.txt

And here did the installation happen:

http://artifacts.dev.testing-farm.io/43ac6f7c-955d-4175-846c-c8d3d3b8278c/guest-setup-bd6829b6-cab2-47ad-a84d-1278d18282cf/artifact-installation-bd6829b6-cab2-47ad-a84d-1278d18282cf/4-Install-packages.txt

I cannot see what is wrong, can you @churchyard ?

All logs from installation process are in http://artifacts.dev.testing-farm.io/43ac6f7c-955d-4175-846c-c8d3d3b8278c/guest-setup-bd6829b6-cab2-47ad-a84d-1278d18282cf

Are there more packages installed later? E.g. some testing framework packages?

I've opened https://src.fedoraproject.org/rpms/python3.10/pull-request/59 to hopefully get some useful information.

https://osci-jenkins-1.ci.fedoraproject.org/job/fedora-ci/job/dist-git-pipeline/job/master/49795/testReport/(root)/tests/dnf_history/

ID     | Command line             | Date and time    | Action(s)      | Altered
-------------------------------------------------------------------------------
     7 | install --assumeyes --al | 2021-06-09 11:31 | I, U           |   80 EE
     6 | install --assumeyes --al | 2021-06-09 11:30 | D, I, O        |   80 EE
     5 |                          | 2021-06-09 11:30 | Install        |    3   
     4 | -y install python3.10-de | 2021-06-09 11:30 | Install        |    5   
     3 | -y update python3.10-deb | 2021-06-09 11:29 | I, U           |   96 EE
     2 |                          | 2021-06-09 11:28 | Install        |    5  <
     1 |                          | 2021-06-06 17:36 | Install        |  355 >E

Transaction ID : 7
Begin time     : Wed 09 Jun 2021 11:31:23 AM UTC
Begin rpmdb    : 385:4eb94871483dbece978eb52063e672bcb655e1d0
End time       : Wed 09 Jun 2021 11:31:47 AM UTC (24 seconds)
End rpmdb      : 386:c7f5ae04e08a8f7b2be85116c4e1a468537ddf3d
User           : root <root>
Return-Code    : Success
Releasever     : rawhide
Command Line   : install --assumeyes --allowerasing python3.10
Comment        : 
Packages Altered:
    Install  python3.9-3.9.5-3.fc35.x86_64                                 @testing-farm-tag-repository
    Upgrade  python-unversioned-command-3.10.0~b2-3.fc35.noarch            @test-artifacts
    Upgraded python-unversioned-command-3.9.5-2.fc35.noarch                @@System
    Upgrade  python3-3.10.0~b2-3.fc35.x86_64                               @test-artifacts
    Upgraded python3-3.9.5-2.fc35.x86_64                                   @@System
    Upgrade  python3-devel-3.10.0~b2-3.fc35.x86_64                         @test-artifacts
    Upgraded python3-devel-3.9.5-2.fc35.x86_64                             @@System
    Upgrade  python3-idle-3.10.0~b2-3.fc35.x86_64                          @test-artifacts
    Upgraded python3-idle-3.9.5-2.fc35.x86_64                              @@System
    Upgrade  python3-libs-3.10.0~b2-3.fc35.x86_64                          @test-artifacts
    Upgraded python3-libs-3.9.5-2.fc35.x86_64                              @@System
    Upgrade  python3-test-3.10.0~b2-3.fc35.x86_64                          @test-artifacts
    Upgraded python3-test-3.9.5-2.fc35.x86_64                              @@System
    Upgrade  python3-tkinter-3.10.0~b2-3.fc35.x86_64                       @test-artifacts
    Upgraded python3-tkinter-3.9.5-2.fc35.x86_64                           @@System
    Upgrade  audit-3.0.1-3.fc35.x86_64                                     @testing-farm-tag-repository
    Upgraded audit-3.0.1-2.fc35.x86_64                                     @@System
    Upgrade  audit-libs-3.0.1-3.fc35.x86_64                                @testing-farm-tag-repository
    Upgraded audit-libs-3.0.1-2.fc35.x86_64                                @@System
    Upgrade  cloud-init-20.4-5.fc35.noarch                                 @testing-farm-tag-repository
    Upgraded cloud-init-20.4-2.fc34.noarch                                 @@System
    Upgrade  dnf-4.7.0-2.fc35.noarch                                       @testing-farm-tag-repository
    Upgraded dnf-4.6.1-1.fc35.noarch                                       @@System
    Upgrade  dnf-data-4.7.0-2.fc35.noarch                                  @testing-farm-tag-repository
    Upgraded dnf-data-4.6.1-1.fc35.noarch                                  @@System
    Upgrade  dnf-plugins-core-4.0.21-2.fc35.noarch                         @testing-farm-tag-repository
    Upgraded dnf-plugins-core-4.0.21-1.fc35.noarch                         @@System
    Upgrade  dnf-utils-4.0.21-2.fc35.noarch                                @testing-farm-tag-repository
    Upgraded dnf-utils-4.0.21-1.fc35.noarch                                @@System
    Upgrade  gpgme-1.15.1-4.fc35.x86_64                                    @testing-farm-tag-repository
    Upgraded gpgme-1.15.1-3.fc35.x86_64                                    @@System
    Upgrade  koji-1.25.0-2.fc35.noarch                                     @testing-farm-tag-repository
    Upgraded koji-1.25.0-1.fc35.noarch                                     @@System
    Upgrade  libcomps-0.1.15-7.fc35.x86_64                                 @testing-farm-tag-repository
    Upgraded libcomps-0.1.15-6.fc34.x86_64                                 @@System
    Upgrade  libdnf-0.62.0-2.fc35.x86_64                                   @testing-farm-tag-repository
    Upgraded libdnf-0.60.0-1.fc35.x86_64                                   @@System
    Upgrade  libselinux-3.2-2.fc35.x86_64                                  @testing-farm-tag-repository
    Upgraded libselinux-3.2-1.fc35.x86_64                                  @@System
    Upgrade  libselinux-utils-3.2-2.fc35.x86_64                            @testing-farm-tag-repository
    Upgraded libselinux-utils-3.2-1.fc35.x86_64                            @@System
    Upgrade  libsemanage-3.2-2.fc35.x86_64                                 @testing-farm-tag-repository
    Upgraded libsemanage-3.2-1.fc35.x86_64                                 @@System
    Upgrade  policycoreutils-3.2-3.fc35.x86_64                             @testing-farm-tag-repository
    Upgraded policycoreutils-3.2-2.fc35.x86_64                             @@System
    Upgrade  python3-attrs-21.2.0-3.fc35.noarch                            @testing-farm-tag-repository
    Upgraded python3-attrs-21.2.0-1.fc35.noarch                            @@System
    Upgrade  python3-audit-3.0.1-3.fc35.x86_64                             @testing-farm-tag-repository
    Upgraded python3-audit-3.0.1-2.fc35.x86_64                             @@System
    Upgrade  python3-babel-2.9.1-3.fc35.noarch                             @testing-farm-tag-repository
    Upgraded python3-babel-2.9.1-1.fc35.noarch                             @@System
    Upgrade  python3-cffi-1.14.5-2.fc35.x86_64                             @testing-farm-tag-repository
    Upgraded python3-cffi-1.14.5-1.fc35.x86_64                             @@System
    Upgrade  python3-chardet-4.0.0-3.fc35.noarch                           @testing-farm-tag-repository
    Upgraded python3-chardet-4.0.0-1.fc34.noarch                           @@System
    Upgrade  python3-configobj-5.0.6-24.fc35.noarch                        @testing-farm-tag-repository
    Upgraded python3-configobj-5.0.6-23.fc34.noarch                        @@System
    Upgrade  python3-cryptography-3.4.7-3.fc35.x86_64                      @testing-farm-tag-repository
    Upgraded python3-cryptography-3.4.7-2.fc35.x86_64                      @@System
    Upgrade  python3-dateutil-1:2.8.1-6.fc35.noarch                        @testing-farm-tag-repository
    Upgraded python3-dateutil-1:2.8.1-3.fc34.noarch                        @@System
    Upgrade  python3-dbus-1.2.16-5.fc35.x86_64                             @testing-farm-tag-repository
    Upgraded python3-dbus-1.2.16-4.fc34.x86_64                             @@System
    Upgrade  python3-decorator-5.0.9-2.fc35.noarch                         @testing-farm-tag-repository
    Upgraded python3-decorator-5.0.9-1.fc35.noarch                         @@System
    Upgrade  python3-distro-1.5.0-6.fc35.noarch                            @testing-farm-tag-repository
    Upgraded python3-distro-1.5.0-5.fc34.noarch                            @@System
    Upgrade  python3-dnf-4.7.0-2.fc35.noarch                               @testing-farm-tag-repository
    Upgraded python3-dnf-4.6.1-1.fc35.noarch                               @@System
    Upgrade  python3-dnf-plugins-core-4.0.21-2.fc35.noarch                 @testing-farm-tag-repository
    Upgraded python3-dnf-plugins-core-4.0.21-1.fc35.noarch                 @@System
    Upgrade  python3-gpg-1.15.1-4.fc35.x86_64                              @testing-farm-tag-repository
    Upgraded python3-gpg-1.15.1-3.fc35.x86_64                              @@System
    Upgrade  python3-gssapi-1.6.9-4.fc35.x86_64                            @testing-farm-tag-repository
    Upgraded python3-gssapi-1.6.9-3.fc34.x86_64                            @@System
    Upgrade  python3-hawkey-0.62.0-2.fc35.x86_64                           @testing-farm-tag-repository
    Upgraded python3-hawkey-0.60.0-1.fc35.x86_64                           @@System
    Upgrade  python3-idna-2.10-4.fc35.noarch                               @testing-farm-tag-repository
    Upgraded python3-idna-2.10-3.fc34.noarch                               @@System
    Upgrade  python3-jinja2-2.11.3-3.fc35.noarch                           @testing-farm-tag-repository
    Upgraded python3-jinja2-2.11.3-1.fc34.noarch                           @@System
    Upgrade  python3-jsonpatch-1.21-16.fc35.noarch                         @testing-farm-tag-repository
    Upgraded python3-jsonpatch-1.21-15.fc35.noarch                         @@System
    Upgrade  python3-jsonpointer-2.0-3.fc35.noarch                         @testing-farm-tag-repository
    Upgraded python3-jsonpointer-2.0-2.fc34.noarch                         @@System
    Upgrade  python3-jsonschema-3.2.0-11.fc35.noarch                       @testing-farm-tag-repository
    Upgraded python3-jsonschema-3.2.0-9.fc34.noarch                        @@System
    Upgrade  python3-jwt+crypto-2.0.1-2.fc35.noarch                        @testing-farm-tag-repository
    Upgraded python3-jwt+crypto-2.0.1-1.fc35.noarch                        @@System
    Upgrade  python3-jwt-2.0.1-2.fc35.noarch                               @testing-farm-tag-repository
    Upgraded python3-jwt-2.0.1-1.fc35.noarch                               @@System
    Upgrade  python3-koji-1.25.0-2.fc35.noarch                             @testing-farm-tag-repository
    Upgraded python3-koji-1.25.0-1.fc35.noarch                             @@System
    Upgrade  python3-libcomps-0.1.15-7.fc35.x86_64                         @testing-farm-tag-repository
    Upgraded python3-libcomps-0.1.15-6.fc34.x86_64                         @@System
    Upgrade  python3-libdnf-0.62.0-2.fc35.x86_64                           @testing-farm-tag-repository
    Upgraded python3-libdnf-0.60.0-1.fc35.x86_64                           @@System
    Upgrade  python3-libselinux-3.2-2.fc35.x86_64                          @testing-farm-tag-repository
    Upgraded python3-libselinux-3.2-1.fc35.x86_64                          @@System
    Upgrade  python3-libsemanage-3.2-2.fc35.x86_64                         @testing-farm-tag-repository
    Upgraded python3-libsemanage-3.2-1.fc35.x86_64                         @@System
    Upgrade  python3-markupsafe-1.1.1-11.fc35.x86_64                       @testing-farm-tag-repository
    Upgraded python3-markupsafe-1.1.1-10.fc34.x86_64                       @@System
    Upgrade  python3-oauthlib+signedtoken-3.0.2-10.fc35.noarch             @testing-farm-tag-repository
    Upgraded python3-oauthlib+signedtoken-3.0.2-9.fc34.noarch              @@System
    Upgrade  python3-oauthlib-3.0.2-10.fc35.noarch                         @testing-farm-tag-repository
    Upgraded python3-oauthlib-3.0.2-9.fc34.noarch                          @@System
    Upgrade  python3-pip-21.1.1-3.fc35.noarch                              @testing-farm-tag-repository
    Upgraded python3-pip-21.1.1-1.fc35.noarch                              @@System
    Upgrade  python3-ply-3.11-12.fc35.noarch                               @testing-farm-tag-repository
    Upgraded python3-ply-3.11-11.fc34.noarch                               @@System
    Upgrade  python3-policycoreutils-3.2-3.fc35.noarch                     @testing-farm-tag-repository
    Upgraded python3-policycoreutils-3.2-2.fc35.noarch                     @@System
    Upgrade  python3-prettytable-0.7.2-26.fc35.noarch                      @testing-farm-tag-repository
    Upgraded python3-prettytable-0.7.2-25.fc34.noarch                      @@System
    Upgrade  python3-pycparser-2.20-4.fc35.noarch                          @testing-farm-tag-repository
    Upgraded python3-pycparser-2.20-3.fc34.noarch                          @@System
    Upgrade  python3-pyrsistent-0.17.3-7.fc35.x86_64                       @testing-farm-tag-repository
    Upgraded python3-pyrsistent-0.17.3-6.fc35.x86_64                       @@System
    Upgrade  python3-pyserial-3.4-11.fc35.noarch                           @testing-farm-tag-repository
    Upgraded python3-pyserial-3.4-10.fc34.noarch                           @@System
    Upgrade  python3-pysocks-1.7.1-10.fc35.noarch                          @testing-farm-tag-repository
    Upgraded python3-pysocks-1.7.1-8.fc34.noarch                           @@System
    Upgrade  python3-pytz-2021.1-3.fc35.noarch                             @testing-farm-tag-repository
    Upgraded python3-pytz-2021.1-2.fc35.noarch                             @@System
    Upgrade  python3-pyyaml-5.4.1-3.fc35.x86_64                            @testing-farm-tag-repository
    Upgraded python3-pyyaml-5.4.1-2.fc35.x86_64                            @@System
    Upgrade  python3-requests-2.25.1-3.fc35.noarch                         @testing-farm-tag-repository
    Upgraded python3-requests-2.25.1-1.fc34.noarch                         @@System
    Upgrade  python3-requests-gssapi-1.2.3-2.fc35.noarch                   @testing-farm-tag-repository
    Upgraded python3-requests-gssapi-1.2.3-1.fc34.noarch                   @@System
    Upgrade  python3-rpm-4.16.90-0.git15395.8.fc35.1.x86_64                @testing-farm-tag-repository
    Upgraded python3-rpm-4.16.90-0.git15395.8.fc35.x86_64                  @@System
    Upgrade  python3-setools-4.4.0-2.fc35.x86_64                           @testing-farm-tag-repository
    Upgraded python3-setools-4.4.0-1.fc35.x86_64                           @@System
    Upgrade  python3-setuptools-56.2.0-4.fc35.noarch                       @testing-farm-tag-repository
    Upgraded python3-setuptools-56.2.0-1.fc35.noarch                       @@System
    Upgrade  python3-six-1.16.0-3.fc35.noarch                              @testing-farm-tag-repository
    Upgraded python3-six-1.16.0-1.fc35.noarch                              @@System
    Upgrade  python3-unbound-1.13.1-7.fc35.x86_64                          @testing-farm-tag-repository
    Upgraded python3-unbound-1.13.1-6.fc35.x86_64                          @@System
    Upgrade  python3-urllib3-1.26.4-2.fc35.noarch                          @testing-farm-tag-repository
    Upgraded python3-urllib3-1.26.4-1.fc35.noarch                          @@System
    Upgrade  rpm-4.16.90-0.git15395.8.fc35.1.x86_64                        @testing-farm-tag-repository
    Upgraded rpm-4.16.90-0.git15395.8.fc35.x86_64                          @@System
    Upgrade  rpm-build-libs-4.16.90-0.git15395.8.fc35.1.x86_64             @testing-farm-tag-repository
    Upgraded rpm-build-libs-4.16.90-0.git15395.8.fc35.x86_64               @@System
    Upgrade  rpm-libs-4.16.90-0.git15395.8.fc35.1.x86_64                   @testing-farm-tag-repository
    Upgraded rpm-libs-4.16.90-0.git15395.8.fc35.x86_64                     @@System
    Upgrade  rpm-plugin-selinux-4.16.90-0.git15395.8.fc35.1.x86_64         @testing-farm-tag-repository
    Upgraded rpm-plugin-selinux-4.16.90-0.git15395.8.fc35.x86_64           @@System
    Upgrade  rpm-plugin-systemd-inhibit-4.16.90-0.git15395.8.fc35.1.x86_64 @testing-farm-tag-repository
    Upgraded rpm-plugin-systemd-inhibit-4.16.90-0.git15395.8.fc35.x86_64   @@System
    Upgrade  rpm-sign-libs-4.16.90-0.git15395.8.fc35.1.x86_64              @testing-farm-tag-repository
    Upgraded rpm-sign-libs-4.16.90-0.git15395.8.fc35.x86_64                @@System
    Upgrade  unbound-libs-1.13.1-7.fc35.x86_64                             @testing-farm-tag-repository
    Upgraded unbound-libs-1.13.1-6.fc35.x86_64                             @@System
    Upgrade  yum-4.7.0-2.fc35.noarch                                       @testing-farm-tag-repository
    Upgraded yum-4.6.1-1.fc35.noarch                                       @@System

Seems Ok? I'll restart the previously failed checks.

I still see the same problem. I've added rpm -qa to the actual tests in the affected PRs. In about an hour, we should see.

https://src.fedoraproject.org/rpms/python3.9/pull-request/71 has finished.

I see python3-devel-3.9.5-2.fc35.x86_64, python3-libs-3.9.5-2.fc35.x86_64 etc in the output of rpm -qa. I don't see the built python3.9-3.9.5-3.fc35.x86_64 in there.

The built package is not installed during tests.

@churchyard sorry, I am super confused, looks related somehow to python 3.10, but I fail to find what is going on, according to the dnf command ^ the package should have been installed? We even verified it?

http://artifacts.dev.testing-farm.io/4b8328f7-8372-4557-afe1-edcc277e9d0d/guest-setup-9a4c3bb4-1e0b-4790-b20e-75df591be3de/artifact-installation-9a4c3bb4-1e0b-4790-b20e-75df591be3de/5-Verify-all-packages-installed.txt

Will it help if I give you access to the machine to investigate?

Will it help if I give you access to the machine to investigate?

Not really, the rpm -qa command is the only thing I've needed to verify. It would help to see all the dnf/rpm installation logs in order.

https://src.fedoraproject.org/rpms/python3.10/pull-request/58 also finished. The rpm -qa output contains:

python3.10-debugsource-3.10.0~b2-3.fc35.x86_64
python3.10-debuginfo-3.10.0~b2-3.fc35.x86_64
python3-3.9.5-2.fc35.x86_64

It does not contain the expected python3.10-3.10.0~b2-3.fc35.x86_64 package.

http://artifacts.dev.testing-farm.io/12a878ac-1595-4164-a047-08fbff3dee9e/work-tests.ymlMc8Mv6/ansible-output.txt

changed: [sut] => (item=python3-tox) => {
    "ansible_loop_var": "item",
    "attempts": 1,
    "changed": true,
    "cmd": "dnf install --assumeyes --allowerasing python3-tox\n",
    "delta": "0:01:10.197796",
    "end": "2021-06-09 14:22:24.161209",
    "item": "python3-tox",
    "rc": 0,
    "start": "2021-06-09 14:21:13.963413"
}

STDOUT:

Last metadata expiration check: 0:01:44 ago on Wed 09 Jun 2021 02:19:31 PM UTC.
Dependencies resolved.
================================================================================
 Package                      Arch   Version                      Repo     Size
================================================================================
Installing:
 tox                          noarch 3.23.0-2.fc35                rawhide 170 k
Installing dependencies:
 annobin-docs                 noarch 9.73-2.fc35                  rawhide  77 k
 annobin-plugin-gcc           x86_64 9.73-2.fc35                  rawhide  41 k
 dwz                          x86_64 0.14-1.fc35                  rawhide 129 k
 efi-srpm-macros              noarch 5-2.fc35                     rawhide  21 k
 emacs-filesystem             noarch 1:27.2-3.fc35                rawhide 8.5 k
 fonts-srpm-macros            noarch 1:2.0.5-5.fc34               rawhide  27 k
 fpc-srpm-macros              noarch 1.3-3.fc34                   rawhide 7.7 k
 ghc-srpm-macros              noarch 1.5.0-4.fc34                 rawhide 7.8 k
 gnat-srpm-macros             noarch 4-13.fc34                    rawhide 8.3 k
 go-srpm-macros               noarch 3.0.11-1.fc35                rawhide  26 k
 kernel-srpm-macros           noarch 1.0-4.fc34                   rawhide 7.3 k
 lua-srpm-macros              noarch 1-4.fc34                     rawhide 8.3 k
 nim-srpm-macros              noarch 3-4.fc34                     rawhide 8.4 k
 ocaml-srpm-macros            noarch 6-4.fc34                     rawhide 7.8 k
 openblas-srpm-macros         noarch 2-9.fc34                     rawhide 7.4 k
 perl-srpm-macros             noarch 1-41.fc35                    rawhide 8.4 k
 pypy                         x86_64 7.3.4-1.fc35                 rawhide  12 k
 pypy-libs                    x86_64 7.3.4-1.fc35                 rawhide  19 M
 pypy3                        x86_64 7.3.4-1.fc35                 rawhide  11 M
 pypy3-libs                   x86_64 7.3.4-1.fc35                 rawhide 6.9 M
 python-srpm-macros           noarch 3.9-38.fc35                  rawhide  21 k
 python-wheel-wheel           noarch 1:0.36.2-2.fc34              rawhide  42 k
 python3-appdirs              noarch 1.4.4-2.fc34                 rawhide  22 k
 python3-distlib              noarch 0.3.1-4.fc34                 rawhide 187 k
 python3-filelock             noarch 3.0.12-9.fc34                rawhide  22 k
 python3-packaging            noarch 20.9-1.fc34                  rawhide  70 k
 python3-pluggy               noarch 0.13.1-3.fc34                rawhide  38 k
 python3-py                   noarch 1.10.0-2.fc34                rawhide 429 k
 python3-pyparsing            noarch 2.4.7-6.fc35                 rawhide 150 k
 python3-toml                 noarch 0.10.2-2.fc34                rawhide  39 k
 python3-virtualenv           noarch 20.4.7-1.fc35                rawhide 229 k
 qt5-srpm-macros              noarch 5.15.2-2.fc34                rawhide 8.4 k
 redhat-rpm-config            noarch 186-1.fc35                   rawhide  67 k
 rust-srpm-macros             noarch 17-2.fc34                    rawhide 9.8 k
 tix                          x86_64 1:8.4.3-31.fc34              rawhide 247 k
 unzip                        x86_64 6.0-52.fc35                  rawhide 180 k
 zip                          x86_64 3.0-28.fc34                  rawhide 260 k
Installing weak dependencies:
 pypy-devel                   x86_64 7.3.4-1.fc35                 rawhide  67 k
 pypy3-devel                  x86_64 7.3.4-1.fc35                 rawhide  59 k
 python2.7                    x86_64 2.7.18-11.fc35               rawhide  13 M
 python3.5                    x86_64 3.5.10-6.fc35                rawhide  18 M
 python3.6                    x86_64 3.6.13-3.fc35                rawhide  16 M
 python3.7                    x86_64 3.7.10-2.fc35                rawhide  19 M
 python3.8                    x86_64 3.8.10-1.fc35                rawhide  16 M
Downgrading:
 audit                        x86_64 3.0.1-2.fc35                 rawhide 251 k
 audit-libs                   x86_64 3.0.1-2.fc35                 rawhide 115 k
 cloud-init                   noarch 20.4-2.fc34                  rawhide 1.0 M
 dnf                          noarch 4.6.1-1.fc35                 rawhide 447 k
 dnf-data                     noarch 4.6.1-1.fc35                 rawhide  48 k
 dnf-plugins-core             noarch 4.0.21-1.fc35                rawhide  35 k
 dnf-utils                    noarch 4.0.21-1.fc35                rawhide  38 k
 gpgme                        x86_64 1.15.1-3.fc35                rawhide 207 k
 koji                         noarch 1.25.0-1.fc35                rawhide 186 k
 libcomps                     x86_64 0.1.15-6.fc34                rawhide  79 k
 libdnf                       x86_64 0.60.0-1.fc35                rawhide 634 k
 libselinux                   x86_64 3.2-1.fc35                   rawhide  83 k
 libselinux-utils             x86_64 3.2-1.fc35                   rawhide 160 k
 libsemanage                  x86_64 3.2-1.fc35                   rawhide 116 k
 policycoreutils              x86_64 3.2-2.fc35                   rawhide 199 k
 python-unversioned-command   noarch 3.9.5-2.fc35                 rawhide  12 k
 python3                      x86_64 3.9.5-2.fc35                 rawhide  28 k
     replacing  python3.9.x86_64 3.9.5-3.fc35
 python3-attrs                noarch 21.2.0-1.fc35                rawhide  85 k
 python3-audit                x86_64 3.0.1-2.fc35                 rawhide  86 k
 python3-babel                noarch 2.9.1-1.fc35                 rawhide 5.8 M
 python3-cffi                 x86_64 1.14.5-1.fc35                rawhide 244 k
 python3-chardet              noarch 4.0.0-1.fc34                 rawhide 214 k
 python3-configobj            noarch 5.0.6-23.fc34                rawhide  62 k
 python3-cryptography         x86_64 3.4.7-2.fc35                 rawhide 700 k
 python3-dateutil             noarch 1:2.8.1-3.fc34               rawhide 289 k
 python3-dbus                 x86_64 1.2.16-4.fc34                rawhide 133 k
 python3-debug                x86_64 3.9.5-2.fc35                 rawhide 3.0 M
 python3-decorator            noarch 5.0.9-1.fc35                 rawhide  27 k
 python3-devel                x86_64 3.9.5-2.fc35                 rawhide 206 k
 python3-distro               noarch 1.5.0-5.fc34                 rawhide  36 k
 python3-dnf                  noarch 4.6.1-1.fc35                 rawhide 415 k
 python3-dnf-plugins-core     noarch 4.0.21-1.fc35                rawhide 197 k
 python3-gpg                  x86_64 1.15.1-3.fc35                rawhide 261 k
 python3-gssapi               x86_64 1.6.9-3.fc34                 rawhide 462 k
 python3-hawkey               x86_64 0.60.0-1.fc35                rawhide 116 k
 python3-idle                 x86_64 3.9.5-2.fc35                 rawhide 735 k
 python3-idna                 noarch 2.10-3.fc34                  rawhide  99 k
 python3-jinja2               noarch 2.11.3-1.fc34                rawhide 493 k
 python3-jsonpatch            noarch 1.21-15.fc35                 rawhide  25 k
 python3-jsonpointer          noarch 2.0-2.fc34                   rawhide  18 k
 python3-jsonschema           noarch 3.2.0-9.fc34                 rawhide 108 k
 python3-jwt                  noarch 2.0.1-1.fc35                 rawhide  38 k
 python3-jwt+crypto           noarch 2.0.1-1.fc35                 rawhide 8.8 k
 python3-koji                 noarch 1.25.0-1.fc35                rawhide 294 k
 python3-libcomps             x86_64 0.1.15-6.fc34                rawhide  51 k
 python3-libdnf               x86_64 0.60.0-1.fc35                rawhide 795 k
 python3-libs                 x86_64 3.9.5-2.fc35                 rawhide 7.3 M
 python3-libselinux           x86_64 3.2-1.fc35                   rawhide 187 k
 python3-libsemanage          x86_64 3.2-1.fc35                   rawhide  83 k
 python3-markupsafe           x86_64 1.1.1-10.fc34                rawhide  32 k
 python3-oauthlib             noarch 3.0.2-9.fc34                 rawhide 169 k
 python3-oauthlib+signedtoken noarch 3.0.2-9.fc34                 rawhide 8.6 k
 python3-pip                  noarch 21.1.1-1.fc35                rawhide 1.8 M
 python3-ply                  noarch 3.11-11.fc34                 rawhide 103 k
 python3-policycoreutils      noarch 3.2-2.fc35                   rawhide 2.0 M
 python3-prettytable          noarch 0.7.2-25.fc34                rawhide  42 k
 python3-pycparser            noarch 2.20-3.fc34                  rawhide 126 k
 python3-pyrsistent           x86_64 0.17.3-6.fc35                rawhide 103 k
 python3-pyserial             noarch 3.4-10.fc34                  rawhide 159 k
 python3-pysocks              noarch 1.7.1-8.fc34                 rawhide  35 k
 python3-pytz                 noarch 2021.1-2.fc35                rawhide  49 k
 python3-pyyaml               x86_64 5.4.1-2.fc35                 rawhide 194 k
 python3-requests             noarch 2.25.1-1.fc34                rawhide 114 k
 python3-requests-gssapi      noarch 1.2.3-1.fc34                 rawhide  27 k
 python3-rpm                  x86_64 4.16.90-0.git15395.8.fc35    rawhide  94 k
 python3-setools              x86_64 4.4.0-1.fc35                 rawhide 555 k
 python3-setuptools           noarch 56.2.0-1.fc35                rawhide 881 k
 python3-six                  noarch 1.16.0-1.fc35                rawhide  36 k
 python3-test                 x86_64 3.9.5-2.fc35                 rawhide 9.2 M
 python3-tkinter              x86_64 3.9.5-2.fc35                 rawhide 311 k
 python3-unbound              x86_64 1.13.1-6.fc35                rawhide 102 k
 python3-urllib3              noarch 1.26.4-1.fc35                rawhide 188 k
 rpm                          x86_64 4.16.90-0.git15395.8.fc35    rawhide 537 k
 rpm-build-libs               x86_64 4.16.90-0.git15395.8.fc35    rawhide  96 k
 rpm-libs                     x86_64 4.16.90-0.git15395.8.fc35    rawhide 317 k
 rpm-plugin-selinux           x86_64 4.16.90-0.git15395.8.fc35    rawhide  23 k
 rpm-plugin-systemd-inhibit   x86_64 4.16.90-0.git15395.8.fc35    rawhide  23 k
 rpm-sign-libs                x86_64 4.16.90-0.git15395.8.fc35    rawhide  30 k
 unbound-libs                 x86_64 1.13.1-6.fc35                rawhide 529 k
 yum                          noarch 4.6.1-1.fc35                 rawhide  45 k

Transaction Summary
================================================================================
Install    45 Packages
Downgrade  80 Packages

Many packages in that log are installed from testing-farm-tag-repository or test-artifacts repos.
But suddenly, tox is installed from "rawhide" and downgrades the world.

Seems like the repo switch happens when dnf is upgraded. How is the testing-farm-tag-repository and test-artifacts repo configured?

The tag repository for rawhide is:

[testing-farm-tag-repository]
name=Tag repository for rawhide
baseurl=https://kojipkgs.fedoraproject.org/repos/rawhide/latest/x86_64
gpgcheck=0
enabled=1
priority=999
skip_if_unavailable=True

The test artifacts is a simple repo created from all packages from the tested build, but with default priority :(

I guess I get it now, I believe the priority needs to change, tag repository should have lower priority then the test-artifacts repo, right? :facepalm:
Edited 2 years ago by mvadkert

@churchyard I fixed the priority, test-artifacts has now higher priority then tag-repository. let's retry the test.

https://dnf.readthedocs.io/en/latest/conf_ref.html

The priority value of this repository, default is 99. If there is more than one candidate package for a particular operation, the one from a repo with the lowest priority value is picked, possibly despite being less convenient otherwise (e.g. by being a lower version).

I guess the priority needs to be lower.
Edited 2 years ago by churchyard

I'd use:

  • test-artifacts, priority 1
  • testing-farm-tag-repository, priority 9
  • regular fedora repos, priority default (99)

Nevertheless, my original idea was: Where on disk is this repo defined and configured? Is it possible that updating dnf will override/delete the config?
Edited 2 years ago by churchyard

https://src.fedoraproject.org/rpms/poetry/pull-request/12 clearly runs the tests on Python 3.9 as well. Should ave been Python 3.10.

yeah, I messed up ...

thanks, I used silly values, should have checked the docs

I believe, it is now set to the advised values:

  • test-artifacts, priority 1
  • testing-farm-tag-repository, priority 9
  • regular fedora repos, priority default (99)
diff --git a/citool-config/dev/guest-setup/post-artifact-installation/create_test_repository.yml b/citool-config/dev/guest-setup/post-artifact-installation/create_test_repository.yml
index 10bcc94..825fe04 100644
--- a/citool-config/dev/guest-setup/post-artifact-installation/create_test_repository.yml
+++ b/citool-config/dev/guest-setup/post-artifact-installation/create_test_repository.yml
@@ -26,7 +26,7 @@
         name: test-artifacts
         description: Test artifacts repository
         baseurl: file:///var/share/test-artifacts
-        priority: 900
+        priority: 1
         gpgcheck: no

   when: rpms_available.rc == 0
diff --git a/citool-config/dev/guest-setup/pre-artifact-installation/templates/tag.repo.j2 b/citool-config/dev/guest-setup/pre-artifact-installation/templates/tag.repo.j2
index 2a3a3e9..1ff17c5 100644
--- a/citool-config/dev/guest-setup/pre-artifact-installation/templates/tag.repo.j2
+++ b/citool-config/dev/guest-setup/pre-artifact-installation/templates/tag.repo.j2
@@ -3,5 +3,5 @@ name=Tag repository for {{ tag_repository_name }}
 baseurl={{ tag_repository_url }}
 gpgcheck=0
 enabled=1
-priority=800
+priority=9
 skip_if_unavailable=True

It seems that the proper packages were installed in https://src.fedoraproject.org/rpms/python3.10/pull-request/58 so this particular instance of the problem is most likely fixed. Thanks. (Still waiting for python3.9 and poetry PR to finish to confirm 100 %.)

However had there been a dependency resolution issue when installing some of the needed packages, I am not sure the tested package would not silently be reinstalled (e.g. downgraded).

@churchyard thanks for staying with me on the issue, took me a while to realize the problem. Funny enough, it was there for a year :(

However had there been a dependency resolution issue when installing some of the needed packages, I am not sure the tested package would not silently be reinstalled (e.g. downgraded).

If the installation is not successful, i.e. rpm -q NVR for all packages form the build fails at the end, not tests are run.

If the installation is not successful, i.e. rpm -q NVR for all packages form the build fails at the end, not tests are run.

If this is not a newly added check, then the previous failures have shown that it is not the case.

@churchyard will investigate more, but rpm -q NVR should be enough to verify ... it returns 1 if some of the packages was not found ...

I do believe this is now resolved. The rpm -q for verification is working, verified manually.

Metadata Update from @mvadkert:
- Issue status updated to: Closed (was: Open)
2 years ago

Login to comment on this ticket.

Metadata
None
None
None
None
Medium
Powered by Pagure 5.13.3
Documentation • File an Issue • About • SSH Hostkey/Fingerprint
© Red Hat, Inc. and others.