#3058 Fedora-Rawhide-20220203.n.1 DOOMED
Closed by humaton. Opened by releng.

pungi.global.log

[ERROR   ] [FAIL] Ostree (variant Silverblue, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: 82346703. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20220203.n.1/logs/ppc64le/Silverblue/ostree-5/runroot.log for more details.
[ERROR   ] [FAIL] Ostree (variant Silverblue, arch x86_64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 82346702. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20220203.n.1/logs/x86_64/Silverblue/ostree-4/runroot.log for more details.
[ERROR   ] [FAIL] Ostree (variant Silverblue, arch aarch64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 82346706. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20220203.n.1/logs/aarch64/Silverblue/ostree-6/runroot.log for more details.
[ERROR   ] [FAIL] Ostree (variant Kinoite, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: 82346705. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20220203.n.1/logs/ppc64le/Kinoite/ostree-2/runroot.log for more details.
[ERROR   ] [FAIL] Ostree (variant Kinoite, arch x86_64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 82346704. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20220203.n.1/logs/x86_64/Kinoite/ostree-1/runroot.log for more details.
[ERROR   ] [FAIL] Ostree (variant Kinoite, arch aarch64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 82346701. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20220203.n.1/logs/aarch64/Kinoite/ostree-3/runroot.log for more details.
  • Compose run failed because: - No Task ID, look at log statement
[ERROR   ] Compose run failed: argument obsoletes: Expected Modulemd.Obsoletes, but got list

Compose Total time: 2:59:21
Compose phase INIT time: 0:00:27.
Compose phase PKGSET time: 0:26:34.
Compose phase WEAVER: FAILED.
Compose phase BUILDINSTALL time: 2:20:23.
Compose phase GATHER time: 2:27:08.
Compose phase OSTREE time: 0:12:32.
Compose phase OSTREE_INSTALLER time: 0:55:54.
Compose phase CREATEREPO: FAILED.


@ppisar this looks related to the module obsoletes? Can you see whats going wrong here?
Or @lsedlar as I also upgraded pungi, which may have been a mistake. :(

Actually I guess @fivaldi was working on this?

Yes, fivaldi works on adding obsoletes support to pungi.

A relevant log is at https://kojipkgs.fedoraproject.org/compose/rawhide/Fedora-Rawhide-20220203.n.1/logs/global/traceback.global.log:wine_glass:

TypeError: argument obsoletes: Expected Modulemd.Obsoletes, but got list
Frame collect_module_obsoletes in /usr/lib/python3.10/site-packages/pungi/module_util.py at line 91
<CODE>
      84     mod_index = mod_index or Modulemd.ModuleIndex()
      85 
      86     for module_name, obsoletes in iter_module_defaults_or_obsoletes(
      87         obsoletes_dir, obsoletes=True
      88     ):
      89         for obsolete in obsoletes:
      90             if not modules_to_load or module_name in modules_to_load:
-->   91                 mod_index.add_obsoletes(obsoletes)
      92 
      93     return mod_index
</CODE>
<LOCALS>
           mod_index = <Modulemd.ModuleIndex object at 0x7f01a40fae40 (ModulemdModuleIndex at 0x7f0484338f90)>
         module_name = 'perl'
     modules_to_load = {'perl-Date-Manip', 'subversion', 'sway', 'nginx', 'perl-YAML', 'ghc', 'perl-App-cpanminus', 'perl-XML-Parser', 'varnish', 'nodejs', 'cri-o', 'perl-DBD-Pg', 'perl-DBI', 'perl', 'swig', 'perl-FCGI', 'p
            obsolete = <Modulemd.Obsoletes object at 0x7f00c0fe4a00 (ModulemdObsoletes at 0x7f024c0268b0)>
           obsoletes = [<Modulemd.Obsoletes object at 0x7f00c0fe4a00 (ModulemdObsoletes at 0x7f024c0268b0)>]
       obsoletes_dir = '/mnt/koji/compose/rawhide/Fedora-Rawhide-20220203.n.1/work/global/module_obsoletes'
</LOCALS>

I haven't read the code, but I think it's a typo. There might be "mod_index.add_obsoletes(obsolete)" instead of "mod_index.add_obsoletes(obsoletes)".

However, there are other non-module failures in x86_64 task log, e.g. https://kojipkgs.fedoraproject.org//work/tasks/6702/82346702/runroot.log:

Installing packages: 45%
/var/tmp/rpm-tmp.I1PHpp: line 2: ln: command not found
Detected system with nfsnobody defined, creating /etc/systemd/dont-synthesize-nobody
Installing packages: 49%
[...]
Initializing rootfs
Moving /usr to target
Copying toplevel compat symlinks
Recompiling policy
Migrating /usr/etc/passwd to /usr/lib/
Migrating /usr/etc/group to /usr/lib/
error: Finalizing rootfs: Adding altfiles to /etc/nsswitch.conf: Too many levels of symbolic links (os error 40)

@kevin, can you try correcting /usr/lib/python3.10/site-packages/pungi/module_util.py:91 line on that system and running pungi again?

Thanks, @ppisar, it really should be obsolete, not obsoletes

TypeError: argument obsoletes: Expected Modulemd.Obsoletes, but got list
Frame collect_module_obsoletes in /usr/lib/python3.10/site-packages/pungi/module_util.py at line 91
<CODE>
      84     mod_index = mod_index or Modulemd.ModuleIndex()
      85 
      86     for module_name, obsoletes in iter_module_defaults_or_obsoletes(
      87         obsoletes_dir, obsoletes=True
      88     ):
      89         for obsolete in obsoletes:
      90             if not modules_to_load or module_name in modules_to_load:
-->   91                 mod_index.add_obsoletes(obsoletes)
      92 
      93     return mod_index
</CODE>

I wonder how this could pass the testing we've done..
Please for testing the change, so we can patch pungi...

The patch is included in pungi-4.3.3-3.
https://bodhi.fedoraproject.org/updates/FEDORA-2022-836ef78ac2
https://bodhi.fedoraproject.org/updates/FEDORA-2022-310e303f6b

I am updating the compose box with this new update and will run another compose after https://koji.fedoraproject.org/koji/buildinfo?buildID=1912597 is built as it fixes another dep issue.

Metadata Update from @humaton:
- Issue status updated to: Closed (was: Open)

Metadata