dusty / failed-composes

Clone
Source Code
GIT

#194 Fedora-Rawhide-20180424.n.0 DOOMED
Opened 6 years ago by dustymabe. Modified 5 years ago

Open
Close issue as:
fixed invalid timeout killed known_issue

pungi.global.log

[INFO    ] [FAIL] Buildinstall (variant Everything, arch ppc64) failed, but going on anyway.
[INFO    ] Runroot task failed: 26532455. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/ppc64/buildinstall-Everything.ppc64.log for more details.

[INFO    ] [FAIL] Buildinstall (variant Server, arch ppc64) failed, but going on anyway.
[INFO    ] Runroot task failed: 26532459. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/ppc64/buildinstall-Server.ppc64.log for more details.

[INFO    ] [FAIL] Ostree (variant AtomicHost, arch x86_64) failed, but going on anyway.
[INFO    ] Runroot task failed: 26535000. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/x86_64/AtomicHost/ostree-3/runroot.log for more details.

[INFO    ] [FAIL] Ostree (variant AtomicWorkstation, arch x86_64) failed, but going on anyway.
[INFO    ] Runroot task failed: 26535001. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/x86_64/AtomicWorkstation/ostree-4/runroot.log for more details.

[INFO    ] [FAIL] Ostree (variant AtomicHost, arch ppc64le) failed, but going on anyway.
[INFO    ] Runroot task failed: 26534999. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/ppc64le/AtomicHost/ostree-2/runroot.log for more details.

[INFO    ] [FAIL] Ostree (variant AtomicHost, arch aarch64) failed, but going on anyway.
[INFO    ] Runroot task failed: 26534998. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/aarch64/AtomicHost/ostree-1/runroot.log for more details.

[LIVE_MEDIA      ] [INFO    ] [FAIL] Live media (variant Labs, arch *, subvariant Scientific_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [INFO    ] Live media task failed: 26535823. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/i386-x86_64/livemedia-Labs-Scientific_KDE.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [INFO    ] [FAIL] Live media (variant Labs, arch *, subvariant Astronomy_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [INFO    ] Live media task failed: 26535810. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/i386-x86_64/livemedia-Labs-Astronomy_KDE.i386-x86_64.log for more details.

[IMAGE_BUILD     ] [INFO    ] [FAIL] Image build (variant AtomicHost, arch *, subvariant AtomicHost) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] ImageBuild task failed: 26535811. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/x86_64/imagebuild-AtomicHost-AtomicHost-vagrant-libvirt-vagrant-virtualbox.x86_64.log for more details.

[IMAGE_BUILD     ] [INFO    ] [FAIL] Image build (variant AtomicHost, arch *, subvariant AtomicHost) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] ImageBuild task failed: 26535806. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/aarch64-ppc64le-x86_64/imagebuild-AtomicHost-AtomicHost-qcow2-raw-xz.aarch64-ppc64le-x86_64.log for more details.

[IMAGE_BUILD     ] [INFO    ] [FAIL] Image build (variant Cloud, arch *, subvariant Cloud_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] ImageBuild task failed: 26535824. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/x86_64/imagebuild-Cloud-Cloud_Base-vagrant-libvirt-vagrant-virtualbox.x86_64.log for more details.

[IMAGE_BUILD     ] [INFO    ] [FAIL] Image build (variant Labs, arch *, subvariant Python_Classroom) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] ImageBuild task failed: 26535857. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/i386-x86_64/imagebuild-Labs-Python_Classroom-vagrant-libvirt-vagrant-virtualbox.i386-x86_64.log for more details.

[IMAGE_BUILD     ] [INFO    ] [FAIL] Image build (variant Workstation, arch *, subvariant Workstation) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] ImageBuild task failed: 26535868. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/aarch64/imagebuild-Workstation-Workstation-raw-xz.aarch64.log for more details.

[IMAGE_BUILD     ] [INFO    ] [FAIL] Image build (variant Spins, arch *, subvariant Minimal) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] ImageBuild task failed: 26535865. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/aarch64/imagebuild-Spins-Minimal-raw-xz.aarch64.log for more details.

[IMAGE_BUILD     ] [INFO    ] [FAIL] Image build (variant Server, arch *, subvariant Server) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] ImageBuild task failed: 26535860. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/aarch64/imagebuild-Server-Server-raw-xz.aarch64.log for more details.

[IMAGE_BUILD     ] [INFO    ] [FAIL] Image build (variant Container, arch *, subvariant Container_Minimal_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] ImageBuild task failed: 26535844. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/aarch64-armhfp-ppc64le-s390x-x86_64/imagebuild-Container-Container_Minimal_Base-docker.aarch64-armhfp-ppc64le-s390x-x86_64.log for more details.

[IMAGE_BUILD     ] [INFO    ] [FAIL] Image build (variant Container, arch *, subvariant Container_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] ImageBuild task failed: 26535836. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/aarch64-armhfp-ppc64le-s390x-x86_64/imagebuild-Container-Container_Base-docker.aarch64-armhfp-ppc64le-s390x-x86_64.log for more details.
  • Compose run failed because: - 26535819
[ERROR   ] Compose run failed: ImageBuild task failed: 26535819. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/aarch64-ppc64-ppc64le-s390x-x86_64/imagebuild-Cloud-Cloud_Base-qcow2-raw-xz.aarch64-ppc64-ppc64le-s390x-x86_64.log for more details.

pungi.global.log

26532455

[INFO ] [FAIL] Ostree (variant AtomicHost, arch x86_64) failed, but going on anyway.
[INFO ] Runroot task failed: 26535000. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/x86_64/AtomicHost/ostree-3/runroot.log for more details.

26535001

[INFO ] [FAIL] Ostree (variant AtomicWorkstation, arch x86_64) failed, but going on anyway.
[INFO ] Runroot task failed: 26535001. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/x86_64/AtomicWorkstation/ostree-4/runroot.log for more details.

26534999

[INFO ] [FAIL] Ostree (variant AtomicHost, arch ppc64le) failed, but going on anyway.
[INFO ] Runroot task failed: 26534999. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/ppc64le/AtomicHost/ostree-2/runroot.log for more details.

26534998

[INFO ] [FAIL] Ostree (variant AtomicHost, arch aarch64) failed, but going on anyway.
[INFO ] Runroot task failed: 26534998. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20180424.n.0/logs/aarch64/AtomicHost/ostree-1/runroot.log for more details.

ostree compose failure for all arches are common and appears to be related to selinux. Error log:

/proc/self/fd/13/usr/etc/selinux/targeted/contexts/files/file_contexts: line 3219 has invalid context system_u:object_r:root_t:s0
error: Finalizing rootfs: SELinux postprocess: With policy root '/proc/self/fd/13/usr/etc/selinux/targeted': Failed to look up context of /: No such file or directory
Traceback (most recent call last):
  File "/usr/bin/pungi-make-ostree", line 15, in <module>
    ostree.main()
  File "/usr/lib/python3.6/site-packages/pungi/ostree/__init__.py", line 93, in main
    func()
  File "/usr/lib/python3.6/site-packages/pungi/ostree/tree.py", line 108, in run
    self._make_tree()
  File "/usr/lib/python3.6/site-packages/pungi/ostree/tree.py", line 42, in _make_tree
    shortcuts.run(cmd, show_cmd=True, stdout=True, logfile=log_file)

While comparing the packages installed from yesterday's compose (20180423.n.0 which was fine ) against today ( 20180424.n.0 ), I see libselinux, policycoreutils and checkpolicy packages has been updated to 2.8-rc1. Can these package updates be the cause of ostree compose failure?

Yeah, almost certainly a regression in either libselinux or selinux-policy packages. Hard to say for sure which one, although the error message:

usr/etc/selinux/targeted/contexts/files/file_contexts: line 3219 has invalid context system_u:object_r:root_t:s0

Makes me think this is in the policy package.

I'd ping the people who did those pkg uploads and see what they think first; if it's not obvious the next step is to set up a reproducer environment which will involve configuring a container to use the packages from that compose. I'd look at the resulting file_contexts files to see if there's something obviously invalid.

@plautrba ^^^

Should there be a policy that updates which break composes get reverted after a while, maybe ?

That might be a bit too inflexible, I think. It's sort of an informal policy already, in that releng is fairly gung ho about untagging compose-breaking changes that we can't figure out a fix for.

Login to comment on this ticket.

Metadata
None
None
None
None
Powered by Pagure 5.13.3
Documentation • File an Issue • About • SSH Hostkey/Fingerprint
© Red Hat, Inc. and others.