#1529 Fedora-Rawhide-20190227.n.0 DOOMED
Opened 5 years ago by dustymabe. Modified 5 years ago

pungi.global.log

[ERROR   ] [FAIL] Ostree (variant Silverblue, arch x86_64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 33076759. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/x86_64/Silverblue/ostree-1/runroot.log for more details.
[OSTREE_INSTALLER] [ERROR   ] [FAIL] Ostree installer (variant Silverblue, arch x86_64) failed, but going on anyway.
[OSTREE_INSTALLER] [ERROR   ] Runroot task failed: 33076774. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/x86_64/Silverblue/ostree_installer-1/runroot.log for more details.
  • No Task ID, look at log statement
[CREATEISO       ] [ERROR   ] [FAIL] Iso (variant Server, arch ppc64le) failed, but going on anyway.
[CREATEISO       ] [ERROR   ] Runroot task failed: None. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/ppc64le/createiso-Fedora-Server-dvd-ppc64le-Rawhide-20190227.n.0.iso.ppc64le.log for more details.
[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Server, arch armhfp, subvariant Server) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 33078472. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/armhfp/liveimage-Fedora-Server-armhfp-Rawhide-20190227.n.0.armhfp.log for more details.
[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Workstation, arch armhfp, subvariant Workstation) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 33078522. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/armhfp/liveimage-Fedora-Workstation-armhfp-Rawhide-20190227.n.0.armhfp.log for more details.
[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Spins, arch armhfp, subvariant SoaS) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 33078500. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/armhfp/liveimage-Fedora-SoaS-armhfp-Rawhide-20190227.n.0.armhfp.log for more details.
[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Spins, arch armhfp, subvariant Mate) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 33078489. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/armhfp/liveimage-Fedora-Mate-armhfp-Rawhide-20190227.n.0.armhfp.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Astronomy_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078477. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Labs-Astronomy_KDE.i386-x86_64.log for more details.
[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Spins, arch armhfp, subvariant LXDE) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 33078483. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/armhfp/liveimage-Fedora-LXDE-armhfp-Rawhide-20190227.n.0.armhfp.log for more details.
[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Labs, arch armhfp, subvariant Python_Classroom) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 33078470. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/armhfp/liveimage-Fedora-Python-Classroom-armhfp-Rawhide-20190227.n.0.armhfp.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Design_suite) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078488. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Labs-Design_suite.i386-x86_64.log for more details.
[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Spins, arch armhfp, subvariant KDE) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 33078474. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/armhfp/liveimage-Fedora-KDE-armhfp-Rawhide-20190227.n.0.armhfp.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Games) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078498. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Labs-Games.i386-x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Scientific_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078492. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Labs-Scientific_KDE.i386-x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Security) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078503. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Labs-Security.i386-x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Robotics) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078520. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Labs-Robotics.i386-x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Jam_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078511. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Labs-Jam_KDE.i386-x86_64.log for more details.
[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Spins, arch armhfp, subvariant LXQt) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 33078515. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/armhfp/liveimage-Fedora-LXQt-armhfp-Rawhide-20190227.n.0.armhfp.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Python_Classroom) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078528. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Labs-Python_Classroom.i386-x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant Xfce) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078540. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Spins-Xfce.i386-x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant Cinnamon) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078545. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Spins-Cinnamon.i386-x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant SoaS) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078542. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Spins-SoaS.i386-x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant Mate) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078554. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Spins-Mate.i386-x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant LXDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078552. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Spins-LXDE.i386-x86_64.log for more details.
[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant LXQt) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 33078561. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/livemedia-Spins-LXQt.i386-x86_64.log for more details.
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Spins, arch *, subvariant Minimal) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 33078519. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/aarch64/imagebuild-Spins-Minimal-raw-xz.aarch64.log for more details.
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Cloud, arch *, subvariant Cloud_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 33078476. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/x86_64/imagebuild-Cloud-Cloud_Base-vagrant-libvirt-vagrant-virtualbox.x86_64.log for more details.
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Labs, arch *, subvariant Python_Classroom) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 33078497. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/imagebuild-Labs-Python_Classroom-vagrant-libvirt-vagrant-virtualbox.i386-x86_64.log for more details.
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Workstation, arch *, subvariant Workstation) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 33078527. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/aarch64/imagebuild-Workstation-Workstation-raw-xz.aarch64.log for more details.
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Server, arch *, subvariant Server) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 33078506. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/aarch64/imagebuild-Server-Server-raw-xz.aarch64.log for more details.
[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Labs, arch *, subvariant Scientific) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 33078501. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/i386-x86_64/imagebuild-Labs-Scientific-vagrant-libvirt-vagrant-virtualbox.i386-x86_64.log for more details.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch ppc64le, subvariant Container_Base) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Base) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant Container, arch s390x, subvariant Container_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch s390x, subvariant Container_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] Hardlinking /mnt/koji/packages/Fedora-Container-Base/Rawhide/20190227.n.0/images/Fedora-Container-Base-Rawhide-20190227.n.0.aarch64.tar.xz to /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/compose/Container/aarch64/images/Fedora-Container-Base-Rawhide-20190227.n.0.aarch64.tar.xz
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch s390x, subvariant Container_Minimal_Base) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant Container, arch ppc64le, subvariant Container_Minimal_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch ppc64le, subvariant Container_Minimal_Base) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Minimal_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Minimal_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] Hardlinking /mnt/koji/packages/Fedora-Container-Minimal-Base/Rawhide/20190227.n.0/images/Fedora-Container-Minimal-Base-Rawhide-20190227.n.0.aarch64.tar.xz to /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/compose/Container/aarch64/images/Fedora-Container-Minimal-Base-Rawhide-20190227.n.0.aarch64.tar.xz
  • Compose run failed because: - 33078504
[ERROR   ] Compose run failed: LiveImage task failed: 33078504. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20190227.n.0/logs/armhfp/liveimage-Fedora-Xfce-armhfp-Rawhide-20190227.n.0.armhfp.log for more details.

DEBUG util.py:490: BUILDSTDERR: Unknown configuration option: failovermethod = priority in /var/tmp/imgcreate-axllr_7f/dnf.conf-zbli2duu
DEBUG util.py:490: BUILDSTDERR: repo: downloading from remote: koji-override-0
DEBUG util.py:490: BUILDSTDERR: koji-override-0 882 kB/s | 67 MB 01:17
DEBUG util.py:490: BUILDSTDERR: not found other for:
DEBUG util.py:490: BUILDSTDERR: not found modules for:
DEBUG util.py:490: BUILDSTDERR: not found deltainfo for:
DEBUG util.py:490: BUILDSTDERR: not found updateinfo for:
DEBUG util.py:490: BUILDSTDERR: koji-override-0: using metadata from Wed Feb 27 07:50:14 2019.
DEBUG util.py:490: BUILDSTDERR: Last metadata expiration check: 0:01:53 ago on Wed Feb 27 09:36:41 2019.
DEBUG util.py:490: BUILDSTDERR: No module defaults found
DEBUG util.py:490: BUILDSTDERR: Failed to add groups file for repository: koji-override-0 - ERROR: Parser error at line:1 col:1
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: ERROR: Parser error at line:1 col:2
DEBUG util.py:490: BUILDSTDERR: not well-formed (invalid token)
DEBUG util.py:490: BUILDSTDERR: Unable to create appliance : Failed to find group 'core' : no such group
DEBUG util.py:490: BUILDSTDERR: umount:
DEBUG util.py:490: BUILDSTDERR: /var/tmp/imgcreate-axllr_7f/install_root/sys:
DEBUG util.py:490: BUILDSTDERR: target
DEBUG util.py:490: BUILDSTDERR: is
DEBUG util.py:490: BUILDSTDERR: busy.
DEBUG util.py:490: BUILDSTDERR: Unable to unmount /var/tmp/imgcreate-axllr_7f/install_root/sys normally, using lazy unmount

well, koji-override-0 for that task was http://kojipkgs.fedoraproject.org/compose/rawhide/Fedora-Rawhide-20190227.n.0/compose/Everything/armhfp/os , so it's complaining about the comps for that repo, it seems.

I think I know what's going on here: the issue is the new zck compression support. If you look in https://kojipkgs.fedoraproject.org/compose/rawhide/Fedora-Rawhide-20190227.n.0/compose/Everything/armhfp/os/repodata/ , there's a zck-compressed comps file (there is also an uncompressed one, and an xzip-compressed one).

The error we're hitting is in dnf, here. If you read through that whole section of code, the gist of what's going on is that dnf asks libdnf to find the comps file for it - by calling repo._repo.getCompsFn() here - then tries to decompress that file if it finds that it's compressed, via dnf.yum.misc.decompress, then reads it in.

That repo._repo.getCompsFn() call actually winds up hitting libdnf Repo.getCompsFn(), here. getCompsFn() basically calls getMetadataPath() with one metadata file type - MD_TYPE_GROUP_GZ - and if it doesn't get anything, calls it with MD_TYPE_GROUP. Those constants are set as "group_gz" and "group" respectively. However, since zchunk support was added, getMetadataPath() adds a wrinkle: whatever type you call it with, it first appends "_zck" to the end and looks for that. If it doesn't find it, it looks up the original, unmodified type.

So ultimately what happens here is fallback through four lookups for a metadata file with one of these "types", in order of preference:

  1. group_gz_zck
  2. group_gz
  3. group_zck
  4. group

This lookup is happening in repomd.xml, which is generated I think by createrepo via librepo. Here's the compose's repomd.xml. We can see that the "type" set for the .xml.zck file is "group_gz_zck". This seems questionable unless the file is double-compressed, but that's what it is. So the first lookup of the four will succeed, and libdnf will return the zchunk-compressed file.

That is a problem, because if you look at dnf's decompress(), it does not know how to recognize or decompress a zck-compressed file. So it will wind up just trying to read it as-is as if it were an xml file, which it...isn't.

That's my theory, anyway! We can see several potential avenues of attack here:

  1. Teach dnf to decompress zck files
  2. Have libdnf prefer the straight xzip-compressed comps file over the zchunk-compressed one somehow
  3. Hotfix: revert libdnf zchunk support in Rawhide and Branched
  4. Hotfix: revert whatever change causes the group_gz_zck file to appear in the first place in Rawhide and Branched (it did not show up in the Fedora-30-20190224.n.0 compose, so something changed between then and Fedora-Rawhide-20190227.n.0 to cause this)

@jdieter any thoughts?

Note, while the zck patches landed in upstream libdnf months ago, they only landed in Fedora on 2019-02-19. We did have a successful Branched compose on 2019-02-24 that probably ran with the updated libdnf, but if you look at the corresponding directory in that compose, it does not contain a zck-compressed comps file. I don't know why that is different between Branched 2019-02-24 and Rawhide 2019-02-27, but it would explain why the Branched compose worked: there's no zck-compressed file to be returned by getCompsFn(), so it falls through to the "group_gz" lookup and returns the xz-compressed file (whose repomd type is indeed "group_gz"), which dnf handles fine.

edit: working theory about why this zck-compressed comps suddenly started showing up is that it's a change in createrepo_c 0.12.1, and the composers got updated to that version between 2019-02-24 and 2019-02-27.

(replaced by edit of earlier comment)

@adamwill, you've hit it on the head. The original createrepo_c zchunk patch only built primary, filelists and other as .zck files. There was a new patch that must have only recently made it into Fedora that now generates .zck versions of all the other files.

When I tested this patch, it was only creating group_zck files (rather than group_gz_zck), and dnf was falling back to the gz file. I was aware of this, but since the fallback to the "gz" xz-compressed comps worked, I figured that we'd get it fixed later.

Which brings us to a potential third hot-fix: revert the latest patch to createrepo_c until we can teach dnf (and anything else that reads comps, i.e. possibly PackageKit) to directly decompress zchunk files. We'll still get zchunk compression for primary, filelists and other.

Let me look into the last option

Reverting createrepo_c is the temporary fix that releng has picked, too - they're running a Rawhide compose with the builders downgraded to createrepo_c 0.12.0.

I'm filing a bug on dnf for the missing zchunk support. AFAICT, comps files are the only thing dnf tries to deal with directly. I don't know about PackageKit, dnfdaemon etc.

Ok, that sounds good. zchunk currently doesn't have python bindings, so I'll need to fix that ASAP so dnf can decompress the file.

One question: is the group_gz_zck type for the .xml.zck file actually correct? Is it really double-compressed? If it's just straight zck-compressed xml, shouldn't librepo or createrepo or whatever be fixed to set the type to group_zck, which would happen to fix this?

No, it's not correct, the file is just straight zck-compressed xml. When I wrote the createrepo_c patch, I assumed that group is uncompressed and I took group_gz to mean the compressed version of comps (since createrepo_c will happy pass an xz file to it). Since librepo automatically adds the _zck suffix to search for a zchunk variant of the file, I just added _zck to make group_gz_zck, which made sense at the time.

If we set the type to group_zck, it would "fix" the problem in that librepo would never pass the zchunk file to dnf, so dnf wouldn't ever try to download it. I think a more permanent solution might be to have librepo only automatically request the _zck suffix for primary, filelists and other (because those are decompressed by libsolv). All other zchunk variants would need to be requested by the calling application (dnf, PackageKit, etc).

This would also make sure we don't hit upgrade problems down the road (i.e. a user is trying to upgrade from F30 without zchunked comps.xml to F31 with zchunked comps.xml and hasn't updated dnf yet...)

yeah, that's a problem we were worried about in IRC discussion too. Indeed the definition of group_gz has been extended a bit to cover xzip compression too, but group_gz_zck does still feel like an odd name :)

And here's a pull request for librepo that will limit it to only automatically upgrade to zchunk versions of primary, filelists and other: https://github.com/rpm-software-management/librepo/pull/141

My apologies for letting this get through. I'll be adding a test case to librepo to make sure that zchunk files for comps and updateinfo don't get downloaded unless specifically requested.

On further analysis on my test system, this bug only shows up if you try to actually do something with comps, i.e. dnf group install foo. This means that, even if someone has a buggy version of libsolv, they can still upgrade to a good version.

Login to comment on this ticket.

Metadata