#1346 Need Hyperscale Koji image build hosts for x86_64 and aarch64
Opened a month ago by ngompa. Modified 3 days ago

Today, I tried to build the CentOS Hyperscale OpenStack image in CBS, and it failed on AArch64 because the kernel is an older one on c8s using 64k pages and doesn't support subpage (4k sector size on 64k page size).

Could we get dedicated x86_64 and aarch64 koji image builder nodes for CentOS Hyperscale that runs c9s with the current hyperscale kernel?


FYI : current infra tags don't cover el9 (cbs infra currently runs on rhel8).
other thing : as it was working in the past for hyperscale images, is that something that changed inside hyperscale images that suddenly would require a completely different kernel and userspace env ?

Metadata Update from @arrfab:
- Issue tagged with: blocked, cbs, feature-request, investigation

a month ago

Yes. We rebased our kernel and btrfs-progs to v6.7, which include a change to default to 4k sector sizes for new filesystems by default regardless of page size to ensure cross-arch compatibility. The older kernel doesn't support this mode, so it chokes.

so that means that such aarch64 builder, if running that kernel, would then impact all other aarch64 rpm builds for all other SIGs ?

It should not have meaningful impact on rpm builds itself, since Mock isolates things away in that regard. Even for doing kmod builds, the host environment kernel does not matter.

Metadata Update from @arrfab:
- Issue marked as depending on: #1350

11 days ago

It should not have meaningful impact on rpm builds itself, since Mock isolates things away in that regard. Even for doing kmod builds, the host environment kernel does not matter.

Just adding a note here that it makes a difference in rare cases, e.g., when building a kernel sha512hmac is usually called during the build process. Building for rhel8 targets this will fail depending on which kernel the build host is running.

kernel 4.18.0-425.19.2.el8_7:

+ sha512hmac vmlinuz-6.6.16-1.el8.aarch64
libkcapi - Error: Netlink error: sendmsg failed
libkcapi - Error: Netlink error: sendmsg failed
libkcapi - Error: NETLINK_CRYPTO: cannot obtain cipher information for hmac(sha512) (is required crypto_user.c patch missing? see documentation)
Allocation of hmac(sha512) cipher failed (ret=-111)

kernel 5.14.0-76.hs2.hsx.el8:
No error.

The hosts seem to be picked randomly?

Note: This does not depend on the architecture.

This seems to be related to this kernel commit 1.

Note: For rhel9 targets the used kernel version makes no difference, hence I assume some userspace component, probably libkcapi, has some influence as well.

It should not have meaningful impact on rpm builds itself, since Mock isolates things away in >
The hosts seem to be picked randomly?

The koji builders are assigned to channels, and if nothing is specified, rpm builds are going to default one : https://cbs.centos.org/koji/channelinfo?channelID=1
But some of these builders are also in other channels, like image one (https://cbs.centos.org/koji/channelinfo?channelID=7) , which is where the kiwi builds are processed, and so if a rpm build also lands on one of these builders, the underlying kernel was updated to take care of understanding btrfs.
Dedicating specific builders just to build images wouldn't be the best usage we can do a build farm so ideally these builders would still accept rpm builds and have zero impact during the build process

Login to comment on this ticket.

Metadata