#12531 Move copr_hypervisor group from iptables to nftables
Closed: Fixed 3 months ago by kevin. Opened 10 months ago by praiskup.

This has been done before, but Copr hypervisors stopped allocating VMs, observing several problems
- inability to boot VMs (ppc64le p08 boxes)
- inability to ssh-connect to newly started VMs over ipv6
- no ipv4 internet on allocated VMs (through libvirt's NAT), even though ipv6 worked

Reverting to iptables && libvirtd restart helped the situation:
https://pagure.io/fedora-infra/ansible/c/43b8ee52d8b05acb22a8128d4b9fe207707bea82..43b8ee52d8b05acb22a8128d4b9fe207707bea82

Goot for now, but we should align with the rest of the Fedora hypervisors and move to nftables.


Do we know where the extra iptables rules are coming from?

I don't see anything firewall related in: roles/copr/hypervisor/*

Metadata Update from @james:
- Issue assigned to james

10 months ago

I don't think we add anything ourselves? Libvirt though modifies iptables on VM boot/termination. Is libvirt known to work with nftables correctly?
We need to make VMs globally accessible over ipv6, and ipv4 over libvirt NAT.

It definitely does in rhel9... but I am reminded that those machines are rhel8 still. Perhaps thats the issue?

Metadata Update from @phsmoura:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: medium-gain, medium-trouble, ops

10 months ago

Could be?

This comment won't make the decision easier, but sooner or later we should have some firewall managed "centrally" for all our VMs on hypervisors, and I've seen even the RHEL9 libvirt (and not yet fixed for C10S) having troubles with modern firewall.

The nftables issue on Fedora was analyzed by Laine here:
https://github.com/fedora-copr/copr/issues/3945
And I was able to make it work with the suggested custom nft rules.

We still have to keep iptables on RHEL 8 machines, though.

See also: https://matrix.to/#/!JMiyDwIilrGoiSmkqy:matrix.org/$ZZTjf32bR00NDJ7CTDRHGIm_a3F5iJ5kkulOMlNUSkM?via=fedora.im&via=matrix.org&via=envs.net

ok, so should we just close this now I guess?

reopen if there's anymore to do.

Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

3 months ago

Log in to comment on this ticket.

Metadata
Boards 1
ops Status: Backlog