For the past couple of hours the CentOS CI OCP hasn't been able to create/remove any pod, spamming the OCP event logs with:
<img alt="" src="https://sumsal.cz/s/Screen_jknVZOgp.png" />
This also means all jobs in the respective Jenkins OCP instances are stuck in a queue waiting for an available pod.
I suspect this is a yet another occurrence of https://pagure.io/centos-infra/issue/423 /cc @dkirwan
Yep, after setting the node selector to kubernetes.io/hostname=kempty-n11.ci.centos.org, everything is back to normal.
kubernetes.io/hostname=kempty-n11.ci.centos.org
Not sure what's going wrong there @mrc0mmand , I need to investigate when I get a minute ;( in the mean time I've rebooted the kempty-n12 node.
Metadata Update from @arrfab: - Issue tagged with: centos-ci-infra, low-gain, medium-trouble
Looks like kempty-n12 is having issues once again.
kempty-n12
Nevermind, it managed to reassess itself this time.
bugs triage : can we so close this one ?
Metadata Update from @arrfab: - Issue priority set to: Waiting on Reporter (was: Needs Review)
I guess it can be closed. I saw some hiccups on the kempty.12 nodes (i.e. it failed to create pods for a couple of minutes several times), but so far it always "fixed" itself.
Metadata Update from @mrc0mmand: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Login to comment on this ticket.