We have some job running on Fedora CI, but it looks like PODs are taking long time to being created an meanwhile we keep seeing this type of messages
Failed to pull image "172.30.254.79:5000/continuous-infra/jenkins-continuous-infra-slave:stable": rpc error: code = 2 desc = failed to register layer: devmapper: Thin Pool has 45102 free data blocks which is less than minimum required 45343 free data blocks. Create more free space in thin pool or use dm.min_free_space option to change behavior
Failed to pull image "172.30.254.79:5000/continuous-infra/singlehost-test:stable": rpc error: code = 2 desc = failed to register layer: devmapper: Thin Pool has 45225 free data blocks which is less than minimum required 45343 free data blocks. Create more free space in thin pool or use dm.min_free_space option to change behavior
Failed to pull image "172.30.254.79:5000/continuous-infra/cloud-image-compose:stable": rpc error: code = 2 desc = failed to register layer: devmapper: Thin Pool has 45103 free data blocks which is less than minimum required 45343 free data blocks. Create more free space in thin pool or use dm.min_free_space option to change behavior
The problem seems to happen when PODs are running on n27.dumpty.ci.centos.org (172.22.6.55) node
This is trouble with the scheduler again. For some reason, disk pressure information isn't being communicated back to the masters.
I'm going to cordon this node (since there are quite a few containers running), and look at this for when we repave the cluster.
Metadata Update from @bstinson: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Login to comment on this ticket.