Some nodes on the openshift staging cluster seem to be running out of resources. In particular, os-node04.stg.phx2.fedoraproject.org seems to be having issues with its devmapper pool.
os-node04.stg.phx2.fedoraproject.org
5 out of 5 of the last builds of coreos-cincinnati-stub failed (at different times, but all of them this morning) with the following error:
coreos-cincinnati-stub
error: build error: devmapper: Thin Pool has 11855 free data blocks which is less than minimum required 11944 free data blocks. Create more free space in thin pool or use dm.min_free_space option to change behavior
Cleaned up. This was largely due to old images kept around.
Metadata Update from @kevin: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
@kevin thanks for quickly fixing this! I'd be happy to contribute in cleaning up some of the oldest tags in my imagestream, however cluster RBAC policies deny that even for project owners.
Metadata Update from @dustymabe: - Issue status updated to: Open (was: Closed)
re-opening as I'm seeing this in stage now periodically fore the compose-tracker and coreos-koji-tagger projects
compose-tracker
coreos-koji-tagger
error: build error: devmapper: Thin Pool has 11696 free data blocks which is less than minimum required 11944 free data blocks. Create more free space in thin pool or use dm.min_free_space option to change behavior
@kevin cleaned up some images again.. so this is fixed.... for now
Metadata Update from @dustymabe: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Login to comment on this ticket.