Currently the ODCS systems are running out of space. They store a lot of data on a 2 node gluster which acts like a failover brick. This is not suported by the gluster upstream and causes various problems over time. We would want to move the data out of the brick into a shared NFS storage node.
Metadata Update from @mizdebsk:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: odcs
https://pagure.io/fedora-infrastructure/issue/8046 is a duplicate of this ticket
Can someone provide some sort of timeline of when this needs to be done by?
The real issue behind this is that ODCS does not remove old composes in Fedora infra. I'm going to update ODCS to new version which should fix this. But because the ODCS version used in Fedora infra is very old, we need this to happen first:
So, as I feared... this reached 100% full recently. We didn't get an alert because we got on when it went 90% full and acked it... :(
So, I just went and did it. Both prod and stg are now using nfs volumes. Please check permissions or the like...
I will go deal with the rabbitmq ticket here as soon as I can.
Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)
to comment on this ticket.