Planned Outage - koji upgrade - 2024-02-21 21:00 UTC
There will be an outage starting at 2024-02-21 21:00 UTC, which will last approximately 3 hours.
To convert UTC to your local time, take a look at http://fedoraproject.org/wiki/Infrastructure/UTCHowto or run:
date -d '2024-02-21 21:00UTC'
Reason for outage:
koji will be upgraded to 1.34.0, which requires a schema update that touches many rows. We estimate this will take about 45minutes to complete and during that time, koji will be completely offline. Package maintainers are advised to not start any long term builds before the outage.
Affected Services:
Ticket Link:
https://pagure.io/fedora-infrastructure/issue/11778
Please join #fedora-admin or #fedora-noc on irc.libera.chat or #admin:fedoraproject.org / #noc:fedoraproject.org on matrix. Please add comments to the ticket for this outage above.
Updated status for this outage may be available at https://www.fedorastatus.org/
FWIW, my plan for db01 is:
(I did this with db-koji01 a while back just fine).
I am going to do this process now with staging.
It could be wise to take down bodhi completely before taking down Koji, as failing to tag builds will cause out of synch statuses between updates status and build tags.
I'm going to change this outage to just be the koji update.
Thinking about it we are getting some new hardware soon, and I want to wait for that to be setup for the new rhel9 db01. I could set it up on existing hardware, but then would have to move it, etc. So, just putting it on the new hardware in the first place makes more sense. ;)
Yeah, I can scale bodhi down before koji is taken down, thanks for the input!
Metadata Update from @phsmoura: - Issue priority set to: Waiting on Assignee (was: Needs Review) - Issue tagged with: medium-gain, medium-trouble, ops
Outage is over.
I did try and do a vacuum full on the db, but the builrdoot table is gigantic and it was taking a really really long time, so I ended up just canceling. We can try again sometime.
Metadata Update from @kevin: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Log in to comment on this ticket.