#371 Planned Outage: CentOS CI OCP4 09:00 - 10:00 UTC Monday 28th June
Closed: Fixed 11 months ago by dkirwan. Opened 11 months ago by dkirwan.

There will be a planned outage for the CentOS CI OCP4 cluster on Monday 28th June for a period of 1 hour from 09:00 - 10:00 UTC but should not take the full hour to complete this work.

This work is to allow us to restore our primary storage storage02 back into production. This should drastically improve performance as we have moved to a RAID10 configuration.


Thank you a lot for your exemplary pre-notifications for outages, and providing such an excellent service in general! :clap:

  • Upgraded the firmware on the storage HBA, was running v9, upgraded to v16
  • Updated the kernel to the latest version in CentOS 8.4
  • Reshaped the array to RAID 10, with some spare disks
  • Stress tested last week, much faster, no more hardware failure messages
  • rsynced data back from storinator2 to storage02
  • Migrated ocp.stg.ci and ocp.ci Openshift clusters back to use this array.

This work is now complete.

Metadata Update from @dkirwan:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

11 months ago

Login to comment on this ticket.

Metadata
Boards 2
CentOS CI Infra Status: Backlog