centos-infra

Clone
Source Code
GIT

#371 Planned Outage: CentOS CI OCP4 09:00 - 10:00 UTC Monday 28th June
Closed: Fixed 2 years ago by dkirwan. Opened 2 years ago by dkirwan.

Closed: Fixed
Reopen Issue

There will be a planned outage for the CentOS CI OCP4 cluster on Monday 28th June for a period of 1 hour from 09:00 - 10:00 UTC but should not take the full hour to complete this work.

This work is to allow us to restore our primary storage storage02 back into production. This should drastically improve performance as we have moved to a RAID10 configuration.

Thank you a lot for your exemplary pre-notifications for outages, and providing such an excellent service in general! :clap:
  • Upgraded the firmware on the storage HBA, was running v9, upgraded to v16
  • Updated the kernel to the latest version in CentOS 8.4
  • Reshaped the array to RAID 10, with some spare disks
  • Stress tested last week, much faster, no more hardware failure messages
  • rsynced data back from storinator2 to storage02
  • Migrated ocp.stg.ci and ocp.ci Openshift clusters back to use this array.

This work is now complete.

Metadata Update from @dkirwan:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)
2 years ago

Login to comment on this ticket.

Metadata

centos-ci-infra high-gain medium-trouble centos-common-infra

None
None
Needs Review
Boards 2
CentOS_Common_Infrastructure Status: Backlog
CentOS CI Infra Status: Backlog
Powered by Pagure 5.13.3
Documentation • File an Issue • About • SSH Hostkey/Fingerprint
© Red Hat, Inc. and others.