#402 Reconfigure supermicro chassis for CI infra (hardware issue)
Closed: Fixed 2 years ago by arrfab. Opened 2 years ago by arrfab.

We suffered recently from a network switch issue in a chassis used for CI infra.
As that chassis is out of warranty, there was no way to have support nor the network switch replaced.
The workaround to restore service was to consolidate some network bridges on all nodes to be running from eth1 (as eth0 had no connectivity anymore)

But that's blocking currently redeploying/reinstalling some nodes through ansible automation, as supermicro nodes can only do pxe/network boot from eth0.

The plan:

  • reconfigure (but not reload) network config/bridges on hosts to go back to eth0
  • shutdown all nodes
  • work with PNT/Devops team to swap network switches in chassis (so that eth0 is connected and eth1 is on bad switch)
  • validate
  • restart all nodes

Metadata Update from @arrfab:
- Issue assigned to arrfab

2 years ago

Metadata Update from @arrfab:
- Issue tagged with: centos-ci-infra, high-gain, medium-trouble

2 years ago

we have agreement on the date/time slot with PNT/Devops team so it's now announced : https://lists.centos.org/pipermail/ci-users/2021-August/002177.html

Tuesday August 17th, 1:00 pm UTC time

All completed, so closing

Metadata Update from @arrfab:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

2 years ago

Login to comment on this ticket.

Metadata
Boards 1
CentOS CI Infra Status: Backlog