#1417 Duffy nodes stuck in provisioning/contextualizing loop #4
Closed: Fixed 11 months ago by arrfab. Opened 11 months ago by mrc0mmand.

There seems to be something wrong with node deployment in general, since all pools (that I have checked) seem to have machines stuck in provisioning:

https://duffy.ci.centos.org/api/v1/pools/virt-ec2-t2-centos-9s-x86_64:

{
  "action": "get",
  "pool": {
    "name": "virt-ec2-t2-centos-9s-x86_64",
    "fill-level": 8,
    "levels": {
      "provisioning": 8,
      "ready": 0,
      "contextualizing": 0,
      "deployed": 2,
      "deprovisioning": 0
    }
  }
}

https://duffy.ci.centos.org/api/v1/pools/virt-ec2-t2-centos-8s-x86_64:

{
  "action": "get",
  "pool": {
    "name": "virt-ec2-t2-centos-8s-x86_64",
    "fill-level": 10,
    "levels": {
      "provisioning": 10,
      "ready": 0,
      "contextualizing": 0,
      "deployed": 0,
      "deprovisioning": 0
    }
  }
}

https://duffy.ci.centos.org/api/v1/pools/metal-ec2-c5n-centos-9s-x86_64:

{
  "action": "get",
  "pool": {
    "name": "metal-ec2-c5n-centos-9s-x86_64",
    "fill-level": 3,
    "levels": {
      "provisioning": 3,
      "ready": 0,
      "contextualizing": 0,
      "deployed": 0,
      "deprovisioning": 0
    }
  }
}

stuck process (but don't know why and I'll investigate another day as it's saturday evening) but show be good now as it was restarted and I saw some instances being really provisioned and in ready state :

duffy client show-pool virt-ec2-t2-centos-9s-x86_64
{
  "action": "get",
  "pool": {
    "name": "virt-ec2-t2-centos-9s-x86_64",
    "fill_level": 8,
    "levels": {
      "provisioning": 0,
      "ready": 8,
      "contextualizing": 0,
      "deployed": 4,
      "deprovisioning": 0
    }
  }
}

Metadata Update from @arrfab:
- Issue assigned to arrfab

11 months ago

Metadata Update from @arrfab:
- Issue tagged with: centos-ci-infra, high-gain, investigation, medium-trouble

11 months ago

Metadata Update from @arrfab:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

11 months ago

Log in to comment on this ticket.

Metadata