#7255 Cannot deploy Openshift cluster to osbs-aarch64-master01.stg.arm.fedoraproject.org
Closed: Fixed 5 years ago Opened 5 years ago by cverna.

  • Describe what you need us to do:

I am trying to use the ansible-ansible-ansible-openshift role to deploy a new openshift cluster for osbs-aarch64.
This role clone the ansible-openshift git repo to osbs-control01.stg.phx2.fedoraproject.org machine, then the playbook is run from osbs-control01.stg. It looks like osbs-control01.stg does not recognize osbs-aarch64-master01.stg.arm.fedoraproject.org

fatal: [osbs-control01.stg.phx2.fedoraproject.org]: FAILED! => {"changed": true, "cmd": "ansible-playbook playbooks/prerequisites.yml -i cluster-inventory-stg", "delta": "0:00:32.072602", "end": "2018-09-19 17:5
4:58.743305", "msg": "non-zero return code", "rc": 2, "start": "2018-09-19 17:54:26.670703", "stderr": " [WARNING]: Could not match supplied host pattern, ignoring: oo_lb_to_config\n [WARNING]: Could not match s
upplied host pattern, ignoring: oo_nfs_to_config", "stderr_lines": [" [WARNING]: Could not match supplied host pattern, ignoring: oo_lb_to_config", " [WARNING]: Could not match supplied host pattern, ignoring: o
o_nfs_to_config"], "stdout": "\nPLAY 

The error can be reproduced running the following playbook sudo rbac-playbook groups/osbs/aarch64/cluster_deployment.yml -t osbs-aarch64-deploy-openshift

  • When do you need this? (YYYY/MM/DD)

  • When is this no longer needed or useful? (YYYY/MM/DD)

  • If we cannot complete your request, what is the impact?


Should be fixed now.

:soccer:

Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

5 years ago

Metadata Update from @cverna:
- Issue status updated to: Open (was: Closed)

5 years ago

Reopening this ticket since I still have the same error message when trying to run the playbook.

Metadata Update from @smooge:
- Issue assigned to smooge

5 years ago

Where is it supposed to get the inventory file -i cluster-inventory-stg (that isn't in in the rbac allowed commands so that may be part of the issue)

Where is it supposed to get the inventory file -i cluster-inventory-stg (that isn't in in the rbac allowed commands so that may be part of the issue)

The inventory is generated by the ansible-x3-openshift role on osbs-control01.stg then the ansible-openshift playbook is executed from osbs-control01.stg used the generated playbook.

I have run this from root with a -v to see if I could see what might be problematic

TASK [ansible-ansible-openshift-ansible : debug] ****************************************************************************************************************************
Monday 24 September 2018  15:15:09 +0000 (0:00:00.062)       0:00:07.285 ****** 
ok: [osbs-control01.stg.phx2.fedoraproject.org] => {
    "openshift_master_default_subdomain": "VARIABLE IS NOT DEFINED!: 'openshift_master_default_subdomain' is undefined"
}

later on in the chain

TASK [ansible-ansible-openshift-ansible : generate the inventory file (production)] *****************************************************************************************
Monday 24 September 2018  15:15:09 +0000 (0:00:00.041)       0:00:07.387 ****** 
skipping: [osbs-control01.stg.phx2.fedoraproject.org] => {"changed": false, "skip_reason": "Conditional result was False"}

TASK [ansible-ansible-openshift-ansible : generate the inventory file (osbs)] ***********************************************************************************************
Monday 24 September 2018  15:15:09 +0000 (0:00:00.039)       0:00:07.427 ****** 
ok: [osbs-control01.stg.phx2.fedoraproject.org] => {"changed": false, "checksum": "3352ede4b2f827e4ccbd76c38374d4084698f287", "dest": "/root/openshift-ansible/cluster-inventory-stg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/root/openshift-ansible/cluster-inventory-stg", "secontext": "system_u:object_r:admin_home_t:s0", "size": 34991, "state": "file", "uid": 0}

TASK [ansible-ansible-openshift-ansible : run ansible prereqs playbook] *****************************************************************************************************
Monday 24 September 2018  15:15:09 +0000 (0:00:00.720)       0:00:08.147 ****** 
fatal: [osbs-control01.stg.phx2.fedoraproject.org]: FAILED! => {"changed": true, "cmd": "ansible-playbook playbooks/prerequisites.yml -i cluster-inventory-stg", "delta": "0:00:02.166871", "end": "2018-09-24 15:15:12.287424", "msg": "non-zero return code", "rc": 2, "start": "2018-09-24 15:15:10.120553", "stderr": " [WARNING]: Could not match supplied host pattern, ignoring: oo_lb_to_config\n [WARNING]: Could not match supplied host pattern, ignoring: oo_nfs_to_config", "stderr_lines": [" [WARNING]: Could not match supplied host pattern, ignoring: oo_lb_to_config", " [WARNING]: Could not match supplied host pattern, ignoring: oo_nfs_to_config"], "stdout": "\nPLAY [Initialization Checkpoint Start] *****************************************\n\nTASK [Set install initialization 'In Progress'] ********************************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.068)       0:00:00.068 ****** \nok: [osbs-aarch64-master01.stg.arm.fedoraproject.org]\n\nPLAY [Populate config host groups] *********************************************\n\nTASK [Load group name mapping variables] ***************************************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.059)       0:00:00.128 ****** \nok: [localhost]\n\nTASK [Evaluate groups - g_etcd_hosts or g_new_etcd_hosts required] *************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.027)       0:00:00.155 ****** \nskipping: [localhost]\n\nTASK [Evaluate groups - g_master_hosts or g_new_master_hosts required] *********\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.023)       0:00:00.178 ****** \nskipping: [localhost]\n\nTASK [Evaluate groups - g_node_hosts or g_new_node_hosts required] *************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.022)       0:00:00.201 ****** \nskipping: [localhost]\n\nTASK [Evaluate groups - g_lb_hosts required] ***********************************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.021)       0:00:00.222 ****** \nskipping: [localhost]\n\nTASK [Evaluate groups - g_nfs_hosts required] **********************************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.019)       0:00:00.241 ****** \nskipping: [localhost]\n\nTASK [Evaluate groups - g_nfs_hosts is single host] ****************************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.019)       0:00:00.260 ****** \nskipping: [localhost]\n\nTASK [Evaluate groups - g_glusterfs_hosts required] ****************************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.018)       0:00:00.279 ****** \nskipping: [localhost]\n\nTASK [Evaluate groups - Fail if no etcd hosts group is defined] ****************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.019)       0:00:00.298 ****** \nskipping: [localhost]\n\nTASK [Evaluate oo_all_hosts] ***************************************************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.020)       0:00:00.318 ****** \nok: [localhost] => (item=osbs-aarch64-master01.stg.arm.fedoraproject.org)\n\nTASK [Evaluate oo_masters] *****************************************************\nMonday 24 September 2018  15:15:11 +0000 (0:00:00.053)       0:00:00.372 ****** \nok: [localhost] => (item=osbs-aarch64-master01.stg.arm.fedoraproject.org)\n\nTASK [Evaluate oo_first_master] ************************

2 things could be happening here.
1. The playbook doesn't have the full path to the inventory so is not finding it
2. The playbook is not generating an empty file.

I tried to capture the file in the playrun but I could not 'find' any file when it ran.. so I am not sure what is happening yet.

Problem is in the hosts that the playbook expects to exist but do not

TASK [Evaluate oo_etcd_to_migrate] ******************************************************************************************************************************************
Monday 24 September 2018  16:44:18 +0000 (0:00:00.021)       0:00:00.807 ******
ok: [localhost] => (item=osbs-aarch64-master01.stg.arm.fedoraproject.org)
 [WARNING]: Could not match supplied host pattern, ignoring: oo_lb_to_config

 [WARNING]: Could not match supplied host pattern, ignoring: oo_nfs_to_config


PLAY [Ensure that all non-node hosts are accessible] ************************************************************************************************************************

TASK [Gathering Facts] ******************************************************************************************************************************************************
Monday 24 September 2018  16:44:18 +0000 (0:00:00.045)       0:00:00.853 ******
fatal: [osbs-aarch64-master01.stg.arm.fedoraproject.org]: UNREACHABLE! => {"changed": false, "msg": "SSH Error: data could not be sent to remote host \"osbs-aarch64-master01.stg.arm.fedoraproject.org\". Make sure this host can be reached over ssh", "unreachable": true}

NO MORE HOSTS LEFT **********************************************************************************************************************************************************

PLAY RECAP ******************************************************************************************************************************************************************
localhost                  : ok=11   changed=0    unreachable=0    failed=0
osbs-aarch64-master01.stg.arm.fedoraproject.org : ok=1    changed=0    unreachable=1    failed=0


INSTALLER STATUS ************************************************************************************************************************************************************
Initialization             : In Progress (0:00:01)

This is I believe the 'we only have one host and we are expecting many more' problem but not sure.

Correction.. the problem is that the ssh keys were not getting copied over in the subplaybook. Talked with cverna in channel and he will fix and we will debug from there.

This seems to be fixed. Please re-open if there's anything else to do.

:fishing_pole_and_fish:

Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

5 years ago

Metadata Update from @cverna:
- Issue status updated to: Open (was: Closed)

5 years ago

Metadata Update from @cverna:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

5 years ago

Metadata Update from @cverna:
- Issue status updated to: Open (was: Closed)

5 years ago

Metadata Update from @cverna:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

5 years ago

Login to comment on this ticket.

Metadata