#861 Small enhancements for the "how to upgrade persistent instances" document
Closed 4 years ago by praiskup. Opened 4 years ago by frostyx.

@@ -60,12 +60,6 @@ 

  

      source ~/Downloads/persistent-openrc.sh

  

- Detach volume from the old instance::

- 

-     openstack server remove volume "<instance_id>" "<volume_id>"

-     # e.g.

-     openstack server remove volume "52d97d72-5915-45c0-b223-xxxxxxxxxxxx" "9e2b4c55-9ec3-4508-af46-xxxxxxxxxxxx"

- 

  Backup the old instance by renaming it::

  

      openstack server set --name <old_name>_backup "<id>"
@@ -73,18 +67,23 @@ 

      openstack server set --name copr-dist-git-dev_backup "85260b5b-7f61-4398-8d05-xxxxxxxxxxxx"

  

  

- .. note:: You might need to backup also letsencrypt certificates.

-           See `Letsencrypt renewal limits`_.

- 

- .. note:: You should terminate existing resalloc resources.

-           See `Terminate resalloc resources`_.

+ .. warning:: You might need to backup also letsencrypt certificates.

+              See `Letsencrypt renewal limits`_.

  

+ .. warning:: backend - You should terminate existing resalloc resources.

+              See `Terminate resalloc resources`_.

  

  Finally, shut down the instance to avoid storage inconsistency and other possible problems::

  

      $ ssh root@<old_name>.fedorainfracloud.org

      [root@copr-dist-git-dev ~][STG]# shutdown -h now

  

+ Once the instance is halted, detach volume from the old instance::

+ 

+     openstack server remove volume "<instance_id>" "<volume_id>"

+     # e.g.

+     openstack server remove volume "52d97d72-5915-45c0-b223-xxxxxxxxxxxx" "9e2b4c55-9ec3-4508-af46-xxxxxxxxxxxx"

+ 

  

  Provision new instance from scratch

  -----------------------------------
@@ -109,7 +108,10 @@ 

  and re-run it again and again. Most likely you will also need to attach a volume to it

  in the `OpenStack instances dashboard`_.

  

- .. note:: Copr backend requires an outdated version of python3-novaclient.

+ .. note:: frontend - It will most likely be necessary to manualy upgrade the database.

+           See `Upgrade the database`_.

+ 

+ .. note:: backend - Copr backend requires an outdated version of python3-novaclient.

            See `Downgrade python novaclient`_.

  

  
@@ -125,6 +127,15 @@ 

  ``More`` button. In the dropdown menu, there is a button ``Terminate instance``, use it.

  

  

+ Final steps

+ -----------

+ 

+ Don't forget to announce on `fedora devel`_ and `copr devel`_ mailing lists and also on

+ ``#fedora-buildsys`` that everything should be working again.

+ 

+ Close the infrastructure ticket.

+ 

+ 

  Troubleshooting

  ---------------

  
@@ -184,6 +195,9 @@ 

  

  Please note two addresses needs to be updated, both are backend's.

  

+ Run provision playbooks for ``copr-backend`` and ``copr-keygen`` to propagate the changes

+ to the respective instances.

+ 

  

  Terminate resalloc resources

  ............................
@@ -217,8 +231,29 @@ 

            with the situation properly.

  

  

+ Upgrade the database

+ ....................

+ 

+ When upgrading to a distribution that provides a new major version of PostgreSQL server,

+ there is a manual intervention required.

+ 

+ Upgrade the database::

+ 

+     [root@copr-fe-dev ~][STG]# dnf install postgresql-upgrade

+     [root@copr-fe-dev ~][STG]# postgresql-setup --upgrade

+ 

+ 

+ And rebuild indexes::

+ 

+     [root@copr-fe-dev ~][STG]# su postgres

+     bash-5.0$ cd

+     bash-5.0$ reindexdb --all

+ 

+ 

  

  .. _`Fedora Infra OpenStack`: https://fedorainfracloud.org

  .. _`OpenStack images dashboard`: https://fedorainfracloud.org/dashboard/project/images/

  .. _`OpenStack instances dashboard`: https://fedorainfracloud.org/dashboard/project/instances/

  .. _`Fedora infrastructure issue #7966`: https://pagure.io/fedora-infrastructure/issue/7966

+ .. _`fedora devel`: https://lists.fedorahosted.org/archives/list/devel@lists.fedoraproject.org/

+ .. _`copr devel`: https://lists.fedoraproject.org/archives/list/copr-devel@lists.fedorahosted.org/

These changes are based on my notes from the upgrade to F30 that happened this week.

6 new commits added

  • [doc] add some final steps to the upgrade document
  • [doc] describe how to upgrade the database
  • [doc] run playbooks after changing backend and keygen playbooks
  • [doc] detach volume after the volume is shut down
  • [doc] mention that some notes are for backend only
  • [doc] change some notes to warnings
4 years ago

Merged manually (pagure broken again) as:

* bc214f2d - (HEAD -> master, origin/master) [doc] add some final steps to the upgrade document (16 seconds ago)
* 75c17c69 - [doc] describe how to upgrade the database (16 seconds ago)
* 5c1dc8a5 - [doc] run playbooks after changing backend and keygen playbooks (16 seconds ago)
* bce8507d - [doc] detach volume after the volume is shut down (16 seconds ago)
* 3aa746df - [doc] mention that some notes are for backend only (16 seconds ago)
* 2b21f603 - [doc] change some notes to warnings (16 seconds ago)

Pull-Request has been closed by praiskup

4 years ago
Metadata