Difference between revisions of "Oath FFU Juno To Ocata"
James Penick (talk | contribs) |
James Penick (talk | contribs) |
||
| Line 8: | Line 8: | ||
# Validate control plane pipeline | # Validate control plane pipeline | ||
# HV preparation | # HV preparation | ||
| − | + | ## Upgrade all compute nodes to RHEL 7 | |
# DB preparation | # DB preparation | ||
| − | + | ## archive deleted rows | |
| − | + | ## validate backups | |
# Verify network ACLs are correct | # Verify network ACLs are correct | ||
# Update the Horizon Banner with CMR information | # Update the Horizon Banner with CMR information | ||
| Line 17: | Line 17: | ||
# Internal announcements on intranet, email, etc | # Internal announcements on intranet, email, etc | ||
# Build new jumphosts that use openstack-client, rather than the novaclient | # Build new jumphosts that use openstack-client, rather than the novaclient | ||
| + | |||
| + | === Upgrade === | ||
| + | |||
| + | # Take cluster snapshot of VMs status | ||
| + | # Start CMR | ||
| + | # Snooze monitoring alerts and stop functional testing jobs | ||
| + | # Stop api and mq services | ||
| + | # Stop nova compute on all HVs & confirm | ||
| + | # Backup db | ||
| + | # Run DB migration script | ||
| + | # Re-image API and MQ nodes to RHEL-7 | ||
| + | # Chef bootstrap API, MQ, and DB nodes | ||
| + | # Env and runlist association | ||
| + | # Start deployment for API, MQ, DB nodes. | ||
| + | # Deploy to two Compute nodes online as canaries | ||
| + | # Bring cluster online with the two canary compute nodes | ||
| + | # Validate VM creation, deletion work as expected. Ensure VMs don't disappear from canary hypervisors. | ||
| + | # Upgrade remaining compute nodes | ||
| + | # Post deployment checks for Control plane and HVs | ||
| + | # Clean up any additional db backup did during migration | ||
Revision as of 10:33, 26 February 2018
Preparing to upgrade
- Create CMR.
- Finalize CMR steps
- Testing chef bootstrap & converge for api, mq, db, HVs
- Verify runbooks for SRE/PE
- Add new VIPs to LB
- Validate control plane pipeline
- HV preparation
- Upgrade all compute nodes to RHEL 7
- DB preparation
- archive deleted rows
- validate backups
- Verify network ACLs are correct
- Update the Horizon Banner with CMR information
- Add VIP settings in Chef recipe
- Internal announcements on intranet, email, etc
- Build new jumphosts that use openstack-client, rather than the novaclient
Upgrade
- Take cluster snapshot of VMs status
- Start CMR
- Snooze monitoring alerts and stop functional testing jobs
- Stop api and mq services
- Stop nova compute on all HVs & confirm
- Backup db
- Run DB migration script
- Re-image API and MQ nodes to RHEL-7
- Chef bootstrap API, MQ, and DB nodes
- Env and runlist association
- Start deployment for API, MQ, DB nodes.
- Deploy to two Compute nodes online as canaries
- Bring cluster online with the two canary compute nodes
- Validate VM creation, deletion work as expected. Ensure VMs don't disappear from canary hypervisors.
- Upgrade remaining compute nodes
- Post deployment checks for Control plane and HVs
- Clean up any additional db backup did during migration
