Difference between revisions of "StarlingX/Test/SanityTests"
(→Sanity-OpenStack) |
(→Sanity-Platform) |
||
| (28 intermediate revisions by the same user not shown) | |||
| Line 8: | Line 8: | ||
! iso || DATE | ! iso || DATE | ||
|- | |- | ||
| − | | http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/ | + | |http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190522T013000Z/|| 22 - MAY- 2019 |
|- | |- | ||
| − | | | + | | . || . |
|- | |- | ||
| − | | | + | | || |
|} | |} | ||
| + | |||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| + | ! Provision-Containers || AIO - Simplex Virtual || AIO - Baremetal || bug | ||
| + | |- | ||
| + | | 1. Provisioning Simplex System || PASS || PASS || | ||
| + | |- | ||
| + | | 2. Provisioning Duplex System || PASS || PASS || | ||
| + | |- | ||
| + | | 3. Provisioning Standard Non-Storage System || PASS || PASS || | ||
| + | |- | ||
| + | | 4. Provisioning Standard Storage System || N/A || PASS || | ||
| + | |} | ||
| + | |||
| + | {| class="wikitable" | ||
! 01-Instance-From-Image || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug | ! 01-Instance-From-Image || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug | ||
|- | |- | ||
| − | | 1. Create Flavors for Instances || PASS ||PASS || PASS|| | + | | 1. Create Flavors for Instances || PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 2. Create Images for Instances ||PASS ||PASS || PASS|| | + | | 2. Create Images for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 3. Create Networks for Instances || PASS ||PASS || PASS|| | + | | 3. Create Networks for Instances || PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 4. Launch Instances || | + | | 4. Launch Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 5. Suspend Resume Instances || | + | | 5. Suspend Resume Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 6. Set Error Active Flags Instances || | + | | 6. Set Error Active Flags Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 7. Pause Unpause Instances || | + | | 7. Pause Unpause Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 8. Stop Start Instances || | + | | 8. Stop Start Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 9. Lock Unlock Instances || | + | | 9. Lock Unlock Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 10. Reboot Instances || | + | | 10. Reboot Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 11. Rebuild Instances || | + | | 11. Rebuild Instances ||PASS ||PASS || PASS|| N/A||PASS||FAIL||PASS||PASS|| |
|- | |- | ||
| − | | 12. Resize Instances || FAIL|| | + | | 12. Resize Instances ||FAIL||PASS || PASS|| N/A||FAIL||FAIL||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1824412 |
|- | |- | ||
| − | | 13. Set Unset Properties Instances || | + | | 13. Set Unset Properties Instances ||PASS ||PASS || PASS|| N/A||PASS||FAIL||PASS||PASS|| |
|- | |- | ||
| − | | 14. Evacuate Instances From Hosts ||PASS ||PASS || | + | | 14. Evacuate Instances From Hosts ||PASS ||PASS || pas|| N/A||PASS||PASS||PASS||PASS|| |
|} | |} | ||
| Line 51: | Line 64: | ||
! 02-Instance-From-Volume || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug | ! 02-Instance-From-Volume || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug | ||
|- | |- | ||
| − | | 1. Create Flavors for Instances ||PASS ||PASS || PASS|| | + | | 1. Create Flavors for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 2. Create Images for Instances ||PASS ||PASS || PASS|| | + | | 2. Create Images for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 3. Create Networks for Instance ||PASS ||PASS || PASS|| | + | | 3. Create Networks for Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 4. Create Volume for Instances || | + | | 4. Create Volume for Instances || PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 5. Launch Instances || | + | | 5. Launch Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 6. Suspend Resume Instance || | + | | 6. Suspend Resume Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 7. Set Error Active Flags Instance || | + | | 7. Set Error Active Flags Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 8. Pause Unpause Instances || | + | | 8. Pause Unpause Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 9. Stop Start Instances || | + | | 9. Stop Start Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 10. Lock Unlock Instances || | + | | 10. Lock Unlock Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 11. Reboot Instances || | + | | 11. Reboot Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | |12. Rebuild Instances || | + | |12. Rebuild Instances ||PASS ||PASS || PASS|| N/A||PASS|| FAIL||PASS||PASS|| |
|- | |- | ||
| − | | 13. Resize Instances ||FAIL|| | + | | 13. Resize Instances ||FAIL||PASS || PASS|| N/A|| FAIL|| FAIL||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1824412 |
|- | |- | ||
| − | | 14. Set Unset Properties Instances || | + | | 14. Set Unset Properties Instances ||PASS ||PASS || PASS|| N/A|| PASS|| FAIL||PASS||PASS||https://bugs.launchpad.net/starlingx/+bug/1824412 |
|- | |- | ||
| − | | 15. Evacuate Instances From Hosts ||PASS ||PASS || | + | | 15. Evacuate Instances From Hosts ||PASS ||PASS || FAIL|| N/A||PASS||PASS||PASS||PASS|| |
|} | |} | ||
| Line 87: | Line 100: | ||
! 03-Instance-From-Snapshot || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug | ! 03-Instance-From-Snapshot || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug | ||
|- | |- | ||
| − | | 1. Create Flavors for Instances ||PASS ||PASS || PASS|| | + | | 1. Create Flavors for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 2. Create Images for Instances ||PASS ||PASS || PASS|| | + | | 2. Create Images for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 3. Create Networks for Instance ||PASS ||PASS || PASS|| | + | | 3. Create Networks for Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 4. Create Volume for Instances || | + | | 4. Create Volume for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 5. Create Snapshot for Instance || | + | | 5. Create Snapshot for Instance ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 6. Launch Instances || | + | | 6. Launch Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 7. Suspend Resume Instances || | + | | 7. Suspend Resume Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 8. Set Error Active Flags Instances || | + | | 8. Set Error Active Flags Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 9. Pause Unpause Instances || | + | | 9. Pause Unpause Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 10. Stop Start Instances || | + | | 10. Stop Start Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 11. Lock Unlock Instances || | + | | 11. Lock Unlock Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 12. Reboot Instances || | + | | 12. Reboot Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 13. Rebuild Instances || | + | | 13. Rebuild Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 14. Resize Instances || FAIL|| | + | | 14. Resize Instances ||FAIL||PASS || PASS|| N/A|| FAIL||FAIL||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1824412 |
|- | |- | ||
| − | | 15. Set Unset Properties Instances || | + | | 15. Set Unset Properties Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 16. Evacuate Instances From Hosts || PASS ||PASS || PASS|| | + | | 16. Evacuate Instances From Hosts ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| Line 127: | Line 140: | ||
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug | ! 04-Instance-From-Heat-Template || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug | ||
|- | |- | ||
| − | | 1. Create Flavors for Instances ||PASS ||PASS || PASS|| | + | | 1. Create Flavors for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 2. Create Images for Instances ||PASS ||PASS || PASS|| | + | | 2. Create Images for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 3. Create Networks for Instance ||PASS ||PASS || PASS|| | + | | 3. Create Networks for Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 4. Create Instance Trough Stack ||PASS ||PASS || PASS|| | + | | 4. Create Instance Trough Stack ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|} | |} | ||
| Line 140: | Line 153: | ||
! 05-Measurements-For-Metric || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug | ! 05-Measurements-For-Metric || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug | ||
|- | |- | ||
| − | | 1. Create Image For Metrics ||PASS ||PASS || PASS|| | + | | 1. Create Image For Metrics ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 2. Update Image Name ||PASS ||PASS || PASS|| | + | | 2. Update Image Name ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | 3. Update Image Disk Ram Size ||PASS ||PASS || PASS|| | + | | 3. Update Image Disk Ram Size ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|} | |} | ||
| Line 160: | Line 173: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| − | ! 01-Host-Management || AIO - Simplex Virtual | + | ! 01-Host-Management || AIO - Simplex Virtual ||AIO - Duplex Virtual|| Standard - Local Storage (2+2) Virtua || Standard - Dedicated Storage (2+2+2) Virtua|| AIO - Simplex BM || AIO - Duplex BM|| Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || Bug |
| + | |- | ||
| + | | 1. Lock Active Controller ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| | ||
|- | |- | ||
| − | | | + | | 2. Lock Unlock Standby Controller || PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
| − | | | + | | 3. Lock Unlock Compute Hosts ||PASS||FAIL|| PASS|| N/A||PASS||PASS||PASS||PASS|| |
|} | |} | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| − | ! | + | ! 02-sanity-platform || AIO - Simplex Virtual ||AIO - Duplex Virtual|| Standard - Local Storage (2+2) Virtua || Standard - Dedicated Storage (2+2+2) Virtua|| AIO - Simplex BM || AIO - Duplex BM|| Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || Bug |
|- | |- | ||
| − | | 1. OpenStack PODs Healthy || | + | | 1. OpenStack PODs Healthy ||FAIL||FAIL||FAIL||N/A||FAIL||FAIL||PASS||PASS|| |
|- | |- | ||
| − | | 2. Reapply STX OpenStack ||PASS || | + | | 2. Reapply STX OpenStack ||PASS ||FAIL ||FAIL||N/A||PASS||FAIL||PASS||PASS|| |
|- | |- | ||
| − | | 3. STX OpenStack Override Update Reset ||PASS ||PASS || PASS|| | + | | 3. STX OpenStack Override Update Reset ||PASS||PASS|| PASS||N/A||PASS||FAIL||PASS||PASS|| |
|- | |- | ||
| − | | 4. Kube System Services || PASS || | + | | 4. Kube System Services ||PASS||FAIL ||FAIL||N/A||FAIL||FAIL||PASS||FAIL|| |
|- | |- | ||
| − | | 5. Create Check Delete POD || | + | | 5. Create Check Delete POD ||FAIL||FAIL||FAIL||N/A||FAIL||FAIL||PASS||FAIL|| |
|} | |} | ||
Revision as of 23:45, 22 May 2019
Sanity Test
Sanity-OpenStack
Tests were not run because provisioning fails
| iso | DATE |
|---|---|
| http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190522T013000Z/ | 22 - MAY- 2019 |
| . | . |
| Provision-Containers | AIO - Simplex Virtual | AIO - Baremetal | bug |
|---|---|---|---|
| 1. Provisioning Simplex System | PASS | PASS | |
| 2. Provisioning Duplex System | PASS | PASS | |
| 3. Provisioning Standard Non-Storage System | PASS | PASS | |
| 4. Provisioning Standard Storage System | N/A | PASS |
| 01-Instance-From-Image | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 2. Create Images for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 3. Create Networks for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 4. Launch Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 5. Suspend Resume Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 6. Set Error Active Flags Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 7. Pause Unpause Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 8. Stop Start Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 9. Lock Unlock Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 10. Reboot Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 11. Rebuild Instances | PASS | PASS | PASS | N/A | PASS | FAIL | PASS | PASS | |
| 12. Resize Instances | FAIL | PASS | PASS | N/A | FAIL | FAIL | PASS | PASS | https://bugs.launchpad.net/starlingx/+bug/1824412 |
| 13. Set Unset Properties Instances | PASS | PASS | PASS | N/A | PASS | FAIL | PASS | PASS | |
| 14. Evacuate Instances From Hosts | PASS | PASS | pas | N/A | PASS | PASS | PASS | PASS |
| 02-Instance-From-Volume | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 2. Create Images for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 3. Create Networks for Instance | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 4. Create Volume for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 5. Launch Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 6. Suspend Resume Instance | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 7. Set Error Active Flags Instance | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 8. Pause Unpause Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 9. Stop Start Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 10. Lock Unlock Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 11. Reboot Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 12. Rebuild Instances | PASS | PASS | PASS | N/A | PASS | FAIL | PASS | PASS | |
| 13. Resize Instances | FAIL | PASS | PASS | N/A | FAIL | FAIL | PASS | PASS | https://bugs.launchpad.net/starlingx/+bug/1824412 |
| 14. Set Unset Properties Instances | PASS | PASS | PASS | N/A | PASS | FAIL | PASS | PASS | https://bugs.launchpad.net/starlingx/+bug/1824412 |
| 15. Evacuate Instances From Hosts | PASS | PASS | FAIL | N/A | PASS | PASS | PASS | PASS |
| 03-Instance-From-Snapshot | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 2. Create Images for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 3. Create Networks for Instance | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 4. Create Volume for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 5. Create Snapshot for Instance | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 6. Launch Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 7. Suspend Resume Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 8. Set Error Active Flags Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 9. Pause Unpause Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 10. Stop Start Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 11. Lock Unlock Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 12. Reboot Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 13. Rebuild Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 14. Resize Instances | FAIL | PASS | PASS | N/A | FAIL | FAIL | PASS | PASS | https://bugs.launchpad.net/starlingx/+bug/1824412 |
| 15. Set Unset Properties Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 16. Evacuate Instances From Hosts | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS |
| 04-Instance-From-Heat-Template | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 2. Create Images for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 3. Create Networks for Instance | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 4. Create Instance Trough Stack | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS |
| 05-Measurements-For-Metric | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Create Image For Metrics | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 2. Update Image Name | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 3. Update Image Disk Ram Size | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS |
| Networking-Tests | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Ping from Controller to Instances | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | |
| 2. Ping Between Instances | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
Sanity-Platform
| 01-Host-Management | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtua | Standard - Dedicated Storage (2+2+2) Virtua | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | Bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Lock Active Controller | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 2. Lock Unlock Standby Controller | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
| 3. Lock Unlock Compute Hosts | PASS | FAIL | PASS | N/A | PASS | PASS | PASS | PASS |
| 02-sanity-platform | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtua | Standard - Dedicated Storage (2+2+2) Virtua | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | Bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. OpenStack PODs Healthy | FAIL | FAIL | FAIL | N/A | FAIL | FAIL | PASS | PASS | |
| 2. Reapply STX OpenStack | PASS | FAIL | FAIL | N/A | PASS | FAIL | PASS | PASS | |
| 3. STX OpenStack Override Update Reset | PASS | PASS | PASS | N/A | PASS | FAIL | PASS | PASS | |
| 4. Kube System Services | PASS | FAIL | FAIL | N/A | FAIL | FAIL | PASS | FAIL | |
| 5. Create Check Delete POD | FAIL | FAIL | FAIL | N/A | FAIL | FAIL | PASS | FAIL |
