Difference between revisions of "StarlingX/Test/SanityTests"
(→Sanity-OpenStack) |
(→Sanity-Platform) |
||
Line 175: | Line 175: | ||
! 01-Host-Management || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM || Bug | ! 01-Host-Management || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM || Bug | ||
|- | |- | ||
− | | 1. | + | | 1. Lock Active Controller ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
− | | 2. | + | | 2. Lock Unlock Standby Controller || PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS|| |
+ | |- | ||
+ | | 3. Lock Unlock Compute Hosts ||FAIL||FAIL|| FAIL|| N/A||PASS||PASS||PASS||PASS|| | ||
|} | |} | ||
Line 184: | Line 186: | ||
! 01-Host-Management || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM || Bug | ! 01-Host-Management || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM || Bug | ||
|- | |- | ||
− | | 1. OpenStack PODs Healthy ||PASS ||PASS || | + | | 1. OpenStack PODs Healthy ||PASS ||PASS ||FAIL||N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
− | | 2. Reapply STX OpenStack ||PASS ||PASS || | + | | 2. Reapply STX OpenStack ||PASS ||PASS ||FAIL||N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
− | | 3. STX OpenStack Override Update Reset || | + | | 3. STX OpenStack Override Update Reset ||FAIL||N/A|| PASS|| PASS||PASS||PASS||PASS||PASS|| |
|- | |- | ||
− | | 4. Kube System Services || PASS ||PASS || | + | | 4. Kube System Services || PASS ||PASS ||FAIL||N/A||PASS||PASS||PASS||PASS|| |
|- | |- | ||
− | | 5. Create Check Delete POD ||PASS ||PASS || | + | | 5. Create Check Delete POD ||PASS ||PASS ||FAIL||N/A||PASS||PASS||PASS||PASS|| |
|} | |} |
Revision as of 21:24, 22 May 2019
Sanity Test
Sanity-OpenStack
Tests were not run because provisioning fails
iso | DATE |
---|---|
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190522T013000Z/ | 22 - MAY- 2019 |
https://bugs.launchpad.net/starlingx/+bug/1829299 | SRIOV and Multus images not pulled from local mirror registry |
https://bugs.launchpad.net/starlingx/+bug/1828059 | cinder volume create failed |
Provision-Containers | AIO - Simplex Virtual | AIO - Baremetal | bug |
---|---|---|---|
1. Provisioning Simplex System | PASS | PASS | |
2. Provisioning Duplex System | PASS | PASS | |
3. Provisioning Standard Non-Storage System | PASS | PASS | |
4. Provisioning Standard Storage System | N/A | PASS |
01-Instance-From-Image | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
2. Create Images for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
3. Create Networks for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
4. Launch Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 | |
6. Set Error Active Flags Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
7. Pause Unpause Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
8. Stop Start Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
9. Lock Unlock Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
10. Reboot Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
11. Rebuild Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
12. Resize Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 | |
14. Evacuate Instances From Hosts | PASS | PASS | FAIL | N/A | PASS | PASS | PASS | PASS |
02-Instance-From-Volume | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
2. Create Images for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
3. Create Networks for Instance | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
4. Create Volume for Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
5. Launch Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
6. Suspend Resume Instance | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
7. Set Error Active Flags Instance | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
8. Pause Unpause Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
9. Stop Start Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
10. Lock Unlock Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
11. Reboot Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
12. Rebuild Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
13. Resize Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
14. Set Unset Properties Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
15. Evacuate Instances From Hosts | PASS | PASS | FAIL | N/A | PASS | PASS | PASS | PASS |
03-Instance-From-Snapshot | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
2. Create Images for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
3. Create Networks for Instance | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
4. Create Volume for Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
5. Create Snapshot for Instance | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
6. Launch Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
7. Suspend Resume Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
8. Set Error Active Flags Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
9. Pause Unpause Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
10. Stop Start Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
11. Lock Unlock Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
12. Reboot Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
13. Rebuild Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
14. Resize Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
15. Set Unset Properties Instances | PASS | PASS | PASS | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1828059 |
16. Evacuate Instances From Hosts | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS |
04-Instance-From-Heat-Template | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
2. Create Images for Instances | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
3. Create Networks for Instance | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
4. Create Instance Trough Stack | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS |
05-Measurements-For-Metric | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Create Image For Metrics | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
2. Update Image Name | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
3. Update Image Disk Ram Size | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS |
Networking-Tests | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Ping from Controller to Instances | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | |
2. Ping Between Instances | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
Sanity-Platform
01-Host-Management | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM | Bug |
---|---|---|---|---|---|---|---|---|---|
1. Lock Active Controller | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
2. Lock Unlock Standby Controller | PASS | PASS | PASS | N/A | PASS | PASS | PASS | PASS | |
3. Lock Unlock Compute Hosts | FAIL | FAIL | FAIL | N/A | PASS | PASS | PASS | PASS |
01-Host-Management | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM | Bug |
---|---|---|---|---|---|---|---|---|---|
1. OpenStack PODs Healthy | PASS | PASS | FAIL | N/A | PASS | PASS | PASS | PASS | |
2. Reapply STX OpenStack | PASS | PASS | FAIL | N/A | PASS | PASS | PASS | PASS | |
3. STX OpenStack Override Update Reset | FAIL | N/A | PASS | PASS | PASS | PASS | PASS | PASS | |
4. Kube System Services | PASS | PASS | FAIL | N/A | PASS | PASS | PASS | PASS | |
5. Create Check Delete POD | PASS | PASS | FAIL | N/A | PASS | PASS | PASS | PASS |