Difference between revisions of "StarlingX/Test/SanityTests"
(→Sanity-Platform) |
(→Sanity-OpenStack) |
||
Line 5: | Line 5: | ||
! iso || DATE | ! iso || DATE | ||
|- | |- | ||
− | | http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/ | + | | http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190417T142021Z/outputs/iso/|| 17 - April - 2019 |
|- | |- | ||
| NOTE: all tests are failing because provisioning is not complete || https://bugs.launchpad.net/starlingx/+bug/1825045 , https://bugs.launchpad.net/starlingx/+bug/1824994 | | NOTE: all tests are failing because provisioning is not complete || https://bugs.launchpad.net/starlingx/+bug/1825045 , https://bugs.launchpad.net/starlingx/+bug/1824994 |
Revision as of 23:58, 17 April 2019
Sanity Test
Sanity-OpenStack
iso | DATE |
---|---|
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190417T142021Z/outputs/iso/ | 17 - April - 2019 |
NOTE: all tests are failing because provisioning is not complete | https://bugs.launchpad.net/starlingx/+bug/1825045 , https://bugs.launchpad.net/starlingx/+bug/1824994 |
01-Instance-From-Image | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
2. Create Images for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
3. Create Networks for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
4. Launch Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
5. Suspend Resume Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
6. Set Error Active Flags Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
7. Pause Unpause Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
8. Stop Start Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
9. Lock Unlock Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
10. Reboot Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
11. Rebuild Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
12. Resize Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
13. Set Unset Properties Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
14. Evacuate Instances From Hosts | NA | NA | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
02-Instance-From-Volume | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
2. Create Images for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
3. Create Networks for Instance | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
4. Create Volume for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
5. Launch Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
6. Suspend Resume Instance | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
7. Set Error Active Flags Instance | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
8. Pause Unpause Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
9. Stop Start Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
10. Lock Unlock Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
11. Reboot Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
12. Rebuild Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
13. Resize Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
14. Set Unset Properties Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
15. Evacuate Instances From Hosts | NA | NA | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
03-Instance-From-Snapshot | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
2. Create Images for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
3. Create Networks for Instance | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
4. Create Volume for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
5. Create Snapshot for Instance | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
6. Launch Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
7. Suspend Resume Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
8. Set Error Active Flags Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
9. Pause Unpause Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
10. Stop Start Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
11. Lock Unlock Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
12. Reboot Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
13. Rebuild Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
14. Resize Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
15. Set Unset Properties Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
16. Evacuate Instances From Hosts | NA | NA | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
04-Instance-From-Heat-Template | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
2. Create Images for Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
3. Create Networks for Instance | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
4. Create Instance Trough Stack | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
05-Measurements-For-Metric | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Create Image For Metrics | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
2. Update Image Name | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
3. Update Image Disk Ram Size | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
Networking-Tests | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
---|---|---|---|---|---|---|---|---|---|
1. Ping from Controller to Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
2. Ping Between Instances | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1825045 |
Sanity-Platform
01-Host-Management | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM | Bug |
---|---|---|---|---|---|---|---|---|---|
1. Add Controller Host Simplex | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | |
2. Swact Controller Host Simplex | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL |
01-Host-Management | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM | Bug |
---|---|---|---|---|---|---|---|---|---|
1. OpenStack PODs Healthy | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | |
2. Reapply STX OpenStack | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | |
3. STX OpenStack Override Update Reset | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | |
4. Kube System Services | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL | |
5. Create Check Delete POD | PASS | N/A | N/A | N/A | N/A | N/A | N/A | N/A |