Difference between revisions of "StarlingX/Test/SanityTests"
(→Sanity-OpenStack) |
(→Sanity-OpenStack) |
||
| Line 9: | Line 9: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| − | ! 01-Instance-From-Image || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - | + | ! 01-Instance-From-Image || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug |
|- | |- | ||
| 1. Create Flavors for Instances || PASS || PASS || PASS || PASS || PASS || PASS || PASS || PASS || | | 1. Create Flavors for Instances || PASS || PASS || PASS || PASS || PASS || PASS || PASS || PASS || | ||
| Line 43: | Line 43: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| − | ! 02-Instance-From-Volume || AIO - Simplex Virtual | + | ! 02-Instance-From-Volume || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug |
|- | |- | ||
| 1. Create Flavors for Instances || PASS || PASS || PASS || PASS || PASS || PASS || PASS || PASS || | | 1. Create Flavors for Instances || PASS || PASS || PASS || PASS || PASS || PASS || PASS || PASS || | ||
| Line 79: | Line 79: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| − | ! 03-Instance-From-Snapshot || AIO - Simplex Virtual | + | ! 03-Instance-From-Snapshot || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug |
|- | |- | ||
| 1. Create Flavors for Instances || PASS || PASS || PASS || PASS || PASS || PASS || PASS || PASS | | 1. Create Flavors for Instances || PASS || PASS || PASS || PASS || PASS || PASS || PASS || PASS | ||
| Line 118: | Line 118: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| − | ! 04-Instance-From-Heat-Template || AIO - Simplex Virtual | + | ! 04-Instance-From-Heat-Template || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug |
|- | |- | ||
| 1. Create Flavors for Instances || PASS || PASS || PASS || PASS || PASS || PASS || PASS || PASS | | 1. Create Flavors for Instances || PASS || PASS || PASS || PASS || PASS || PASS || PASS || PASS | ||
| Line 131: | Line 131: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| − | ! 05-Measurements-For-Metric || AIO - Simplex Virtual | + | ! 05-Measurements-For-Metric || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug |
|- | |- | ||
| 1. Create Image For Metrics || PASS || PASS || PASS || PASS || PASS || PASS || PASS || PASS | | 1. Create Image For Metrics || PASS || PASS || PASS || PASS || PASS || PASS || PASS || PASS | ||
| Line 142: | Line 142: | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
| − | ! Networking-Tests || AIO - Simplex Virtual | + | ! Networking-Tests || AIO - Simplex Virtual || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug |
|- | |- | ||
| 1. Ping from Controller to Instances || N/A || N/A || N/A || N/A || FAIL || FAIL || FAIL || FAIL|| https://bugs.launchpad.net/starlingx/+bug/1821938 | | 1. Ping from Controller to Instances || N/A || N/A || N/A || N/A || FAIL || FAIL || FAIL || FAIL|| https://bugs.launchpad.net/starlingx/+bug/1821938 | ||
Revision as of 22:24, 9 April 2019
Sanity Test
Sanity-OpenStack
| iso | DATE |
|---|---|
| http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190408T233001Z/outputs/iso/ | 8 - April - 2019 |
| 01-Instance-From-Image | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 2. Create Images for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 3. Create Networks for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 4. Launch Instances | PASS | PASS | PASS | PASS | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 5. Suspend Resume Instances | PASS | PASS | PASS | PASS | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 6. Set Error Active Flags Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 7. Pause Unpause Instances | PASS | PASS | PASS | PASS | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 8. Stop Start Instances | PASS | PASS | PASS | PASS | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 9. Lock Unlock Instances | PASS | PASS | PASS | PASS | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 10. Reboot Instances | PASS | PASS | PASS | PASS | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 11. Rebuild Instances | PASS | PASS | PASS | PASS | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 12. Resize Instances | PASS | PASS | PASS | PASS | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 13. Set Unset Properties Instances | PASS | PASS | PASS | PASS | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 14. Evacuate Instances From Hosts | N/A | N/A | PASS | PASS | PASS | PASS | PASS | PASS |
| 02-Instance-From-Volume | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 2. Create Images for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 3. Create Networks for Instance | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 4. Create Volume for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 5. Launch Instances | PASS | PASS | PASS | PASS | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1823275 |
| 6. Suspend Resume Instance | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 7. Set Error Active Flags Instance | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 8. Pause Unpause Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 9. Stop Start Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 10. Lock Unlock Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 11. Reboot Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 12. Rebuild Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 13. Resize Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 14. Set Unset Properties Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 15. Evacuate Instances From Hosts | N/A | N/A | PASS | PASS | PASS | PASS | PASS | PASS |
| 03-Instance-From-Snapshot | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 2. Create Images for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 3. Create Networks for Instance | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 4. Create Volume for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 5. Create Snapshot for Instance | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 6. Launch Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 7. Suspend Resume Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 8. Set Error Active Flags Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 9. Pause Unpause Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 10. Stop Start Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 11. Lock Unlock Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 12. Reboot Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 13. Rebuild Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 14. Resize Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 15. Set Unset Properties Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 16. Evacuate Instances From Hosts | N/A | N/A | PASS | PASS | PASS | PASS | PASS | PASS |
| 04-Instance-From-Heat-Template | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 2. Create Images for Instances | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 3. Create Networks for Instance | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 4. Create Instance Trough Stack | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS |
| 05-Measurements-For-Metric | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Create Image For Metrics | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 2. Update Image Name | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 3. Update Image Disk Ram Size | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS |
| Networking-Tests | AIO - Simplex Virtual | AIO - Duplex Virtual | Standard - Local Storage (2+2) Virtual | Standard - Dedicated Storage (2+2+2) Virtual | AIO - Simplex BM | AIO - Duplex BM | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) BM | bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. Ping from Controller to Instances | N/A | N/A | N/A | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 2. Ping Between Instances | N/A | N/A | N/A | N/A | FAIL | FAIL | FAIL | FAIL | https://bugs.launchpad.net/starlingx/+bug/1821938 |
Sanity-Platform
| 01-Host-Management | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
|---|---|---|---|---|---|---|---|---|
| 1. Add Controller Host Simplex | PASS | PASS | N/A | N/A | N/A | N/A | N/A | N/A |
| 2. Swact Controller Host Simplex | PASS | PASS | N/A | N/A | N/A | N/A | N/A | N/A |
| 01-Host-Management | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM | Bug |
|---|---|---|---|---|---|---|---|---|---|
| 1. OpenStack PODs Healthy | PASS | FAIL | PASS | PASS | PASS | PASS | PASS | PASS | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 2. Reapply STX OpenStack | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 3. STX OpenStack Override Update Reset | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | |
| 4. Kube System Services | PASS | FAIL | PASS | PASS | PASS | PASS | PASS | PASS | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| 5. Create Check Delete POD | PASS | FAIL | PASS | PASS | PASS | PASS | PASS | PASS | https://bugs.launchpad.net/starlingx/+bug/1821938 |
| Total test | 64 |
|---|
