Difference between revisions of "StarlingX/Test/SanityTests"
(→Sanity-OpenStack) |
(→Sanity-OpenStack) |
||
Line 6: | Line 6: | ||
! 01-Instance-From-Image || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM | ! 01-Instance-From-Image || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM | ||
|- | |- | ||
− | | 1. Create Flavors for Instances || | + | | 1. Create Flavors for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 2. Create Images for Instances || | + | | 2. Create Images for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 3. Create Networks for Instances || | + | | 3. Create Networks for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 4. Launch Instances || | + | | 4. Launch Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 5. Suspend Resume Instances || | + | | 5. Suspend Resume Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 6. Set Error Active Flags Instances || | + | | 6. Set Error Active Flags Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 7. Pause Unpause Instances || | + | | 7. Pause Unpause Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 8. Stop Start Instances || | + | | 8. Stop Start Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 9. Lock Unlock Instances || | + | | 9. Lock Unlock Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 10. Reboot Instances || | + | | 10. Reboot Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 11. Rebuild Instances || | + | | 11. Rebuild Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 12. Resize Instances || | + | | 12. Resize Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 13. Set Unset Properties Instances || | + | | 13. Set Unset Properties Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| 14. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL | | 14. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL | ||
Line 44: | Line 44: | ||
! 02-Instance-From-Volume || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM | ! 02-Instance-From-Volume || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM | ||
|- | |- | ||
− | | 1. Create Flavors for Instances || | + | | 1. Create Flavors for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 2. Create Images for Instances || | + | | 2. Create Images for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 3. Create Networks for Instance || | + | | 3. Create Networks for Instance || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 4. Create Volume for Instances || | + | | 4. Create Volume for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 5. Launch Instances || | + | | 5. Launch Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 6. Suspend Resume Instance || | + | | 6. Suspend Resume Instance || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 7. Set Error Active Flags Instance || | + | | 7. Set Error Active Flags Instance || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 8. Pause Unpause Instances || | + | | 8. Pause Unpause Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 9. Stop Start Instances || | + | | 9. Stop Start Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 10. Lock Unlock Instances || | + | | 10. Lock Unlock Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 11. Reboot Instances || | + | | 11. Reboot Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | |12. Rebuild Instances || | + | |12. Rebuild Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 13. Resize Instances || | + | | 13. Resize Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 14. Set Unset Properties Instances || | + | | 14. Set Unset Properties Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| 15. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL | | 15. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL | ||
Line 84: | Line 84: | ||
! 03-Instance-From-Snapshot || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM | ! 03-Instance-From-Snapshot || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM | ||
|- | |- | ||
− | | 1. Create Flavors for Instances || | + | | 1. Create Flavors for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 2. Create Images for Instances || | + | | 2. Create Images for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 3. Create Networks for Instance || | + | | 3. Create Networks for Instance || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 4. Create Volume for Instances || | + | | 4. Create Volume for Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 5. Create Snapshot for Instance || | + | | 5. Create Snapshot for Instance || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 6. Launch Instances || | + | | 6. Launch Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 7. Suspend Resume Instances || | + | | 7. Suspend Resume Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 8. Set Error Active Flags Instances || | + | | 8. Set Error Active Flags Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 9. Pause Unpause Instances || | + | | 9. Pause Unpause Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 10. Stop Start Instances || | + | | 10. Stop Start Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 11. Lock Unlock Instances || | + | | 11. Lock Unlock Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 12. Reboot Instances || | + | | 12. Reboot Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 13. Rebuild Instances || | + | | 13. Rebuild Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 14. Resize Instances || | + | | 14. Resize Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
− | | 15. Set Unset Properties Instances || | + | | 15. Set Unset Properties Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| 16. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL | | 16. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL | ||
Line 126: | Line 126: | ||
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM | ! 04-Instance-From-Heat-Template || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM | ||
|- | |- | ||
− | | 1. Create Flavors for Instances || | + | | 1. Create Flavors for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 2. Create Images for Instances || | + | | 2. Create Images for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 3. Create Networks for Instance || | + | | 3. Create Networks for Instance || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 4. Create Instance Trough Stack || | + | | 4. Create Instance Trough Stack || FAIL || FAIL || - || FAIL || - || FAIL || - || FAIL |
|} | |} | ||
Line 139: | Line 139: | ||
! 05-Measurements-For-Metric || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM | ! 05-Measurements-For-Metric || AIO - Simplex Virtual || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM | ||
|- | |- | ||
− | | 1. Create Image For Metrics || | + | | 1. Create Image For Metrics || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 2. Update Image Name || | + | | 2. Update Image Name || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|- | |- | ||
− | | 3. Update Image Disk Ram Size || | + | | 3. Update Image Disk Ram Size || FAIL || FAIL || - || PASS || - || PASS || - || PASS |
|} | |} | ||
Revision as of 21:41, 28 March 2019
Sanity Test
Sanity-OpenStack
01-Instance-From-Image | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
2. Create Images for Instances | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
3. Create Networks for Instances | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
4. Launch Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
5. Suspend Resume Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
6. Set Error Active Flags Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
7. Pause Unpause Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
8. Stop Start Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
9. Lock Unlock Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
10. Reboot Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
11. Rebuild Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
12. Resize Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
13. Set Unset Properties Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
14. Evacuate Instances From Hosts | N/A | FAIL | - | PASS | - | PASS | - | FAIL |
15. Ping from Controller to Instances | - | - | - | - | - | - | - | - |
16. Ping Between Instances | - | - | - | - | - | - | - | - |
02-Instance-From-Volume | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
2. Create Images for Instances | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
3. Create Networks for Instance | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
4. Create Volume for Instances | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
5. Launch Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
6. Suspend Resume Instance | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
7. Set Error Active Flags Instance | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
8. Pause Unpause Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
9. Stop Start Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
10. Lock Unlock Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
11. Reboot Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
12. Rebuild Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
13. Resize Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
14. Set Unset Properties Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
15. Evacuate Instances From Hosts | N/A | FAIL | - | PASS | - | PASS | - | FAIL |
16. Ping from Controller to Instances | - | - | - | - | - | - | - | - |
17. Ping Between Instances | - | - | - | - | - | - | - | - |
03-Instance-From-Snapshot | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
2. Create Images for Instances | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
3. Create Networks for Instance | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
4. Create Volume for Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
5. Create Snapshot for Instance | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
6. Launch Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
7. Suspend Resume Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
8. Set Error Active Flags Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
9. Pause Unpause Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
10. Stop Start Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
11. Lock Unlock Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
12. Reboot Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
13. Rebuild Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
14. Resize Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
15. Set Unset Properties Instances | FAIL | FAIL | - | PASS | - | PASS | - | FAIL |
16. Evacuate Instances From Hosts | N/A | FAIL | - | PASS | - | PASS | - | FAIL |
17. Ping from Controller to Instances | - | - | - | - | - | - | - | - |
18. Ping Between Instances | - | - | - | - | - | - | - | - |
04-Instance-From-Heat-Template | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
---|---|---|---|---|---|---|---|---|
1. Create Flavors for Instances | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
2. Create Images for Instances | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
3. Create Networks for Instance | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
4. Create Instance Trough Stack | FAIL | FAIL | - | FAIL | - | FAIL | - | FAIL |
05-Measurements-For-Metric | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
---|---|---|---|---|---|---|---|---|
1. Create Image For Metrics | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
2. Update Image Name | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
3. Update Image Disk Ram Size | FAIL | FAIL | - | PASS | - | PASS | - | PASS |
Sanity-Platform
01-Host-Management | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
---|---|---|---|---|---|---|---|---|
1. Add Controller Host Simplex | - | FAIL | N/A | N/A | N/A | N/A | N/A | N/A |
2. Swact Controller Host Simplex | - | FAIL | N/A | N/A | N/A | N/A | N/A | N/A |
01-Host-Management | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
---|---|---|---|---|---|---|---|---|
1. OpenStack PODs Healthy | - | FAIL | - | PASS | - | PASS | - | PASS |
2. Reapply STX OpenStack | - | FAIL | - | PASS | - | PASS | - | PASS |
3. STX OpenStack Override Update Reset | - | FAIL | - | PASS | - | PASS | - | PASS |
4. Kube System Services | - | FAIL | - | PASS | - | PASS | - | PASS |
5. Create Check Delete POD | - | FAIL | - | FAIL | - | FAIL | - | FAIL |
Total test | 64 |
---|