Difference between revisions of "StarlingX/Test/SanityTests"
(→Sanity-OpenStack) |
(→Sanity-OpenStack) |
||
| Line 12: | Line 12: | ||
| 3. Create Networks for Instances || - || FAIL || - || PASS || - || PASS || - || PASS | | 3. Create Networks for Instances || - || FAIL || - || PASS || - || PASS || - || PASS | ||
|- | |- | ||
| − | | 4. Launch Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 4. Launch Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 5. Suspend Resume Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 5. Suspend Resume Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 6. Set Error Active Flags Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 6. Set Error Active Flags Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 7. Pause Unpause Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 7. Pause Unpause Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 8. Stop Start Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 8. Stop Start Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 9. Lock Unlock Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 9. Lock Unlock Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 10. Reboot Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 10. Reboot Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 11. Rebuild Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 11. Rebuild Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 12. Resize Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 12. Resize Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 13. Set Unset Properties Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 13. Set Unset Properties Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 14. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || | + | | 14. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL |
|} | |} | ||
| Line 48: | Line 48: | ||
| 4. Create Volume for Instances || - || FAIL || - || PASS || - || PASS || - || PASS | | 4. Create Volume for Instances || - || FAIL || - || PASS || - || PASS || - || PASS | ||
|- | |- | ||
| − | | 5. Launch Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 5. Launch Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 6. Suspend Resume Instance || - || FAIL || - || PASS || - || PASS || - || | + | | 6. Suspend Resume Instance || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 7. Set Error Active Flags Instance || - || FAIL || - || PASS || - || PASS || - || | + | | 7. Set Error Active Flags Instance || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 8. Pause Unpause Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 8. Pause Unpause Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 9. Stop Start Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 9. Stop Start Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 10. Lock Unlock Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 10. Lock Unlock Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 11. Reboot Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 11. Reboot Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | |12. Rebuild Instances || - || FAIL || - || PASS || - || PASS || - || | + | |12. Rebuild Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 13. Resize Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 13. Resize Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 14. Set Unset Properties Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 14. Set Unset Properties Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 15. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || | + | | 15. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL |
|} | |} | ||
| Line 81: | Line 81: | ||
| 3. Create Networks for Instance || - || FAIL || - || PASS || - || PASS || - || PASS | | 3. Create Networks for Instance || - || FAIL || - || PASS || - || PASS || - || PASS | ||
|- | |- | ||
| − | | 4. Create Volume for Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 4. Create Volume for Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 5. Create Snapshot for Instance || - || FAIL || - || PASS || - || PASS || - || | + | | 5. Create Snapshot for Instance || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 6. Launch Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 6. Launch Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 7. Suspend Resume Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 7. Suspend Resume Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 8. Set Error Active Flags Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 8. Set Error Active Flags Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 9. Pause Unpause Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 9. Pause Unpause Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 10. Stop Start Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 10. Stop Start Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 11. Lock Unlock Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 11. Lock Unlock Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 12. Reboot Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 12. Reboot Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 13. Rebuild Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 13. Rebuild Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 14. Resize Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 14. Resize Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 15. Set Unset Properties Instances || - || FAIL || - || PASS || - || PASS || - || | + | | 15. Set Unset Properties Instances || - || FAIL || - || PASS || - || PASS || - || FAIL |
|- | |- | ||
| − | | 16. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || | + | | 16. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL |
|} | |} | ||
Revision as of 01:19, 28 March 2019
Sanity Test
Sanity-OpenStack
| 01-Instance-From-Image | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | - | FAIL | - | PASS | - | PASS | - | PASS |
| 2. Create Images for Instances | - | FAIL | - | PASS | - | PASS | - | PASS |
| 3. Create Networks for Instances | - | FAIL | - | PASS | - | PASS | - | PASS |
| 4. Launch Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 5. Suspend Resume Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 6. Set Error Active Flags Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 7. Pause Unpause Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 8. Stop Start Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 9. Lock Unlock Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 10. Reboot Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 11. Rebuild Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 12. Resize Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 13. Set Unset Properties Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 14. Evacuate Instances From Hosts | N/A | FAIL | - | PASS | - | PASS | - | FAIL |
| 02-Instance-From-Volume | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | - | FAIL | - | PASS | - | PASS | - | PASS |
| 2. Create Images for Instances | - | FAIL | - | PASS | - | PASS | - | PASS |
| 3. Create Networks for Instance | - | FAIL | - | PASS | - | PASS | - | PASS |
| 4. Create Volume for Instances | - | FAIL | - | PASS | - | PASS | - | PASS |
| 5. Launch Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 6. Suspend Resume Instance | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 7. Set Error Active Flags Instance | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 8. Pause Unpause Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 9. Stop Start Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 10. Lock Unlock Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 11. Reboot Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 12. Rebuild Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 13. Resize Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 14. Set Unset Properties Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 15. Evacuate Instances From Hosts | N/A | FAIL | - | PASS | - | PASS | - | FAIL |
| 03-Instance-From-Snapshot | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | - | FAIL | - | PASS | - | PASS | - | PASS |
| 2. Create Images for Instances | - | FAIL | - | PASS | - | PASS | - | PASS |
| 3. Create Networks for Instance | - | FAIL | - | PASS | - | PASS | - | PASS |
| 4. Create Volume for Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 5. Create Snapshot for Instance | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 6. Launch Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 7. Suspend Resume Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 8. Set Error Active Flags Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 9. Pause Unpause Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 10. Stop Start Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 11. Lock Unlock Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 12. Reboot Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 13. Rebuild Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 14. Resize Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 15. Set Unset Properties Instances | - | FAIL | - | PASS | - | PASS | - | FAIL |
| 16. Evacuate Instances From Hosts | N/A | FAIL | - | PASS | - | PASS | - | FAIL |
| 04-Instance-From-Heat-Template | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
|---|---|---|---|---|---|---|---|---|
| 1. Create Flavors for Instances | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
| 2. Create Images for Instances | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
| 3. Create Networks for Instance | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
| 4. Create Instance Trough Stack | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | FAIL |
| 05-Measurements-For-Metric | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
|---|---|---|---|---|---|---|---|---|
| 1. Create Image For Metrics | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
| 2. Update Image Name | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
| 3. Update Image Disk Ram Size | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
Sanity-Platform
| 01-Host-Management | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
|---|---|---|---|---|---|---|---|---|
| 1. Add Controller Host Simplex | FAIL | FAIL | N/A | N/A | N/A | N/A | N/A | N/A |
| 2. Swact Controller Host Simplex | FAIL | FAIL | N/A | N/A | N/A | N/A | N/A | N/A |
| 01-Host-Management | AIO - Simplex Virtual | AIO - Simplex BM | AIO - Duplex Virtual | AIO - Duplex BM | Standard - Local Storage (2+2) Virtual | Standard - Local Storage (2+2) BM | Standard - Dedicated Storage (2+2+2) Virtual | Standard - Dedicated Storage (2+2+2) BM |
|---|---|---|---|---|---|---|---|---|
| 1. OpenStack PODs Healthy | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
| 2. Reapply STX OpenStack | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
| 3. STX OpenStack Override Update Reset | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
| 4. Kube System Services | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
| 5. Create Check Delete POD | FAIL | FAIL | PASS | PASS | PASS | PASS | PASS | PASS |
| Total test | 64 |
|---|
