Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(Sanity-OpenStack)
(Sanity-OpenStack)
Line 6: Line 6:
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
 
|-
 
|-
| 1. Create Flavors for Instances || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 1. Create Flavors for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 2. Create Images for Instances || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 2. Create Images for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 3. Create Networks for Instances || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 3. Create Networks for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 4. Launch Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 4. Launch Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 5. Suspend Resume Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 5. Suspend Resume Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 6. Set Error Active Flags Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 6. Set Error Active Flags Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 7. Pause Unpause Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 7. Pause Unpause Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 8. Stop Start Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 8. Stop Start Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 9. Lock Unlock Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 9. Lock Unlock Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 10. Reboot Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 10. Reboot Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 11. Rebuild Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 11. Rebuild Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 12. Resize Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 12. Resize Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 13. Set Unset Properties Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 13. Set Unset Properties Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
 
| 14. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL
 
| 14. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL
Line 44: Line 44:
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
 
|-
 
|-
| 1. Create Flavors for Instances || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 1. Create Flavors for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 2. Create Images for Instances || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 2. Create Images for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 3. Create Networks for Instance || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 3. Create Networks for Instance || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 4. Create Volume for Instances || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 4. Create Volume for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 5. Launch Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 5. Launch Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 6. Suspend Resume Instance || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 6. Suspend Resume Instance || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 7. Set Error Active Flags Instance || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 7. Set Error Active Flags Instance || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 8. Pause Unpause Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 8. Pause Unpause Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 9. Stop Start Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 9. Stop Start Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 10. Lock Unlock Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 10. Lock Unlock Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 11. Reboot Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 11. Reboot Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
|12. Rebuild Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
|12. Rebuild Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 13. Resize Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 13. Resize Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 14. Set Unset Properties Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 14. Set Unset Properties Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
 
| 15. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL
 
| 15. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL
Line 84: Line 84:
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
 
|-
 
|-
| 1. Create Flavors for Instances || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 1. Create Flavors for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 2. Create Images for Instances || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 2. Create Images for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 3. Create Networks for Instance || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 3. Create Networks for Instance || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 4. Create Volume for Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 4. Create Volume for Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 5. Create Snapshot for Instance || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 5. Create Snapshot for Instance || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 6. Launch Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 6. Launch Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 7. Suspend Resume Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 7. Suspend Resume Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 8. Set Error Active Flags Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 8. Set Error Active Flags Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 9. Pause Unpause Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 9. Pause Unpause Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 10. Stop Start Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 10. Stop Start Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 11. Lock Unlock Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 11. Lock Unlock Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 12. Reboot Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 12. Reboot Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 13. Rebuild Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 13. Rebuild Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 14. Resize Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 14. Resize Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
| 15. Set Unset Properties Instances || - || FAIL || - || PASS || - || PASS || - || FAIL
+
| 15. Set Unset Properties Instances || FAIL || FAIL || - || PASS || - || PASS || - || FAIL
 
|-
 
|-
 
| 16. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL
 
| 16. Evacuate Instances From Hosts || N/A || FAIL || - || PASS || - || PASS || - || FAIL
Line 126: Line 126:
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
 
|-
 
|-
| 1. Create Flavors for Instances || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 1. Create Flavors for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 2. Create Images for Instances || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 2. Create Images for Instances || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 3. Create Networks for Instance || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 3. Create Networks for Instance || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 4. Create Instance Trough Stack || - || FAIL || - || FAIL || - || FAIL || - || FAIL
+
| 4. Create Instance Trough Stack || FAIL || FAIL || - || FAIL || - || FAIL || - || FAIL
 
|}
 
|}
  
Line 139: Line 139:
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
 
|-
 
|-
| 1. Create Image For Metrics || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 1. Create Image For Metrics || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 2. Update Image Name || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 2. Update Image Name || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|-
 
|-
| 3. Update Image Disk Ram Size || - || FAIL || - || PASS || - || PASS || - || PASS
+
| 3. Update Image Disk Ram Size || FAIL || FAIL || - || PASS || - || PASS || - || PASS
 
|}
 
|}
  

Revision as of 21:41, 28 March 2019

Sanity Test

Sanity-OpenStack

01-Instance-From-Image AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM
1. Create Flavors for Instances FAIL FAIL - PASS - PASS - PASS
2. Create Images for Instances FAIL FAIL - PASS - PASS - PASS
3. Create Networks for Instances FAIL FAIL - PASS - PASS - PASS
4. Launch Instances FAIL FAIL - PASS - PASS - FAIL
5. Suspend Resume Instances FAIL FAIL - PASS - PASS - FAIL
6. Set Error Active Flags Instances FAIL FAIL - PASS - PASS - FAIL
7. Pause Unpause Instances FAIL FAIL - PASS - PASS - FAIL
8. Stop Start Instances FAIL FAIL - PASS - PASS - FAIL
9. Lock Unlock Instances FAIL FAIL - PASS - PASS - FAIL
10. Reboot Instances FAIL FAIL - PASS - PASS - FAIL
11. Rebuild Instances FAIL FAIL - PASS - PASS - FAIL
12. Resize Instances FAIL FAIL - PASS - PASS - FAIL
13. Set Unset Properties Instances FAIL FAIL - PASS - PASS - FAIL
14. Evacuate Instances From Hosts N/A FAIL - PASS - PASS - FAIL
15. Ping from Controller to Instances - - - - - - - -
16. Ping Between Instances - - - - - - - -
02-Instance-From-Volume AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM
1. Create Flavors for Instances FAIL FAIL - PASS - PASS - PASS
2. Create Images for Instances FAIL FAIL - PASS - PASS - PASS
3. Create Networks for Instance FAIL FAIL - PASS - PASS - PASS
4. Create Volume for Instances FAIL FAIL - PASS - PASS - PASS
5. Launch Instances FAIL FAIL - PASS - PASS - FAIL
6. Suspend Resume Instance FAIL FAIL - PASS - PASS - FAIL
7. Set Error Active Flags Instance FAIL FAIL - PASS - PASS - FAIL
8. Pause Unpause Instances FAIL FAIL - PASS - PASS - FAIL
9. Stop Start Instances FAIL FAIL - PASS - PASS - FAIL
10. Lock Unlock Instances FAIL FAIL - PASS - PASS - FAIL
11. Reboot Instances FAIL FAIL - PASS - PASS - FAIL
12. Rebuild Instances FAIL FAIL - PASS - PASS - FAIL
13. Resize Instances FAIL FAIL - PASS - PASS - FAIL
14. Set Unset Properties Instances FAIL FAIL - PASS - PASS - FAIL
15. Evacuate Instances From Hosts N/A FAIL - PASS - PASS - FAIL
16. Ping from Controller to Instances - - - - - - - -
17. Ping Between Instances - - - - - - - -
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM
1. Create Flavors for Instances FAIL FAIL - PASS - PASS - PASS
2. Create Images for Instances FAIL FAIL - PASS - PASS - PASS
3. Create Networks for Instance FAIL FAIL - PASS - PASS - PASS
4. Create Volume for Instances FAIL FAIL - PASS - PASS - FAIL
5. Create Snapshot for Instance FAIL FAIL - PASS - PASS - FAIL
6. Launch Instances FAIL FAIL - PASS - PASS - FAIL
7. Suspend Resume Instances FAIL FAIL - PASS - PASS - FAIL
8. Set Error Active Flags Instances FAIL FAIL - PASS - PASS - FAIL
9. Pause Unpause Instances FAIL FAIL - PASS - PASS - FAIL
10. Stop Start Instances FAIL FAIL - PASS - PASS - FAIL
11. Lock Unlock Instances FAIL FAIL - PASS - PASS - FAIL
12. Reboot Instances FAIL FAIL - PASS - PASS - FAIL
13. Rebuild Instances FAIL FAIL - PASS - PASS - FAIL
14. Resize Instances FAIL FAIL - PASS - PASS - FAIL
15. Set Unset Properties Instances FAIL FAIL - PASS - PASS - FAIL
16. Evacuate Instances From Hosts N/A FAIL - PASS - PASS - FAIL
17. Ping from Controller to Instances - - - - - - - -
18. Ping Between Instances - - - - - - - -
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM
1. Create Flavors for Instances FAIL FAIL - PASS - PASS - PASS
2. Create Images for Instances FAIL FAIL - PASS - PASS - PASS
3. Create Networks for Instance FAIL FAIL - PASS - PASS - PASS
4. Create Instance Trough Stack FAIL FAIL - FAIL - FAIL - FAIL
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM
1. Create Image For Metrics FAIL FAIL - PASS - PASS - PASS
2. Update Image Name FAIL FAIL - PASS - PASS - PASS
3. Update Image Disk Ram Size FAIL FAIL - PASS - PASS - PASS

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM
1. Add Controller Host Simplex - FAIL N/A N/A N/A N/A N/A N/A
2. Swact Controller Host Simplex - FAIL N/A N/A N/A N/A N/A N/A
01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM
1. OpenStack PODs Healthy - FAIL - PASS - PASS - PASS
2. Reapply STX OpenStack - FAIL - PASS - PASS - PASS
3. STX OpenStack Override Update Reset - FAIL - PASS - PASS - PASS
4. Kube System Services - FAIL - PASS - PASS - PASS
5. Create Check Delete POD - FAIL - FAIL - FAIL - FAIL
Total test 64