Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(Sanity-OpenStack)
(Sanity-Platform)
Line 186: Line 186:
 
! 01-Host-Management || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM || Bug
 
! 01-Host-Management || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM || Bug
 
|-
 
|-
| 1. OpenStack PODs Healthy ||FAIL||FAIL||FAIL||N/A||PASS||PASS||PASS||PASS||
+
| 1. OpenStack PODs Healthy ||FAIL||FAIL||FAIL||N/A||FAIL||FAIL||FAIL||FAIL||
 
|-
 
|-
| 2. Reapply STX OpenStack ||FAIL ||FAIL ||FAIL||N/A||PASS||PASS||PASS||PASS||
+
| 2. Reapply STX OpenStack ||FAIL ||FAIL ||FAIL||N/A||FAIL||FAIL||FAIL||FAIL||
 
|-
 
|-
| 3. STX OpenStack Override Update Reset ||PASS||PASS|| PASS||N/A||PASS||PASS||PASS||PASS||
+
| 3. STX OpenStack Override Update Reset ||PASS||PASS|| PASS||N/A||FAIL||FAIL||FAIL||FAIL||
 
|-
 
|-
| 4. Kube System Services ||FAIL||FAIL ||FAIL||N/A||PASS||PASS||PASS||PASS||
+
| 4. Kube System Services ||FAIL||FAIL ||FAIL||N/A||FAIL||FAIL||FAIL||FAIL||
 
|-
 
|-
| 5. Create Check Delete POD ||FAIL||FAIL||FAIL||N/A||PASS||PASS||PASS||PASS||
+
| 5. Create Check Delete POD ||FAIL||FAIL||FAIL||N/A||FAIL||FAIL||FAIL||FAIL||
 
|}
 
|}

Revision as of 22:04, 22 May 2019

Sanity Test

Sanity-OpenStack

Tests were not run because provisioning fails

iso DATE
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190522T013000Z/ 22 - MAY- 2019
https://bugs.launchpad.net/starlingx/+bug/1829299 SRIOV and Multus images not pulled from local mirror registry
https://bugs.launchpad.net/starlingx/+bug/1828059 cinder volume create failed
Provision-Containers AIO - Simplex Virtual AIO - Baremetal bug
1. Provisioning Simplex System PASS PASS
2. Provisioning Duplex System PASS PASS
3. Provisioning Standard Non-Storage System PASS PASS
4. Provisioning Standard Storage System N/A PASS
01-Instance-From-Image AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS N/A PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS N/A PASS PASS PASS PASS
3. Create Networks for Instances PASS PASS PASS N/A PASS PASS PASS PASS
4. Launch Instances PASS PASS PASS N/A PASS PASS PASS PASS
5. Suspend Resume Instances PASS PASS PASS N/A PASS PASS PASS PASS
6. Set Error Active Flags Instances PASS PASS PASS N/A PASS PASS PASS PASS
7. Pause Unpause Instances PASS PASS PASS N/A PASS PASS PASS PASS
8. Stop Start Instances PASS PASS PASS N/A PASS PASS PASS PASS
9. Lock Unlock Instances PASS PASS PASS N/A PASS PASS PASS PASS
10. Reboot Instances PASS PASS PASS N/A PASS PASS PASS PASS
11. Rebuild Instances PASS PASS PASS N/A PASS PASS PASS PASS
12. Resize Instances PASS PASS PASS N/A PASS PASS PASS PASS
13. Set Unset Properties Instances PASS PASS PASS N/A PASS PASS PASS PASS
14. Evacuate Instances From Hosts PASS PASS FAIL N/A PASS PASS PASS PASS
02-Instance-From-Volume AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS N/A PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS N/A PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS N/A PASS PASS PASS PASS
4. Create Volume for Instances PASS PASS PASS N/A PASS PASS PASS PASS
5. Launch Instances PASS PASS PASS N/A PASS PASS PASS PASS
6. Suspend Resume Instance PASS PASS PASS N/A PASS PASS PASS PASS
7. Set Error Active Flags Instance PASS PASS PASS N/A PASS PASS PASS PASS
8. Pause Unpause Instances PASS PASS PASS N/A PASS PASS PASS PASS
9. Stop Start Instances PASS PASS PASS N/A PASS PASS PASS PASS
10. Lock Unlock Instances PASS PASS PASS N/A PASS PASS PASS PASS
11. Reboot Instances PASS PASS PASS N/A PASS PASS PASS PASS
12. Rebuild Instances PASS PASS PASS N/A FAIL FAIL FAIL FAIL
13. Resize Instances PASS PASS PASS N/A FAIL FAIL FAIL FAIL
14. Set Unset Properties Instances PASS PASS PASS N/A FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1828059
15. Evacuate Instances From Hosts PASS PASS FAIL N/A PASS PASS PASS PASS
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS N/A PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS N/A PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS N/A PASS PASS PASS PASS
4. Create Volume for Instances PASS PASS PASS N/A PASS PASS PASS PASS
5. Create Snapshot for Instance PASS PASS PASS N/A PASS PASS PASS PASS
6. Launch Instances PASS PASS PASS N/A PASS PASS PASS PASS
7. Suspend Resume Instances PASS PASS PASS N/A PASS PASS PASS PASS
8. Set Error Active Flags Instances PASS PASS PASS N/A PASS PASS PASS PASS
9. Pause Unpause Instances PASS PASS PASS N/A PASS PASS PASS PASS
10. Stop Start Instances PASS PASS PASS N/A PASS PASS PASS PASS
11. Lock Unlock Instances PASS PASS PASS N/A PASS PASS PASS PASS
12. Reboot Instances PASS PASS PASS N/A PASS PASS PASS PASS
13. Rebuild Instances PASS PASS PASS N/A PASS PASS PASS PASS
14. Resize Instances PASS PASS PASS N/A PASS PASS PASS PASS
15. Set Unset Properties Instances PASS PASS PASS N/A PASS PASS PASS PASS
16. Evacuate Instances From Hosts PASS PASS PASS N/A PASS PASS PASS PASS
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS N/A PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS N/A PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS N/A PASS PASS PASS PASS
4. Create Instance Trough Stack PASS PASS PASS N/A PASS PASS PASS PASS
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Image For Metrics PASS PASS PASS N/A PASS PASS PASS PASS
2. Update Image Name PASS PASS PASS N/A PASS PASS PASS PASS
3. Update Image Disk Ram Size PASS PASS PASS N/A PASS PASS PASS PASS
Networking-Tests AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Ping from Controller to Instances N/A N/A N/A N/A N/A N/A N/A N/A
2. Ping Between Instances N/A N/A N/A N/A N/A N/A N/A N/A

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. Lock Active Controller PASS PASS PASS N/A PASS PASS PASS PASS
2. Lock Unlock Standby Controller PASS PASS PASS N/A PASS PASS PASS PASS
3. Lock Unlock Compute Hosts FAIL FAIL FAIL N/A PASS PASS PASS PASS
01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. OpenStack PODs Healthy FAIL FAIL FAIL N/A FAIL FAIL FAIL FAIL
2. Reapply STX OpenStack FAIL FAIL FAIL N/A FAIL FAIL FAIL FAIL
3. STX OpenStack Override Update Reset PASS PASS PASS N/A FAIL FAIL FAIL FAIL
4. Kube System Services FAIL FAIL FAIL N/A FAIL FAIL FAIL FAIL
5. Create Check Delete POD FAIL FAIL FAIL N/A FAIL FAIL FAIL FAIL