Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(Sanity-OpenStack)
(Sanity-OpenStack)
Line 70: Line 70:
 
| 3. Create Networks for Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
| 3. Create Networks for Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 4. Create Volume for Instances || PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 4. Create Volume for Instances || PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 5. Launch Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 5. Launch Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 6. Suspend Resume Instance ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 6. Suspend Resume Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 7. Set Error Active Flags Instance ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 7. Set Error Active Flags Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 8. Pause Unpause Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 8. Pause Unpause Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 9. Stop Start Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 9. Stop Start Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 10. Lock Unlock Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 10. Lock Unlock Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 11. Reboot Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 11. Reboot Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
|12. Rebuild Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
|12. Rebuild Instances ||PASS ||PASS || PASS|| N/A||FAIL|| FAIL||FAIL||FAIL||  
 
|-
 
|-
| 13. Resize Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 13. Resize Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL||  
 
|-
 
|-
 
| 14. Set Unset Properties Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
 
| 14. Set Unset Properties Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
Line 106: Line 106:
 
| 3. Create Networks for Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
| 3. Create Networks for Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 4. Create Volume for Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 4. Create Volume for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 5. Create Snapshot for Instance ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 5. Create Snapshot for Instance ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 6. Launch Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 6. Launch Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 7. Suspend Resume Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 7. Suspend Resume Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 8. Set Error Active Flags Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 8. Set Error Active Flags Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 9. Pause Unpause Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 9. Pause Unpause Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 10. Stop Start Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 10. Stop Start Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 11. Lock Unlock Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 11. Lock Unlock Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 12. Reboot Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 12. Reboot Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 13. Rebuild Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 13. Rebuild Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 14. Resize Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 14. Resize Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
 
|-
 
|-
| 15. Set Unset Properties Instances ||PASS ||PASS || PASS|| N/A|| FAIL|| FAIL||FAIL||FAIL|| https://bugs.launchpad.net/starlingx/+bug/1828059
+
| 15. Set Unset Properties Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
|-
 
|-
 
| 16. Evacuate Instances From Hosts ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
 
| 16. Evacuate Instances From Hosts ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||

Revision as of 22:00, 22 May 2019

Sanity Test

Sanity-OpenStack

Tests were not run because provisioning fails

iso DATE
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190522T013000Z/ 22 - MAY- 2019
https://bugs.launchpad.net/starlingx/+bug/1829299 SRIOV and Multus images not pulled from local mirror registry
https://bugs.launchpad.net/starlingx/+bug/1828059 cinder volume create failed
Provision-Containers AIO - Simplex Virtual AIO - Baremetal bug
1. Provisioning Simplex System PASS PASS
2. Provisioning Duplex System PASS PASS
3. Provisioning Standard Non-Storage System PASS PASS
4. Provisioning Standard Storage System N/A PASS
01-Instance-From-Image AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS N/A PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS N/A PASS PASS PASS PASS
3. Create Networks for Instances PASS PASS PASS N/A PASS PASS PASS PASS
4. Launch Instances PASS PASS PASS N/A PASS PASS PASS PASS
5. Suspend Resume Instances PASS PASS PASS N/A PASS PASS PASS PASS
6. Set Error Active Flags Instances PASS PASS PASS N/A PASS PASS PASS PASS
7. Pause Unpause Instances PASS PASS PASS N/A PASS PASS PASS PASS
8. Stop Start Instances PASS PASS PASS N/A PASS PASS PASS PASS
9. Lock Unlock Instances PASS PASS PASS N/A PASS PASS PASS PASS
10. Reboot Instances PASS PASS PASS N/A PASS PASS PASS PASS
11. Rebuild Instances PASS PASS PASS N/A PASS PASS PASS PASS
12. Resize Instances PASS PASS PASS N/A PASS PASS PASS PASS
13. Set Unset Properties Instances PASS PASS PASS N/A PASS PASS PASS PASS
14. Evacuate Instances From Hosts PASS PASS FAIL N/A PASS PASS PASS PASS
02-Instance-From-Volume AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS N/A PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS N/A PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS N/A PASS PASS PASS PASS
4. Create Volume for Instances PASS PASS PASS N/A PASS PASS PASS PASS
5. Launch Instances PASS PASS PASS N/A PASS PASS PASS PASS
6. Suspend Resume Instance PASS PASS PASS N/A PASS PASS PASS PASS
7. Set Error Active Flags Instance PASS PASS PASS N/A PASS PASS PASS PASS
8. Pause Unpause Instances PASS PASS PASS N/A PASS PASS PASS PASS
9. Stop Start Instances PASS PASS PASS N/A PASS PASS PASS PASS
10. Lock Unlock Instances PASS PASS PASS N/A PASS PASS PASS PASS
11. Reboot Instances PASS PASS PASS N/A PASS PASS PASS PASS
12. Rebuild Instances PASS PASS PASS N/A FAIL FAIL FAIL FAIL
13. Resize Instances PASS PASS PASS N/A FAIL FAIL FAIL FAIL
14. Set Unset Properties Instances PASS PASS PASS N/A FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1828059
15. Evacuate Instances From Hosts PASS PASS FAIL N/A PASS PASS PASS PASS
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS N/A PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS N/A PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS N/A PASS PASS PASS PASS
4. Create Volume for Instances PASS PASS PASS N/A PASS PASS PASS PASS
5. Create Snapshot for Instance PASS PASS PASS N/A PASS PASS PASS PASS
6. Launch Instances PASS PASS PASS N/A PASS PASS PASS PASS
7. Suspend Resume Instances PASS PASS PASS N/A PASS PASS PASS PASS
8. Set Error Active Flags Instances PASS PASS PASS N/A PASS PASS PASS PASS
9. Pause Unpause Instances PASS PASS PASS N/A PASS PASS PASS PASS
10. Stop Start Instances PASS PASS PASS N/A PASS PASS PASS PASS
11. Lock Unlock Instances PASS PASS PASS N/A PASS PASS PASS PASS
12. Reboot Instances PASS PASS PASS N/A PASS PASS PASS PASS
13. Rebuild Instances PASS PASS PASS N/A PASS PASS PASS PASS
14. Resize Instances PASS PASS PASS N/A PASS PASS PASS PASS
15. Set Unset Properties Instances PASS PASS PASS N/A PASS PASS PASS PASS
16. Evacuate Instances From Hosts PASS PASS PASS N/A PASS PASS PASS PASS
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS N/A PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS N/A PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS N/A PASS PASS PASS PASS
4. Create Instance Trough Stack PASS PASS PASS N/A PASS PASS PASS PASS
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Image For Metrics PASS PASS PASS N/A PASS PASS PASS PASS
2. Update Image Name PASS PASS PASS N/A PASS PASS PASS PASS
3. Update Image Disk Ram Size PASS PASS PASS N/A PASS PASS PASS PASS
Networking-Tests AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Ping from Controller to Instances N/A N/A N/A N/A N/A N/A N/A N/A
2. Ping Between Instances N/A N/A N/A N/A N/A N/A N/A N/A

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. Lock Active Controller PASS PASS PASS N/A PASS PASS PASS PASS
2. Lock Unlock Standby Controller PASS PASS PASS N/A PASS PASS PASS PASS
3. Lock Unlock Compute Hosts FAIL FAIL FAIL N/A PASS PASS PASS PASS
01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. OpenStack PODs Healthy FAIL FAIL FAIL N/A PASS PASS PASS PASS
2. Reapply STX OpenStack FAIL FAIL FAIL N/A PASS PASS PASS PASS
3. STX OpenStack Override Update Reset PASS PASS PASS N/A PASS PASS PASS PASS
4. Kube System Services FAIL FAIL FAIL N/A PASS PASS PASS PASS
5. Create Check Delete POD FAIL FAIL FAIL N/A PASS PASS PASS PASS