Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(→‎Sanity-OpenStack)
(→‎Sanity-Platform)
(One intermediate revision by the same user not shown)
Line 137: Line 137:
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
+
| 1. Create Flavors for Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
−
| 2. Create Images for Instances ||FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
+
| 2. Create Images for Instances ||PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
−
| 3. Create Networks for Instance || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
+
| 3. Create Networks for Instance || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
 
| 4. Create Instance Trough Stack || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
| 4. Create Instance Trough Stack || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
Line 172: Line 172:
 
! 01-Host-Management || AIO - Simplex Virtual  ||AIO - Duplex Virtual|| Standard - Local Storage (2+2) Virtua || Standard - Dedicated Storage (2+2+2) Virtua|| AIO - Simplex BM || AIO - Duplex BM|| Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || Bug
 
! 01-Host-Management || AIO - Simplex Virtual  ||AIO - Duplex Virtual|| Standard - Local Storage (2+2) Virtua || Standard - Dedicated Storage (2+2+2) Virtua|| AIO - Simplex BM || AIO - Duplex BM|| Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || Bug
 
|-
 
|-
−
| 1. Lock Active Controller || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 1. Lock Active Controller || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
−
| 2. Lock Unlock Standby Controller || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 2. Lock Unlock Standby Controller || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
−
| 3.  Lock Unlock Compute Hosts || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 3.  Lock Unlock Compute Hosts || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|}
 
|}
  
Line 183: Line 183:
 
! 02-sanity-platform || AIO - Simplex Virtual  ||AIO - Duplex Virtual|| Standard - Local Storage (2+2) Virtua || Standard - Dedicated Storage (2+2+2) Virtua|| AIO - Simplex BM || AIO - Duplex BM|| Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || Bug
 
! 02-sanity-platform || AIO - Simplex Virtual  ||AIO - Duplex Virtual|| Standard - Local Storage (2+2) Virtua || Standard - Dedicated Storage (2+2+2) Virtua|| AIO - Simplex BM || AIO - Duplex BM|| Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || Bug
 
|-
 
|-
−
| 1. OpenStack PODs Healthy || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 1. OpenStack PODs Healthy || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
−
| 2. Reapply STX OpenStack || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 2. Reapply STX OpenStack || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
−
| 3. STX OpenStack Override Update Reset || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 3. STX OpenStack Override Update Reset || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
−
| 4. Kube System Services || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 4. Kube System Services || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
−
| 5. Create Check Delete POD || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 5. Create Check Delete POD || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|}
 
|}

Revision as of 01:59, 11 June 2019

Sanity Test

Sanity-OpenStack

iso DATE
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190609T233000Z/outputs/iso/ 10 - Jun- 2019
. .
Provision-Containers AIO - Simplex Virtual AIO - Baremetal bug
1. Provisioning Simplex System PASS PASS
2. Provisioning Duplex System N/A FAIL https://bugs.launchpad.net/starlingx/+bug/1832269
3. Provisioning Standard Non-Storage System N/A FAIL https://bugs.launchpad.net/starlingx/+bug/1832269
4. Provisioning Standard Storage System N/A PASS
01-Instance-From-Image AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Create Images for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
3. Create Networks for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
4. Launch Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
5. Suspend Resume Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
6. Set Error Active Flags Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
7. Pause Unpause Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
8. Stop Start Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
9. Lock Unlock Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832237
10. Reboot Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
11. Rebuild Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
12. Resize Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
13. Set Unset Properties Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
14. Evacuate Instances From Hosts FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
02-Instance-From-Volume AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS PASS PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS PASS PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS PASS PASS PASS PASS PASS
4. Create Volume for Instances PASS PASS PASS PASS PASS PASS PASS PASS
5. Launch Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
6. Suspend Resume Instance FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
7. Set Error Active Flags Instance FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
8. Pause Unpause Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
9. Stop Start Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
10. Lock Unlock Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
11. Reboot Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
12. Rebuild Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
13. Resize Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
14. Set Unset Properties Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
15. Evacuate Instances From Hosts FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS PASS PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS PASS PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS PASS PASS PASS PASS PASS
4. Create Volume for Instances PASS PASS PASS PASS PASS PASS PASS PASS
5. Create Snapshot for Instance PASS PASS PASS PASS PASS PASS PASS PASS
6. Launch Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
7. Suspend Resume Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
8. Set Error Active Flags Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
9. Pause Unpause Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
10. Stop Start Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
11. Lock Unlock Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832237
12. Reboot Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
13. Rebuild Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
14. Resize Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
15. Set Unset Properties Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
16. Evacuate Instances From Hosts FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Create Images for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
3. Create Networks for Instance PASS FAIL FAIL N/A PASS N/A N/A N/A
4. Create Instance Trough Stack PASS FAIL FAIL N/A PASS N/A N/A N/A
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Image For Metrics PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Update Image Name PASS FAIL FAIL N/A PASS N/A N/A N/A
3. Update Image Disk Ram Size PASS FAIL FAIL N/A PASS N/A N/A N/A
Networking-Tests AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Ping from Controller to Instances N/A N/A N/A N/A N/A N/A N/A N/A
2. Ping Between Instances N/A N/A N/A N/A N/A N/A N/A N/A

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtua Standard - Dedicated Storage (2+2+2) Virtua AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM Bug
1. Lock Active Controller PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Lock Unlock Standby Controller PASS FAIL FAIL N/A PASS N/A N/A N/A
3. Lock Unlock Compute Hosts PASS FAIL FAIL N/A PASS N/A N/A N/A
02-sanity-platform AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtua Standard - Dedicated Storage (2+2+2) Virtua AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM Bug
1. OpenStack PODs Healthy PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Reapply STX OpenStack PASS FAIL FAIL N/A PASS N/A N/A N/A
3. STX OpenStack Override Update Reset PASS FAIL FAIL N/A PASS N/A N/A N/A
4. Kube System Services PASS FAIL FAIL N/A PASS N/A N/A N/A
5. Create Check Delete POD PASS FAIL FAIL N/A PASS N/A N/A N/A
Retrieved from "https://wiki.openstack.org/w/index.php?title=StarlingX/Test/SanityTests&oldid=170654"