Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(Sanity-Platform)
(Sanity-Platform)
(5 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
= Sanity Test=
 
= Sanity Test=
 
== ''Sanity-OpenStack'' ==
 
== ''Sanity-OpenStack'' ==
 
Tests were not run because provisioning fails
 
  
 
{| class="wikitable"
 
{| class="wikitable"
Line 8: Line 6:
 
! iso  || DATE
 
! iso  || DATE
 
|-
 
|-
|http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190522T013000Z/|| 22 - MAY- 2019
+
|http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190609T233000Z/outputs/iso/|| 10 - Jun- 2019
 
|-
 
|-
 
| . || .
 
| . || .
Line 21: Line 19:
 
| 1. Provisioning Simplex System || PASS || PASS ||  
 
| 1. Provisioning Simplex System || PASS || PASS ||  
 
|-
 
|-
| 2. Provisioning Duplex System || PASS || PASS ||
+
| 2. Provisioning Duplex System || N/A || FAIL || https://bugs.launchpad.net/starlingx/+bug/1832269
 
|-
 
|-
| 3. Provisioning Standard Non-Storage System || PASS || PASS ||
+
| 3. Provisioning Standard Non-Storage System || N/A|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1832269
 
|-
 
|-
| 4. Provisioning Standard Storage System || N/A || PASS ||
+
| 4. Provisioning Standard Storage System || N/A|| PASS ||
 
|}
 
|}
  
Line 31: Line 29:
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Flavors for Instances || PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 1. Create Flavors for Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 2. Create Images for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 2. Create Images for Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 3. Create Networks for Instances || PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 3. Create Networks for Instances ||PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 4. Launch Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 4. Launch Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 5. Suspend Resume Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 5. Suspend Resume Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 6. Set Error Active Flags Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 6. Set Error Active Flags Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 7. Pause Unpause Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 7. Pause Unpause Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 8. Stop Start Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 8. Stop Start Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 9. Lock Unlock Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||  
+
| 9. Lock Unlock Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832237
 
|-
 
|-
| 10. Reboot Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 10. Reboot Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 11. Rebuild Instances ||PASS ||PASS || PASS|| N/A||PASS||FAIL||PASS||PASS||
+
| 11. Rebuild Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 12. Resize Instances ||FAIL||PASS || PASS|| N/A||FAIL||FAIL||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1824412
+
| 12. Resize Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 13. Set Unset Properties Instances ||PASS ||PASS || PASS|| N/A||PASS||FAIL||PASS||PASS||
+
| 13. Set Unset Properties Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 14. Evacuate Instances From Hosts ||PASS ||PASS || pas|| N/A||PASS||PASS||PASS||PASS||
+
| 14. Evacuate Instances From Hosts || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|}
 
|}
  
Line 64: Line 62:
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Flavors for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 1. Create Flavors for Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 2. Create Images for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 2. Create Images for Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 3. Create Networks for Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 3. Create Networks for Instance || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 4. Create Volume for Instances || PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 4. Create Volume for Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 5. Launch Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 5. Launch Instances ||FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 6. Suspend Resume Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 6. Suspend Resume Instance || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 7. Set Error Active Flags Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 7. Set Error Active Flags Instance || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 8. Pause Unpause Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 8. Pause Unpause Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 9. Stop Start Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 9. Stop Start Instances ||FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 10. Lock Unlock Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 10. Lock Unlock Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 11. Reboot Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 11. Reboot Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
|12. Rebuild Instances ||PASS ||PASS || PASS|| N/A||PASS|| FAIL||PASS||PASS||  
+
|12. Rebuild Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 13. Resize Instances ||FAIL||PASS || PASS|| N/A|| FAIL|| FAIL||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1824412
+
| 13. Resize Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 14. Set Unset Properties Instances ||PASS ||PASS || PASS|| N/A|| PASS|| FAIL||PASS||PASS||https://bugs.launchpad.net/starlingx/+bug/1824412
+
| 14. Set Unset Properties Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 15. Evacuate Instances From Hosts ||PASS ||PASS || FAIL|| N/A||PASS||PASS||PASS||PASS||
+
| 15. Evacuate Instances From Hosts || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
 
 
|}
 
|}
  
Line 100: Line 97:
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Flavors for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 1. Create Flavors for Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 2. Create Images for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 2. Create Images for Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 3. Create Networks for Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 3. Create Networks for Instance || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 4. Create Volume for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 4. Create Volume for Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 5. Create Snapshot for Instance ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 5. Create Snapshot for Instance || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
 
|-
 
|-
| 6. Launch Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 6. Launch Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 7. Suspend Resume Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 7. Suspend Resume Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 8. Set Error Active Flags Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 8. Set Error Active Flags Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 9. Pause Unpause Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 9. Pause Unpause Instances ||FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 10. Stop Start Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 10. Stop Start Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 11. Lock Unlock Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 11. Lock Unlock Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832237
 
|-
 
|-
| 12. Reboot Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 12. Reboot Instances ||FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 13. Rebuild Instances ||PASS ||PASS || PASS|| N/A|| PASS||PASS||PASS||PASS||
+
| 13. Rebuild Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 14. Resize Instances ||FAIL||PASS || PASS|| N/A|| FAIL||FAIL||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1824412
+
| 14. Resize Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 15. Set Unset Properties Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 15. Set Unset Properties Instances || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
 
|-
 
|-
| 16. Evacuate Instances From Hosts ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 16. Evacuate Instances From Hosts || FAIL ||FAIL|| FAIL||N/A||FAIL||N/A||N/A||N/A|| https://bugs.launchpad.net/starlingx/+bug/1832279
  
 
|-
 
|-
Line 140: Line 137:
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Flavors for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 1. Create Flavors for Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 2. Create Images for Instances ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 2. Create Images for Instances ||PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 3. Create Networks for Instance ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 3. Create Networks for Instance || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 4. Create Instance Trough Stack ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 4. Create Instance Trough Stack || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|}
 
|}
  
Line 153: Line 150:
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Image For Metrics ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 1. Create Image For Metrics || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 2. Update Image Name ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 2. Update Image Name || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 3. Update Image Disk Ram Size ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 3. Update Image Disk Ram Size || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|}
 
|}
  
Line 175: Line 172:
 
! 01-Host-Management || AIO - Simplex Virtual  ||AIO - Duplex Virtual|| Standard - Local Storage (2+2) Virtua || Standard - Dedicated Storage (2+2+2) Virtua|| AIO - Simplex BM || AIO - Duplex BM|| Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || Bug
 
! 01-Host-Management || AIO - Simplex Virtual  ||AIO - Duplex Virtual|| Standard - Local Storage (2+2) Virtua || Standard - Dedicated Storage (2+2+2) Virtua|| AIO - Simplex BM || AIO - Duplex BM|| Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || Bug
 
|-
 
|-
| 1. Lock Active Controller ||PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 1. Lock Active Controller || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 2. Lock Unlock Standby Controller || PASS ||PASS || PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 2. Lock Unlock Standby Controller || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 3.  Lock Unlock Compute Hosts ||PASS||FAIL|| PASS|| N/A||PASS||PASS||PASS||PASS||
+
| 3.  Lock Unlock Compute Hosts || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|}
 
|}
  
Line 186: Line 183:
 
! 02-sanity-platform || AIO - Simplex Virtual  ||AIO - Duplex Virtual|| Standard - Local Storage (2+2) Virtua || Standard - Dedicated Storage (2+2+2) Virtua|| AIO - Simplex BM || AIO - Duplex BM|| Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || Bug
 
! 02-sanity-platform || AIO - Simplex Virtual  ||AIO - Duplex Virtual|| Standard - Local Storage (2+2) Virtua || Standard - Dedicated Storage (2+2+2) Virtua|| AIO - Simplex BM || AIO - Duplex BM|| Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || Bug
 
|-
 
|-
| 1. OpenStack PODs Healthy ||FAIL||FAIL||FAIL||N/A||FAIL||FAIL||PASS||PASS||
+
| 1. OpenStack PODs Healthy || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 2. Reapply STX OpenStack ||PASS ||FAIL ||FAIL||N/A||PASS||FAIL||PASS||PASS||
+
| 2. Reapply STX OpenStack || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 3. STX OpenStack Override Update Reset ||PASS||FAIL|| PASS||N/A||PASS||FAIL||PASS||PASS||
+
| 3. STX OpenStack Override Update Reset || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 4. Kube System Services ||PASS||FAIL ||FAIL||N/A||FAIL||FAIL||PASS||FAIL||
+
| 4. Kube System Services || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 5. Create Check Delete POD ||FAIL||PASS||FAIL||N/A||FAIL||FAIL||PASS||FAIL||
+
| 5. Create Check Delete POD || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|}
 
|}

Revision as of 01:59, 11 June 2019

Sanity Test

Sanity-OpenStack

iso DATE
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190609T233000Z/outputs/iso/ 10 - Jun- 2019
. .
Provision-Containers AIO - Simplex Virtual AIO - Baremetal bug
1. Provisioning Simplex System PASS PASS
2. Provisioning Duplex System N/A FAIL https://bugs.launchpad.net/starlingx/+bug/1832269
3. Provisioning Standard Non-Storage System N/A FAIL https://bugs.launchpad.net/starlingx/+bug/1832269
4. Provisioning Standard Storage System N/A PASS
01-Instance-From-Image AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Create Images for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
3. Create Networks for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
4. Launch Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
5. Suspend Resume Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
6. Set Error Active Flags Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
7. Pause Unpause Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
8. Stop Start Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
9. Lock Unlock Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832237
10. Reboot Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
11. Rebuild Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
12. Resize Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
13. Set Unset Properties Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
14. Evacuate Instances From Hosts FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
02-Instance-From-Volume AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS PASS PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS PASS PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS PASS PASS PASS PASS PASS
4. Create Volume for Instances PASS PASS PASS PASS PASS PASS PASS PASS
5. Launch Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
6. Suspend Resume Instance FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
7. Set Error Active Flags Instance FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
8. Pause Unpause Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
9. Stop Start Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
10. Lock Unlock Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
11. Reboot Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
12. Rebuild Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
13. Resize Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
14. Set Unset Properties Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
15. Evacuate Instances From Hosts FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS PASS PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS PASS PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS PASS PASS PASS PASS PASS
4. Create Volume for Instances PASS PASS PASS PASS PASS PASS PASS PASS
5. Create Snapshot for Instance PASS PASS PASS PASS PASS PASS PASS PASS
6. Launch Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
7. Suspend Resume Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
8. Set Error Active Flags Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
9. Pause Unpause Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
10. Stop Start Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
11. Lock Unlock Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832237
12. Reboot Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
13. Rebuild Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
14. Resize Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
15. Set Unset Properties Instances FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
16. Evacuate Instances From Hosts FAIL FAIL FAIL N/A FAIL N/A N/A N/A https://bugs.launchpad.net/starlingx/+bug/1832279
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Create Images for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
3. Create Networks for Instance PASS FAIL FAIL N/A PASS N/A N/A N/A
4. Create Instance Trough Stack PASS FAIL FAIL N/A PASS N/A N/A N/A
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Image For Metrics PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Update Image Name PASS FAIL FAIL N/A PASS N/A N/A N/A
3. Update Image Disk Ram Size PASS FAIL FAIL N/A PASS N/A N/A N/A
Networking-Tests AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Ping from Controller to Instances N/A N/A N/A N/A N/A N/A N/A N/A
2. Ping Between Instances N/A N/A N/A N/A N/A N/A N/A N/A

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtua Standard - Dedicated Storage (2+2+2) Virtua AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM Bug
1. Lock Active Controller PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Lock Unlock Standby Controller PASS FAIL FAIL N/A PASS N/A N/A N/A
3. Lock Unlock Compute Hosts PASS FAIL FAIL N/A PASS N/A N/A N/A
02-sanity-platform AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtua Standard - Dedicated Storage (2+2+2) Virtua AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM Bug
1. OpenStack PODs Healthy PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Reapply STX OpenStack PASS FAIL FAIL N/A PASS N/A N/A N/A
3. STX OpenStack Override Update Reset PASS FAIL FAIL N/A PASS N/A N/A N/A
4. Kube System Services PASS FAIL FAIL N/A PASS N/A N/A N/A
5. Create Check Delete POD PASS FAIL FAIL N/A PASS N/A N/A N/A