Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(→‎Sanity-OpenStack)
(→‎Sanity-OpenStack)
Line 5: Line 5:
 
! iso  || DATE
 
! iso  || DATE
 
|-
 
|-
−
| http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190417T142021Z/outputs/iso/|| 17 - April - 2019
+
| http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190421T233001Z/http:/mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190421T233001Z/|| 22 - April - 2019
 
|-
 
|-
−
| NOTE: all tests are failing because provisioning is not complete || https://bugs.launchpad.net/starlingx/+bug/1825045 , https://bugs.launchpad.net/starlingx/+bug/1824994
+
| NOTE: Duplex and Simplex environment are failing due to: || https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
 
|}
 
|}
Line 14: Line 14:
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Create Flavors for Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 2. Create Images for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Create Images for Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 3. Create Networks for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL||  https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 3. Create Networks for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 4. Launch Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 4. Launch Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 5. Suspend Resume Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 5. Suspend Resume Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 6. Set Error Active Flags Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL||  https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 6. Set Error Active Flags Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 7. Pause Unpause Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 7. Pause Unpause Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 8. Stop Start Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 8. Stop Start Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 9. Lock Unlock Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 9. Lock Unlock Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 10. Reboot Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 10. Reboot Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 11. Rebuild Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 11. Rebuild Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 12. Resize Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 12. Resize Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 13. Set Unset Properties Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 13. Set Unset Properties Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 14. Evacuate Instances From Hosts || NA || NA ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 14. Evacuate Instances From Hosts || NA || NA ||PASS|| PASS|| PASS|| PASS||PASS|| PASS||https://bugs.launchpad.net/starlingx/+bug/1825045
 
|}
 
|}
  
Line 47: Line 47:
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Create Flavors for Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 2. Create Images for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Create Images for Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 3. Create Networks for Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 3. Create Networks for Instance || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 4. Create Volume for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 4. Create Volume for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 5. Launch Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 5. Launch Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 6. Suspend Resume Instance ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 6. Suspend Resume Instance ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 7. Set Error Active Flags Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 7. Set Error Active Flags Instance || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 8. Pause Unpause Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 8. Pause Unpause Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 9. Stop Start Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 9. Stop Start Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 10. Lock Unlock Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 10. Lock Unlock Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 11. Reboot Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 11. Reboot Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
|12. Rebuild Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
|12. Rebuild Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 13. Resize Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 13. Resize Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 14. Set Unset Properties Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 14. Set Unset Properties Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 15. Evacuate Instances From Hosts || NA || NA || FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 15. Evacuate Instances From Hosts || NA || NA || PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
  
 
|}
 
|}
Line 83: Line 83:
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Create Flavors for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 2. Create Images for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Create Images for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 3. Create Networks for Instance ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 3. Create Networks for Instance ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 4. Create Volume for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 4. Create Volume for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 5. Create Snapshot for Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 5. Create Snapshot for Instance || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 6. Launch Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 6. Launch Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 7. Suspend Resume Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 7. Suspend Resume Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 8. Set Error Active Flags Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 8. Set Error Active Flags Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 9. Pause Unpause Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 9. Pause Unpause Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 10. Stop Start Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045  
+
| 10. Stop Start Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045  
 
|-
 
|-
−
| 11. Lock Unlock Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 11. Lock Unlock Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 12. Reboot Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 12. Reboot Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 13. Rebuild Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 13. Rebuild Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 14. Resize Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 14. Resize Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 15. Set Unset Properties Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 15. Set Unset Properties Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 16. Evacuate Instances From Hosts || NA|| NA || FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 16. Evacuate Instances From Hosts || NA|| NA ||PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
  
Line 122: Line 122:
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Create Flavors for Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 2. Create Images for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Create Images for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 3. Create Networks for Instance ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 3. Create Networks for Instance ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 4. Create Instance Trough Stack ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 4. Create Instance Trough Stack ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|}
 
|}
  
Line 135: Line 135:
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Image For Metrics || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Create Image For Metrics || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 2. Update Image Name || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Update Image Name || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 3. Update Image Disk Ram Size || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 3. Update Image Disk Ram Size || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|}
 
|}
  
Line 146: Line 146:
 
! Networking-Tests || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! Networking-Tests || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Ping from Controller to Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Ping from Controller to Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 2. Ping Between Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Ping Between Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|}
 
|}
  

Revision as of 22:15, 22 April 2019

Sanity Test

Sanity-OpenStack

iso DATE
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190421T233001Z/http:/mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190421T233001Z/ 22 - April - 2019
NOTE: Duplex and Simplex environment are failing due to: https://bugs.launchpad.net/starlingx/+bug/1825045
01-Instance-From-Image AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
2. Create Images for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
3. Create Networks for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
4. Launch Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
5. Suspend Resume Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
6. Set Error Active Flags Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
7. Pause Unpause Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
8. Stop Start Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
9. Lock Unlock Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
10. Reboot Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
11. Rebuild Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
12. Resize Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
13. Set Unset Properties Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
14. Evacuate Instances From Hosts NA NA PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
02-Instance-From-Volume AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
2. Create Images for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
3. Create Networks for Instance FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
4. Create Volume for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
5. Launch Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
6. Suspend Resume Instance FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
7. Set Error Active Flags Instance FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
8. Pause Unpause Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
9. Stop Start Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
10. Lock Unlock Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
11. Reboot Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
12. Rebuild Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
13. Resize Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
14. Set Unset Properties Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
15. Evacuate Instances From Hosts NA NA PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
2. Create Images for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
3. Create Networks for Instance FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
4. Create Volume for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
5. Create Snapshot for Instance FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
6. Launch Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
7. Suspend Resume Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
8. Set Error Active Flags Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
9. Pause Unpause Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
10. Stop Start Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
11. Lock Unlock Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
12. Reboot Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
13. Rebuild Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
14. Resize Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
15. Set Unset Properties Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
16. Evacuate Instances From Hosts NA NA PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
2. Create Images for Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
3. Create Networks for Instance FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
4. Create Instance Trough Stack FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Image For Metrics FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
2. Update Image Name FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
3. Update Image Disk Ram Size FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
Networking-Tests AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Ping from Controller to Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
2. Ping Between Instances FAIL FAIL PASS PASS PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. Add Controller Host Simplex FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
2. Swact Controller Host Simplex FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. OpenStack PODs Healthy FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
2. Reapply STX OpenStack FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
3. STX OpenStack Override Update Reset FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
4. Kube System Services FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
5. Create Check Delete POD PASS N/A N/A N/A N/A N/A N/A N/A
Retrieved from "https://wiki.openstack.org/w/index.php?title=StarlingX/Test/SanityTests&oldid=169559"