Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(→‎Sanity-OpenStack)
(→‎Sanity-OpenStack)
Line 5: Line 5:
 
! iso  || DATE
 
! iso  || DATE
 
|-
 
|-
−
| http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190425T013000Z/ || 25 - April - 2019
+
| http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190428T233000Z/|| 29 - April - 2019
−
|-
 
−
| Bare metal bug || https://bugs.launchpad.net/starlingx/+bug/1826308
 
−
|-
 
−
| Virtual bug || https://bugs.launchpad.net/starlingx/+bug/1826445
 
 
|-
 
|-
 
|}
 
|}
Line 16: Line 12:
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 1. Create Flavors for Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 2. Create Images for Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 2. Create Images for Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 3. Create Networks for Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 3. Create Networks for Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 4. Launch Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 4. Launch Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 5. Suspend Resume Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 5. Suspend Resume Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 6. Set Error Active Flags Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 6. Set Error Active Flags Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 7. Pause Unpause Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 7. Pause Unpause Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 8. Stop Start Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 8. Stop Start Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 9. Lock Unlock Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 9. Lock Unlock Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 10. Reboot Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 10. Reboot Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 11. Rebuild Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 11. Rebuild Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 12. Resize Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 12. Resize Instances || FAIL|| PASS || PASS|| N/A|| FAIL|| PASS||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1824412
 
|-
 
|-
−
| 13. Set Unset Properties Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 13. Set Unset Properties Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 14. Evacuate Instances From Hosts || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 14. Evacuate Instances From Hosts ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|}
 
|}
  
Line 49: Line 45:
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 1. Create Flavors for Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS||  https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 2. Create Images for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 2. Create Images for Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 3. Create Networks for Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 3. Create Networks for Instance ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 4. Create Volume for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 4. Create Volume for Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 5. Launch Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 5. Launch Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 6. Suspend Resume Instance ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 6. Suspend Resume Instance ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 7. Set Error Active Flags Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 7. Set Error Active Flags Instance || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 8. Pause Unpause Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 8. Pause Unpause Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 9. Stop Start Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 9. Stop Start Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 10. Lock Unlock Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 10. Lock Unlock Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 11. Reboot Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 11. Reboot Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
|12. Rebuild Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
|12. Rebuild Instances ||PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 13. Resize Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 13. Resize Instances || FAIL|| PASS || PASS|| N/A|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1824412
 
|-
 
|-
−
| 14. Set Unset Properties Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 14. Set Unset Properties Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 15. Evacuate Instances From Hosts || NA || NA || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 15. Evacuate Instances From Hosts || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
  
 
|}
 
|}
Line 85: Line 81:
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 1. Create Flavors for Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 2. Create Images for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 2. Create Images for Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 3. Create Networks for Instance ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 3. Create Networks for Instance || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 4. Create Volume for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 4. Create Volume for Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 5. Create Snapshot for Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 5. Create Snapshot for Instance || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 6. Launch Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 6. Launch Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 7. Suspend Resume Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 7. Suspend Resume Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 8. Set Error Active Flags Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 8. Set Error Active Flags Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 9. Pause Unpause Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 9. Pause Unpause Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 10. Stop Start Instances ||FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 10. Stop Start Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 11. Lock Unlock Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 11. Lock Unlock Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 12. Reboot Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 12. Reboot Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 13. Rebuild Instances ||FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 13. Rebuild Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 14. Resize Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 14. Resize Instances ||FAIL|| PASS || PASS|| N/A|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1824412
 
|-
 
|-
−
| 15. Set Unset Properties Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 15. Set Unset Properties Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 16. Evacuate Instances From Hosts || NA || NA|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 16. Evacuate Instances From Hosts || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
  
Line 124: Line 120:
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 1. Create Flavors for Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 2. Create Images for Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 2. Create Images for Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 3. Create Networks for Instance || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 3. Create Networks for Instance || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 4. Create Instance Trough Stack || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 4. Create Instance Trough Stack || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|}
 
|}
  
Line 137: Line 133:
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Image For Metrics || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 1. Create Image For Metrics || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 2. Update Image Name ||  FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 2. Update Image Name ||  PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 3. Update Image Disk Ram Size || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 3. Update Image Disk Ram Size || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|}
 
|}
  
Line 148: Line 144:
 
! Networking-Tests || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! Networking-Tests || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Ping from Controller to Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS||https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 1. Ping from Controller to Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 2. Ping Between Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
+
| 2. Ping Between Instances || PASS|| PASS|| FAIL|| N/A|| PASS|| PASS||PASS||PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|}
 
|}
  

Revision as of 02:12, 30 April 2019

Sanity Test

Sanity-OpenStack

iso DATE
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190428T233000Z/ 29 - April - 2019
01-Instance-From-Image AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
2. Create Images for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
3. Create Networks for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
4. Launch Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
5. Suspend Resume Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
6. Set Error Active Flags Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
7. Pause Unpause Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
8. Stop Start Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
9. Lock Unlock Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
10. Reboot Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
11. Rebuild Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
12. Resize Instances FAIL PASS PASS N/A FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1824412
13. Set Unset Properties Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
14. Evacuate Instances From Hosts PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
02-Instance-From-Volume AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
2. Create Images for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
3. Create Networks for Instance PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
4. Create Volume for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
5. Launch Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
6. Suspend Resume Instance PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
7. Set Error Active Flags Instance PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
8. Pause Unpause Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
9. Stop Start Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
10. Lock Unlock Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
11. Reboot Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
12. Rebuild Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
13. Resize Instances FAIL PASS PASS N/A FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1824412
14. Set Unset Properties Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
15. Evacuate Instances From Hosts PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
2. Create Images for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
3. Create Networks for Instance PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
4. Create Volume for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
5. Create Snapshot for Instance PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
6. Launch Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
7. Suspend Resume Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
8. Set Error Active Flags Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
9. Pause Unpause Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
10. Stop Start Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
11. Lock Unlock Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
12. Reboot Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
13. Rebuild Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
14. Resize Instances FAIL PASS PASS N/A FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1824412
15. Set Unset Properties Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
16. Evacuate Instances From Hosts PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
2. Create Images for Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
3. Create Networks for Instance PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
4. Create Instance Trough Stack PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Image For Metrics PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
2. Update Image Name PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
3. Update Image Disk Ram Size PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
Networking-Tests AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Ping from Controller to Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
2. Ping Between Instances PASS PASS FAIL N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. Add Controller Host Simplex FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
2. Swact Controller Host Simplex FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. OpenStack PODs Healthy FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
2. Reapply STX OpenStack FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
3. STX OpenStack Override Update Reset FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
4. Kube System Services FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
5. Create Check Delete POD FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
Retrieved from "https://wiki.openstack.org/w/index.php?title=StarlingX/Test/SanityTests&oldid=169749"