Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(→‎Sanity-Platform)
(→‎Sanity-OpenStack)
Line 5: Line 5:
 
! iso  || DATE
 
! iso  || DATE
 
|-
 
|-
−
| http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190421T233001Z/http:/mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190421T233001Z/|| 22 - April - 2019
+
| http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190424T145954Z/ || 24 - April - 2019
 
|-
 
|-
−
| NOTE: Duplex and Simplex environment are failing due to: || https://bugs.launchpad.net/starlingx/+bug/1825045
+
| Bare metal bug || https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
 
|}
 
|}
Line 14: Line 14:
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Create Flavors for Instances || FAIL || FAIL|| FAIL|| FAIL|| PASS|| PASS||PASS|| PASS||  
 
|-
 
|-
−
| 2. Create Images for Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Create Images for Instances || FAIL || FAIL|| FAIL|| FAIL|| PASS|| PASS||PASS|| PASS||  
 
|-
 
|-
−
| 3. Create Networks for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 3. Create Networks for Instances || FAIL || FAIL|| FAIL|| FAIL|| PASS|| PASS||PASS|| PASS||  
 
|-
 
|-
−
| 4. Launch Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 4. Launch Instances || FAIL || FAIL|| FAIL|| FAIL|| PASS|| PASS||PASS|| PASS||  
 
|-
 
|-
−
| 5. Suspend Resume Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 5. Suspend Resume Instances || FAIL || FAIL|| FAIL|| FAIL|| PASS|| PASS||PASS|| PASS||  
 
|-
 
|-
−
| 6. Set Error Active Flags Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 6. Set Error Active Flags Instances || FAIL || FAIL|| FAIL|| FAIL|| PASS|| PASS||PASS|| PASS||  
 
|-
 
|-
−
| 7. Pause Unpause Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 7. Pause Unpause Instances || FAIL || FAIL|| FAIL|| FAIL|| PASS|| PASS||PASS|| PASS||  
 
|-
 
|-
−
| 8. Stop Start Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 8. Stop Start Instances || FAIL || FAIL|| FAIL|| FAIL|| PASS|| PASS||PASS|| PASS||  
 
|-
 
|-
−
| 9. Lock Unlock Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 9. Lock Unlock Instances || FAIL || FAIL|| FAIL|| FAIL|| PASS|| PASS||PASS|| PASS||  
 
|-
 
|-
−
| 10. Reboot Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 10. Reboot Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 11. Rebuild Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 11. Rebuild Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 12. Resize Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 12. Resize Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 13. Set Unset Properties Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 13. Set Unset Properties Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 14. Evacuate Instances From Hosts || NA || NA ||PASS|| PASS|| PASS|| PASS||PASS|| PASS||https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 14. Evacuate Instances From Hosts || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|}
 
|}
  
Line 47: Line 47:
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Create Flavors for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 2. Create Images for Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Create Images for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 3. Create Networks for Instance || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 3. Create Networks for Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 4. Create Volume for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 4. Create Volume for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 5. Launch Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 5. Launch Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 6. Suspend Resume Instance ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 6. Suspend Resume Instance ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 7. Set Error Active Flags Instance || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 7. Set Error Active Flags Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 8. Pause Unpause Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 8. Pause Unpause Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 9. Stop Start Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 9. Stop Start Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 10. Lock Unlock Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 10. Lock Unlock Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 11. Reboot Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 11. Reboot Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
|12. Rebuild Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
|12. Rebuild Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 13. Resize Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 13. Resize Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 14. Set Unset Properties Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 14. Set Unset Properties Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 15. Evacuate Instances From Hosts || NA || NA || PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 15. Evacuate Instances From Hosts || NA || NA || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
  
 
|}
 
|}
Line 83: Line 83:
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Create Flavors for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 2. Create Images for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Create Images for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 3. Create Networks for Instance ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 3. Create Networks for Instance ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 4. Create Volume for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 4. Create Volume for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 5. Create Snapshot for Instance || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 5. Create Snapshot for Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 6. Launch Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 6. Launch Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 7. Suspend Resume Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 7. Suspend Resume Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 8. Set Error Active Flags Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 8. Set Error Active Flags Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1826308
 
|-
 
|-
−
| 9. Pause Unpause Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 9. Pause Unpause Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 10. Stop Start Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045  
+
| 10. Stop Start Instances ||FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 11. Lock Unlock Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 11. Lock Unlock Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 12. Reboot Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 12. Reboot Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 13. Rebuild Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 13. Rebuild Instances ||FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 14. Resize Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 14. Resize Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL|| PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 15. Set Unset Properties Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 15. Set Unset Properties Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 16. Evacuate Instances From Hosts || NA|| NA ||PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 16. Evacuate Instances From Hosts || NA || NA|| FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
  
Line 122: Line 122:
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Flavors for Instances || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Create Flavors for Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 2. Create Images for Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Create Images for Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 3. Create Networks for Instance ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 3. Create Networks for Instance || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 4. Create Instance Trough Stack ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 4. Create Instance Trough Stack || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|}
 
|}
  
Line 135: Line 135:
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Create Image For Metrics || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Create Image For Metrics || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 2. Update Image Name || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Update Image Name || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 3. Update Image Disk Ram Size || FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 3. Update Image Disk Ram Size || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|}
 
|}
  
Line 146: Line 146:
 
! Networking-Tests || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! Networking-Tests || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
−
| 1. Ping from Controller to Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 1. Ping from Controller to Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|-
 
|-
−
| 2. Ping Between Instances ||FAIL || FAIL|| PASS|| PASS|| PASS|| PASS||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
+
| 2. Ping Between Instances || FAIL|| FAIL || FAIL|| FAIL|| FAIL|| FAIL||PASS|| PASS|| https://bugs.launchpad.net/starlingx/+bug/1825045
 
|}
 
|}
  

Revision as of 04:29, 25 April 2019

Sanity Test

Sanity-OpenStack

iso DATE
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190424T145954Z/ 24 - April - 2019
Bare metal bug https://bugs.launchpad.net/starlingx/+bug/1826308
01-Instance-From-Image AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL PASS PASS PASS PASS
2. Create Images for Instances FAIL FAIL FAIL FAIL PASS PASS PASS PASS
3. Create Networks for Instances FAIL FAIL FAIL FAIL PASS PASS PASS PASS
4. Launch Instances FAIL FAIL FAIL FAIL PASS PASS PASS PASS
5. Suspend Resume Instances FAIL FAIL FAIL FAIL PASS PASS PASS PASS
6. Set Error Active Flags Instances FAIL FAIL FAIL FAIL PASS PASS PASS PASS
7. Pause Unpause Instances FAIL FAIL FAIL FAIL PASS PASS PASS PASS
8. Stop Start Instances FAIL FAIL FAIL FAIL PASS PASS PASS PASS
9. Lock Unlock Instances FAIL FAIL FAIL FAIL PASS PASS PASS PASS
10. Reboot Instances FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
11. Rebuild Instances FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
12. Resize Instances FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
13. Set Unset Properties Instances FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
14. Evacuate Instances From Hosts FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
02-Instance-From-Volume AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
3. Create Networks for Instance FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
4. Create Volume for Instances FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
5. Launch Instances FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
6. Suspend Resume Instance FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
7. Set Error Active Flags Instance FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
8. Pause Unpause Instances FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
9. Stop Start Instances FAIL FAIL FAIL FAIL FAIL PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
10. Lock Unlock Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
11. Reboot Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
12. Rebuild Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
13. Resize Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
14. Set Unset Properties Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
15. Evacuate Instances From Hosts NA NA FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
3. Create Networks for Instance FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
4. Create Volume for Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
5. Create Snapshot for Instance FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
6. Launch Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
7. Suspend Resume Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
8. Set Error Active Flags Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1826308
9. Pause Unpause Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
10. Stop Start Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
11. Lock Unlock Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
12. Reboot Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
13. Rebuild Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
14. Resize Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
15. Set Unset Properties Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
16. Evacuate Instances From Hosts NA NA FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
3. Create Networks for Instance FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
4. Create Instance Trough Stack FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Image For Metrics FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
2. Update Image Name FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
3. Update Image Disk Ram Size FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
Networking-Tests AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Ping from Controller to Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045
2. Ping Between Instances FAIL FAIL FAIL FAIL FAIL FAIL PASS PASS https://bugs.launchpad.net/starlingx/+bug/1825045

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. Add Controller Host Simplex FAIL FAIL PASS PASS PASS PASS PASS PASS
2. Swact Controller Host Simplex FAIL FAIL PASS PASS PASS PASS PASS PASSL
01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. OpenStack PODs Healthy FAIL FAIL PASS PASS PASS PASS PASS PASS
2. Reapply STX OpenStack FAIL FAIL PASS PASS PASS PASS PASS PASS
3. STX OpenStack Override Update Reset FAIL FAIL PASS PASS PASS PASS PASS PASS
4. Kube System Services FAIL FAIL PASS PASS PASS PASS PASS PASS
5. Create Check Delete POD FAIL FAIL PASS PASS PASS PASS PASS PASS
Retrieved from "https://wiki.openstack.org/w/index.php?title=StarlingX/Test/SanityTests&oldid=169645"