Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(Sanity-OpenStack)
(Sanity-OpenStack)
Line 5: Line 5:
 
! iso  || DATE
 
! iso  || DATE
 
|-
 
|-
| http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190410T013000Z/outputs/iso/ || 10 - April - 2019
+
| http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190412T013000Z/outputs/iso/ || 12 - April - 2019
 
|}
 
|}
 
{| class="wikitable"
 
{| class="wikitable"
Line 11: Line 11:
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Flavors for Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS ||
+
| 1. Create Flavors for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 2. Create Images for Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS ||
+
| 2. Create Images for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 3. Create Networks for Instances || PASS || PASS || PASS || N/A|| PASS || PASS || PASS || PASS ||
+
| 3. Create Networks for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 4. Launch Instances || PASS || PASS || PASS || N/A || FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 4. Launch Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 5. Suspend Resume Instances || PASS || PASS || PASS || N/A || FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 5. Suspend Resume Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 6. Set Error Active Flags Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 6. Set Error Active Flags Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 7. Pause Unpause Instances || PASS || PASS || PASS|| N/A|| FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 7. Pause Unpause Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 8. Stop Start Instances || PASS || PASS || PASS || N/A|| FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 8. Stop Start Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 9. Lock Unlock Instances || PASS || PASS || PASS || N/A || FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 9. Lock Unlock Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 10. Reboot Instances || PASS || PASS || PASS || N/A || FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 10. Reboot Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 11. Rebuild Instances || PASS || PASS || PASS|| N/A || FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 11. Rebuild Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 12. Resize Instances || PASS || PASS || PASS || N/A || FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 12. Resize Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 13. Set Unset Properties Instances || PASS || PASS || PASS|| N/A || FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 13. Set Unset Properties Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 14. Evacuate Instances From Hosts || NA || NA ||PASS || N/A || PASS || PASS || PASS || PASS ||  
+
| 14. Evacuate Instances From Hosts || NA || NA || FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
  
 
|}
 
|}
Line 45: Line 45:
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 02-Instance-From-Volume || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Flavors for Instances || PASS || PASS ||PASS || N/A || PASS || PASS || PASS || PASS ||
+
| 1. Create Flavors for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 2. Create Images for Instances || PASS || PASS ||PASS|| N/A|| PASS || PASS || PASS || PASS ||
+
| 2. Create Images for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 3. Create Networks for Instance || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS ||
+
| 3. Create Networks for Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 4. Create Volume for Instances || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS ||
+
| 4. Create Volume for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 5. Launch Instances || PASS || PASS || PASS || N/A || FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1823275
+
| 5. Launch Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 6. Suspend Resume Instance || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS ||
+
| 6. Suspend Resume Instance ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 7. Set Error Active Flags Instance || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS ||
+
| 7. Set Error Active Flags Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 8. Pause Unpause Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS ||
+
| 8. Pause Unpause Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 9. Stop Start Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS ||
+
| 9. Stop Start Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 10. Lock Unlock Instances || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS ||
+
| 10. Lock Unlock Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 11. Reboot Instances || PASS || PASS ||PASS || N/A || PASS || PASS || PASS || PASS ||
+
| 11. Reboot Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
|12. Rebuild Instances || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS ||
+
|12. Rebuild Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 13. Resize Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS ||
+
| 13. Resize Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 14. Set Unset Properties Instances || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS ||
+
| 14. Set Unset Properties Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 15. Evacuate Instances From Hosts || NA || NA || PASS || N/A || PASS || PASS || PASS || PASS ||
+
| 15. Evacuate Instances From Hosts || NA || NA || FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
  
 
|}
 
|}
Line 81: Line 81:
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 03-Instance-From-Snapshot  || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Flavors for Instances || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS
+
| 1. Create Flavors for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 2. Create Images for Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 2. Create Images for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 3. Create Networks for Instance || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 3. Create Networks for Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 4. Create Volume for Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 4. Create Volume for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 5. Create Snapshot for Instance || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS
+
| 5. Create Snapshot for Instance || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 6. Launch Instances || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS
+
| 6. Launch Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 7. Suspend Resume Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 7. Suspend Resume Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 8. Set Error Active Flags Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 8. Set Error Active Flags Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 9. Pause Unpause Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 9. Pause Unpause Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 10. Stop Start Instances || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS
+
| 10. Stop Start Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 11. Lock Unlock Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 11. Lock Unlock Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 12. Reboot Instances || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS
+
| 12. Reboot Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 13. Rebuild Instances || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS
+
| 13. Rebuild Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
 
| 14. Resize Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
 
| 14. Resize Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
 
|-
 
|-
| 15. Set Unset Properties Instances || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS
+
| 15. Set Unset Properties Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 16. Evacuate Instances From Hosts || NA|| NA || N/A || PASS || PASS || PASS || PASS || PASS
+
| 16. Evacuate Instances From Hosts || NA|| NA || FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
  
Line 120: Line 120:
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 04-Instance-From-Heat-Template || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Flavors for Instances || PASS || PASS || PASS || N/A|| PASS || PASS || PASS || PASS
+
| 1. Create Flavors for Instances || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 2. Create Images for Instances || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 2. Create Images for Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 3. Create Networks for Instance || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS
+
| 3. Create Networks for Instance ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 4. Create Instance Trough Stack || PASS || PASS || PASS|| N/A || PASS || PASS || PASS || PASS
+
| 4. Create Instance Trough Stack || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|}
 
|}
  
Line 133: Line 133:
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 05-Measurements-For-Metric || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Image For Metrics || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 1. Create Image For Metrics || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 2. Update Image Name || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 2. Update Image Name || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 3. Update Image Disk Ram Size || PASS || PASS || PASS || N/A || PASS || PASS || PASS || PASS
+
| 3. Update Image Disk Ram Size || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|}
 
|}
  
Line 144: Line 144:
 
! Networking-Tests || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! Networking-Tests || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Ping from Controller to Instances || N/A || N/A || N/A || N/A || FAIL || FAIL || FAIL || FAIL|| https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 1. Ping from Controller to Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 2. Ping Between Instances ||N/A || N/A || N/A || N/A || FAIL || FAIL || FAIL || FAIL || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 2. Ping Between Instances ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|}
 
|}
  

Revision as of 17:52, 12 April 2019

Sanity Test

Sanity-OpenStack

iso DATE
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190412T013000Z/outputs/iso/ 12 - April - 2019
01-Instance-From-Image AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. Create Networks for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
4. Launch Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
5. Suspend Resume Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
6. Set Error Active Flags Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
7. Pause Unpause Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
8. Stop Start Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
9. Lock Unlock Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
10. Reboot Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
11. Rebuild Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
12. Resize Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
13. Set Unset Properties Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
14. Evacuate Instances From Hosts NA NA FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
02-Instance-From-Volume AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. Create Networks for Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
4. Create Volume for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
5. Launch Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
6. Suspend Resume Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
7. Set Error Active Flags Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
8. Pause Unpause Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
9. Stop Start Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
10. Lock Unlock Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
11. Reboot Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
12. Rebuild Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
13. Resize Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
14. Set Unset Properties Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
15. Evacuate Instances From Hosts NA NA FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. Create Networks for Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
4. Create Volume for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
5. Create Snapshot for Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
6. Launch Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
7. Suspend Resume Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
8. Set Error Active Flags Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
9. Pause Unpause Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
10. Stop Start Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
11. Lock Unlock Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
12. Reboot Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
13. Rebuild Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
14. Resize Instances PASS PASS PASS N/A PASS PASS PASS PASS
15. Set Unset Properties Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
16. Evacuate Instances From Hosts NA NA FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. Create Networks for Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
4. Create Instance Trough Stack FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Image For Metrics FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Update Image Name FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. Update Image Disk Ram Size FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
Networking-Tests AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Ping from Controller to Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Ping Between Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM
1. Add Controller Host Simplex PASS PASS NA NA NA NA NA NA
2. Swact Controller Host Simplex PASS PASS NA NA NA NA NA NA
01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. OpenStack PODs Healthy PASS FAIL PASS N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1821938
2. Reapply STX OpenStack PASS PASS PASS N/A PASS PASS PASS PASS
3. STX OpenStack Override Update Reset PASS PASS PASS N/A PASS PASS PASS PASS
4. Kube System Services PASS FAIL PASS N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1821938
5. Create Check Delete POD PASS FAIL PASS N/A PASS PASS PASS PASS https://bugs.launchpad.net/starlingx/+bug/1821938