Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(Sanity-OpenStack)
(Sanity-Platform)
Line 153: Line 153:
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
! 01-Host-Management || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM
+
! 01-Host-Management || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM || Bug
 
|-
 
|-
| 1. Add Controller Host Simplex || PASS || PASS || NA || NA || NA || NA || NA || NA  
+
| 1. Add Controller Host Simplex || FAIL || FAIL || NA || NA || NA || NA || NA || NA ||https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 2. Swact Controller Host Simplex || PASS || PASS || NA || NA || NA || NA || NA || NA  
+
| 2. Swact Controller Host Simplex || FAIL || FAIL || NA || NA || NA || NA || NA || NA ||https://bugs.launchpad.net/starlingx/+bug/1824567
 
|}
 
|}
  
Line 164: Line 164:
 
! 01-Host-Management || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM || Bug
 
! 01-Host-Management || AIO - Simplex Virtual  || AIO - Simplex BM || AIO - Duplex Virtual || AIO - Duplex BM || Standard - Local Storage (2+2) Virtual || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) Virtual || Standard - Dedicated Storage (2+2+2) BM || Bug
 
|-
 
|-
| 1. OpenStack PODs Healthy || PASS || FAIL || PASS || N/A || PASS || PASS || PASS || PASS || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 1. OpenStack PODs Healthy || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 2. Reapply STX OpenStack || PASS || PASS || PASS|| N/A  || PASS || PASS || PASS || PASS ||
+
| 2. Reapply STX OpenStack ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 3. STX OpenStack Override Update Reset || PASS || PASS || PASS || N/A  || PASS || PASS || PASS || PASS ||
+
| 3. STX OpenStack Override Update Reset ||FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 4. Kube System Services || PASS || FAIL || PASS|| N/A  || PASS || PASS || PASS || PASS || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 4. Kube System Services || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|-
 
|-
| 5. Create Check Delete POD || PASS || FAIL || PASS|| N/A  || PASS || PASS || PASS || PASS || https://bugs.launchpad.net/starlingx/+bug/1821938
+
| 5. Create Check Delete POD || FAIL || FAIL|| FAIL|| FAIL|| FAIL|| FAIL || FAIL|| FAIL|| https://bugs.launchpad.net/starlingx/+bug/1824567
 
|}
 
|}

Revision as of 17:54, 12 April 2019

Sanity Test

Sanity-OpenStack

iso DATE
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190412T013000Z/outputs/iso/ 12 - April - 2019
01-Instance-From-Image AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. Create Networks for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
4. Launch Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
5. Suspend Resume Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
6. Set Error Active Flags Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
7. Pause Unpause Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
8. Stop Start Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
9. Lock Unlock Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
10. Reboot Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
11. Rebuild Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
12. Resize Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
13. Set Unset Properties Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
14. Evacuate Instances From Hosts NA NA FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
02-Instance-From-Volume AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. Create Networks for Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
4. Create Volume for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
5. Launch Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
6. Suspend Resume Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
7. Set Error Active Flags Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
8. Pause Unpause Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
9. Stop Start Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
10. Lock Unlock Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
11. Reboot Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
12. Rebuild Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
13. Resize Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
14. Set Unset Properties Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
15. Evacuate Instances From Hosts NA NA FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. Create Networks for Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
4. Create Volume for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
5. Create Snapshot for Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
6. Launch Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
7. Suspend Resume Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
8. Set Error Active Flags Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
9. Pause Unpause Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
10. Stop Start Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
11. Lock Unlock Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
12. Reboot Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
13. Rebuild Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
14. Resize Instances PASS PASS PASS N/A PASS PASS PASS PASS
15. Set Unset Properties Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
16. Evacuate Instances From Hosts NA NA FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Create Images for Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. Create Networks for Instance FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
4. Create Instance Trough Stack FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Image For Metrics FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Update Image Name FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. Update Image Disk Ram Size FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
Networking-Tests AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Ping from Controller to Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Ping Between Instances FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. Add Controller Host Simplex FAIL FAIL NA NA NA NA NA NA https://bugs.launchpad.net/starlingx/+bug/1824567
2. Swact Controller Host Simplex FAIL FAIL NA NA NA NA NA NA https://bugs.launchpad.net/starlingx/+bug/1824567
01-Host-Management AIO - Simplex Virtual AIO - Simplex BM AIO - Duplex Virtual AIO - Duplex BM Standard - Local Storage (2+2) Virtual Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) Virtual Standard - Dedicated Storage (2+2+2) BM Bug
1. OpenStack PODs Healthy FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
2. Reapply STX OpenStack FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
3. STX OpenStack Override Update Reset FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
4. Kube System Services FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567
5. Create Check Delete POD FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL https://bugs.launchpad.net/starlingx/+bug/1824567