Jump to: navigation, search

Difference between revisions of "StarlingX/Test/SanityTests"

(Sanity-Platform)
(Sanity-OpenStack)
Line 1: Line 1:
 
= Sanity Test=
 
= Sanity Test=
 
== ''Sanity-OpenStack'' ==
 
== ''Sanity-OpenStack'' ==
 
Tests were not run because provisioning fails
 
  
 
{| class="wikitable"
 
{| class="wikitable"
Line 8: Line 6:
 
! iso  || DATE
 
! iso  || DATE
 
|-
 
|-
|http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190523T013000Z/|| 23 - MAY- 2019
+
|http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190609T233000Z/outputs/iso/|| 10 - Jun- 2019
 
|-
 
|-
 
| . || .
 
| . || .
Line 21: Line 19:
 
| 1. Provisioning Simplex System || PASS || PASS ||  
 
| 1. Provisioning Simplex System || PASS || PASS ||  
 
|-
 
|-
| 2. Provisioning Duplex System || PASS || PASS ||
+
| 2. Provisioning Duplex System || N/A || FAIL ||
 
|-
 
|-
| 3. Provisioning Standard Non-Storage System || PASS || PASS ||
+
| 3. Provisioning Standard Non-Storage System || N/A|| FAIL||
 
|-
 
|-
| 4. Provisioning Standard Storage System || PASS|| PASS ||
+
| 4. Provisioning Standard Storage System || N/A|| PASS ||
 
|}
 
|}
  
Line 31: Line 29:
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
! 01-Instance-From-Image || AIO - Simplex Virtual  || AIO - Duplex Virtual || Standard - Local Storage (2+2) Virtual || Standard - Dedicated Storage (2+2+2) Virtual || AIO - Simplex BM || AIO - Duplex BM  || Standard - Local Storage (2+2) BM || Standard - Dedicated Storage (2+2+2) BM || bug
 
|-
 
|-
| 1. Create Flavors for Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 1. Create Flavors for Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 2. Create Images for Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 2. Create Images for Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 3. Create Networks for Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS|||
+
| 3. Create Networks for Instances ||PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 4. Launch Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 4. Launch Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 5. Suspend Resume Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 5. Suspend Resume Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 6. Set Error Active Flags Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 6. Set Error Active Flags Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 7. Pause Unpause Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 7. Pause Unpause Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 8. Stop Start Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 8. Stop Start Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 9. Lock Unlock Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 9. Lock Unlock Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 10. Reboot Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 10. Reboot Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 11. Rebuild Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 11. Rebuild Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 12. Resize Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 12. Resize Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 13. Set Unset Properties Instances || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 13. Set Unset Properties Instances || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|-
 
|-
| 14. Evacuate Instances From Hosts || PASS ||PASS || PASS||PASS||PASS||PASS||PASS||PASS||
+
| 14. Evacuate Instances From Hosts || PASS ||FAIL|| FAIL||N/A||PASS||N/A||N/A||N/A||
 
|}
 
|}
  

Revision as of 01:46, 11 June 2019

Sanity Test

Sanity-OpenStack

iso DATE
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190609T233000Z/outputs/iso/ 10 - Jun- 2019
. .
Provision-Containers AIO - Simplex Virtual AIO - Baremetal bug
1. Provisioning Simplex System PASS PASS
2. Provisioning Duplex System N/A FAIL
3. Provisioning Standard Non-Storage System N/A FAIL
4. Provisioning Standard Storage System N/A PASS
01-Instance-From-Image AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
2. Create Images for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
3. Create Networks for Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
4. Launch Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
5. Suspend Resume Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
6. Set Error Active Flags Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
7. Pause Unpause Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
8. Stop Start Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
9. Lock Unlock Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
10. Reboot Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
11. Rebuild Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
12. Resize Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
13. Set Unset Properties Instances PASS FAIL FAIL N/A PASS N/A N/A N/A
14. Evacuate Instances From Hosts PASS FAIL FAIL N/A PASS N/A N/A N/A
02-Instance-From-Volume AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS PASS PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS PASS PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS PASS PASS PASS PASS PASS
4. Create Volume for Instances PASS PASS PASS PASS PASS PASS PASS PASS
5. Launch Instances PASS PASS PASS PASS PASS PASS PASS PASS
6. Suspend Resume Instance PASS PASS PASS PASS PASS PASS PASS PASS
7. Set Error Active Flags Instance PASS PASS PASS PASS PASS PASS PASS PASS
8. Pause Unpause Instances PASS PASS PASS PASS PASS PASS PASS PASS
9. Stop Start Instances PASS PASS PASS PASS PASS PASS PASS PASS
10. Lock Unlock Instances PASS PASS PASS PASS PASS PASS PASS PASS
11. Reboot Instances PASS PASS PASS PASS PASS PASS PASS PASS
12. Rebuild Instances PASS PASS PASS PASS PASS PASS PASS PASS
13. Resize Instances PASS PASS PASS PASS PASS PASS PASS PASS
14. Set Unset Properties Instances PASS PASS PASS PASS PASS PASS PASS PASS
15. Evacuate Instances From Hosts PASS PASS PASS PASS PASS PASS PASS PASS
03-Instance-From-Snapshot AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS PASS PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS PASS PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS PASS PASS PASS PASS PASS
4. Create Volume for Instances PASS PASS PASS PASS PASS PASS PASS PASS
5. Create Snapshot for Instance PASS PASS PASS PASS PASS PASS PASS PASS
6. Launch Instances PASS PASS PASS PASS PASS PASS PASS PASS
7. Suspend Resume Instances PASS PASS PASS PASS PASS PASS PASS PASS
8. Set Error Active Flags Instances PASS PASS PASS PASS PASS PASS PASS PASS
9. Pause Unpause Instances PASS PASS PASS PASS PASS PASS PASS PASS
10. Stop Start Instances PASS PASS PASS PASS PASS PASS PASS PASS
11. Lock Unlock Instances PASS PASS PASS PASS PASS PASS PASS PASS
12. Reboot Instances PASS PASS PASS PASS PASS PASS PASS PASS
13. Rebuild Instances PASS PASS PASS PASS PASS PASS PASS PASS
14. Resize Instances PASS PASS PASS PASS PASS PASS PASS PASS
15. Set Unset Properties Instances PASS PASS PASS PASS PASS PASS PASS PASS
16. Evacuate Instances From Hosts PASS PASS PASS PASS PASS PASS PASS PASS
04-Instance-From-Heat-Template AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Flavors for Instances PASS PASS PASS PASS PASS PASS PASS PASS
2. Create Images for Instances PASS PASS PASS PASS PASS PASS PASS PASS
3. Create Networks for Instance PASS PASS PASS PASS PASS PASS PASS PASS
4. Create Instance Trough Stack PASS PASS PASS PASS PASS PASS PASS PASS
05-Measurements-For-Metric AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Create Image For Metrics PASS PASS PASS PASS PASS PASS PASS PASS
2. Update Image Name PASS PASS PASS PASS PASS PASS PASS PASS
3. Update Image Disk Ram Size PASS PASS PASS PASS PASS PASS PASS PASS
Networking-Tests AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtual Standard - Dedicated Storage (2+2+2) Virtual AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM bug
1. Ping from Controller to Instances N/A N/A N/A N/A N/A N/A N/A N/A
2. Ping Between Instances N/A N/A N/A N/A N/A N/A N/A N/A

Sanity-Platform

01-Host-Management AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtua Standard - Dedicated Storage (2+2+2) Virtua AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM Bug
1. Lock Active Controller PASS PASS PASS PASS PASS PASS PASS PASS
2. Lock Unlock Standby Controller PASS PASS PASS PASS PASS PASS PASS PASS
3. Lock Unlock Compute Hosts PASS PASS PASS PASS PASS PASS PASS PASS
02-sanity-platform AIO - Simplex Virtual AIO - Duplex Virtual Standard - Local Storage (2+2) Virtua Standard - Dedicated Storage (2+2+2) Virtua AIO - Simplex BM AIO - Duplex BM Standard - Local Storage (2+2) BM Standard - Dedicated Storage (2+2+2) BM Bug
1. OpenStack PODs Healthy PASS PASS PASS PASS PASS PASS PASS PASS
2. Reapply STX OpenStack PASS PASS PASS PASS PASS PASS PASS PASS
3. STX OpenStack Override Update Reset PASS PASS PASS PASS PASS PASS PASS PASS
4. Kube System Services PASS PASS PASS PASS PASS PASS PASS PASS
5. Create Check Delete POD PASS PASS PASS PASS PASS PASS PASS PASS