Jump to: navigation, search

Difference between revisions of "StarlingX/stx.2018.10 TestingSummary"

(Multinode external storage Bare metal)
(Multinode external storage virtual)
Line 277: Line 277:
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
+
! DOMAIN !! BLOCKED  !! FAIL !! PASS !! Pending !! Grand Total
 
|-
 
|-
| Backup and restore || || || 5 || 5
+
| Backup and restore ||  || || 3 || 2 || 5
 
|-
 
|-
| Fault Management || 1 || || 10 || 11
+
| Fault Management ||    || 1 || 4 || 6 || 11
 
|-
 
|-
| Heat || || || 3 || 3
+
| Heat ||    || || || 3 || 3
 
|-
 
|-
| High Availability || || || 9 || 9
+
| High Availability ||    || || 3 || 6 || 9
 
|-
 
|-
| Horizon || || || 2 || 2
+
| Horizon ||    || || || 2 || 2
 
|-
 
|-
| Installation and Config || || || 3 || 3
+
| Installation and Config ||    || || || 3 || 3
 
|-
 
|-
| Maintenance || 1 || 7 || 5 || 13
+
| Maintenance ||   || || 12 || 1 || 13
 
|-
 
|-
| Networking || || || 16 || 16
+
| Networking ||    || || || 16 || 16
 
|-
 
|-
| Nova || || || 18 || 18
+
| Nova ||    || || || 18 || 18
 
|-
 
|-
| Security || || 2 || 6 || 8
+
| Security ||    || || 3 || 5 || 8
 
|-
 
|-
| Simplex || || || 1 || 1
+
| Simplex ||    || || || 1 || 1
 
|-
 
|-
| Storage || 1 || 3 || 1 || 5
+
| Storage ||    || 1 || 3 || 1 || 5
 
|-
 
|-
| System || || 4 || || 4
+
| System ||  11  || || 4 || || 15
 
|-
 
|-
| System Inventory || || || 12 || 12
+
| System Inventory ||    || || || 12 || 12
 
|-
 
|-
| Grand Total || 3 || 16 || 91 || 110
+
| Grand Total ||   11  || 2 || 32 || 76 || 121
 
|}
 
|}

Revision as of 15:12, 12 October 2018

October Release Testing Progress

Last update: 10/10/2018

Launchpads

ID Title Reproduced on
https://bugs.launchpad.net/starlingx/+bug/1796420 Simplex Bare-Metal : Nova-compute with Status=disable and State=down/degraded Simplex Bare metal, simplex virtual
https://bugs.launchpad.net/starlingx/+bug/1796751 Inactive controller stays in booting after mgmtnetwork down Duplex bare metal, duplex virtual, multinode local storage virtual
https://bugs.launchpad.net/starlingx/+bug/1797234 Instance/VM Console is not opened, Horizon is getting back with Network Error (tcp_error) Multinode external storage virtual
https://bugs.launchpad.net/starlingx/+bug/1797217 namespace is not reasgined on swact Duplex baremetal
https://bugs.launchpad.net/starlingx/+bug/1797474 Simplex-Virtual, Nova-compute with Status=disable and State=down/degraded Simplex Virtual
https://bugs.launchpad.net/starlingx/+bug/1797422 Admin credentials are setup on both controllers after swact Duplex bare metal, Multinode bare metal

Simplex Bare metal

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 5 5
Fault Management 6 3 9
Heat 3 3
High Availability 3 3
Horizon 2 2
Installation and Config 2 2
Maintenance 4 0 4
Networking 1 9 10
Nova 15 15
Security 1 6 7
Simplex 4 4
Storage 3 3
System 3 3 6
System Inventory 7 7
Grand Total 15 65 80

Simplex Virtual

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 5 5
Fault Management 1 7 8
Heat 3 3
High Availability 3 3
Horizon 4 4
Installation and Config 2 2
Maintenance 3 3
Networking 10 10
Nova 11 11
Security 7 7
Simplex 4 4
Storage 2 2
System 3 2 5
System Inventory 4 4
Grand Total 10 61 71

Duplex Bare metal

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 5 5
Fault Management 9 2 11
Heat 3 3
High Availability 4 2 6
Horizon 2 3 5
Installation and Config 2 2
Maintenance 5 2 7
Networking 2 15 17
Nova 3 12 15
Security 8 8
Simplex 1 1
Storage 2 2
System 1 10 1 12
System Inventory 2 4 6
Grand Total 1 41 58 100

Duplex Virtual

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 3 2 5
Fault Management 9 2 11
Heat 3 3
High Availability 4 2 6
Horizon 2 2
Installation and Config 2 2
Maintenance 1 5 1 7
Networking 17 17
Nova 6 13 19
Security 6 2 8
Simplex 1 1
Storage 2 1 3
System 6 6 12
System Inventory 3 6 9
Grand Total 1 50 54 105

Multinode local storage Bare metal

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 3 2 5
Fault Management 1 10 11
Heat 3 3
High Availability 2 7 9
Horizon 2 2
Installation and Config 2 1 3
Maintenance 6 5 11
Networking 16 16
Nova 5 14 19
Security 8 1 9
Simplex 1 1
Storage 1 3 4
System 5 9 14
System Inventory 4 7 11
Grand Total 1 51 66 118

Multinode local storage virtual

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 3 2 5
Fault Management 1 11 12
Heat 3 3
High Availability 1 4 4 9
Horizon 5 5
Installation and Config 3 3
Maintenance 2 10 1 13
Networking 16 16
Nova 2 14 16
Security 8 8
Simplex 1 1
Storage 1 2 3
System 14 14
System Inventory 6 4 10
Grand Total 4 57 57 118

Multinode external storage Bare metal

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 3 2 5
Fault Management 6 5 11
Heat 3 3
High Availability 5 4 9
Horizon 5 5
Installation and Config 3 3
Maintenance 14 14
Networking 16 16
Nova 14 14
Security 8 8
Simplex 1 1
Storage 2 2 4
System 4 11 15
System Inventory 9 9
Grand Total 20 97 117

Multinode external storage virtual

DOMAIN BLOCKED FAIL PASS Pending Grand Total
Backup and restore 3 2 5
Fault Management 1 4 6 11
Heat 3 3
High Availability 3 6 9
Horizon 2 2
Installation and Config 3 3
Maintenance 12 1 13
Networking 16 16
Nova 18 18
Security 3 5 8
Simplex 1 1
Storage 1 3 1 5
System 11 4 15
System Inventory 12 12
Grand Total 11 2 32 76 121