Jump to: navigation, search

Difference between revisions of "StarlingX/stx.2018.10 TestingSummary"

(Simplex Bare metal)
(October Release Testing Progress)
 
(84 intermediate revisions by the same user not shown)
Line 2: Line 2:
 
== October Release Testing Progress ==
 
== October Release Testing Progress ==
  
Last update: 10/11/2018<br />
+
Last update: 10/23/2018<br />
  
 
=== Launchpads ===
 
=== Launchpads ===
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
! ID !! Title !! Reproduced on
+
! ID !! Title !! Reproduced on !! Comments
 
|-
 
|-
| https://bugs.launchpad.net/starlingx/+bug/1796420 || Simplex Bare-Metal : Nova-compute with Status=disable and State=down/degraded|| Simplex Bare metal, simplex virtual
+
| https://bugs.launchpad.net/starlingx/+bug/1796420 || Simplex Bare-Metal : Nova-compute with Status=disable and State=down/degraded|| Simplex Bare metal, simplex virtual || DPDK patch
 
|-
 
|-
| https://bugs.launchpad.net/starlingx/+bug/1796751 || Inactive controller stays in booting after mgmtnetwork down|| Duplex bare metal, duplex virtual, multinode local storage virtual
+
| https://bugs.launchpad.net/starlingx/+bug/1796751 || Inactive controller stays in booting after mgmtnetwork down|| Duplex bare metal, duplex virtual, multinode local storage virtual || Incorrect network configuration (infrastructure), not an issue
 
|-
 
|-
| https://bugs.launchpad.net/starlingx/+bug/1797234 || Instance/VM Console is not opened, Horizon is getting back with Network Error (tcp_error) || Multinode external storage virtual
+
| https://bugs.launchpad.net/starlingx/+bug/1797234 || Instance/VM Console is not opened, Horizon is getting back with Network Error (tcp_error) || Multinode external storage virtual || Might be a configuration issue, deeper debug required
 
|-
 
|-
| https://bugs.launchpad.net/starlingx/+bug/1797217 || namespace is not reasgined on swact || Duplex baremetal
+
| https://bugs.launchpad.net/starlingx/+bug/1797217 || namespace is not reasgined on swact || Duplex baremetal || Not an issue, expected behavior described in the bug is incorrect.
 
|-
 
|-
| https://bugs.launchpad.net/starlingx/+bug/1797474 || Simplex-Virtual, Nova-compute with Status=disable and State=down/degraded || Simplex Virtual
+
| https://bugs.launchpad.net/starlingx/+bug/1797474 || Simplex-Virtual, Nova-compute with Status=disable and State=down/degraded || Simplex Virtual || Duplicated - https://bugs.launchpad.net/starlingx/+bug/1796380
 
|-
 
|-
| https://bugs.launchpad.net/starlingx/+bug/1797422 || Admin credentials are setup on both controllers after swact || Duplex bare metal, Multinode bare metal
+
| https://bugs.launchpad.net/starlingx/+bug/1797422 || Admin credentials are setup on both controllers after swact || Duplex bare metal, Multinode bare metal || Expected behavior. Not an issue (maybe security)?
 +
|-
 +
| https://bugs.launchpad.net/starlingx/+bug/1797961 || MemPageSIze can be empty on a flavor || Duplex bare metal || Upstream nova behavior. "The way the code is written, an empty value here is equivalent to not specifying a pagesize at all."
 +
|-
 +
| https://bugs.launchpad.net/starlingx/+bug/1798442 || Changing MTU value on Data network causes reboot cycling || Multinode local storage bare metal, multinode external storage bare metal, duplex bare metal || Deferred to march release
 +
|-
 +
| https://bugs.launchpad.net/starlingx/+bug/1798631 || Killing glance.api.pid process is not creating any kind of fm alarm-list || Multinode external storage virtual || Issue not reproducible in bare metal. Deferred to march release
 +
|-
 +
| https://bugs.launchpad.net/starlingx/+bug/1798994 || Volume snapshot created from a cirros image can not be deleted with cli || Multinode external storage virtual || "If this is standard openstack behavior, we may choose not to change it. Further investigation is required." - deferred to March release
 +
|-
 +
| https://bugs.launchpad.net/starlingx/+bug/1799271 || error on system restore attempt || Duplex bare metal || "Only fails on duplex bare metal setup. Might be setup specific". Assigned for deeper debug
 +
|-
 +
| https://bugs.launchpad.net/starlingx/+bug/1799312 ||  Cannot launch an instance with local storage || Multinode local storage bare metal, multinode local storage virtual || Assigned for deeper debug, deferred to march release
 +
|-
 +
| https://bugs.launchpad.net/starlingx/+bug/1799517 || "hw:mem_page_size=1GB" Metadata can not be assigned to a flavors with cli commands || Multinode external storage virtual || will try to reproduce with latest ISO
 +
|-
 +
| https://bugs.launchpad.net/starlingx/+bug/1799539 || 1G hugepages for memory allocation is not enable in Virtual external storage config || Multinode external storage virtual || will try to reproduce with latest ISO
 +
|-
 +
| https://bugs.launchpad.net/starlingx/+bug/1799590 || Process 'neutron-l3-agent' does not work || Multinode with local storage virtual ||
 +
|-
 +
| https://bugs.launchpad.net/starlingx/+bug/1799591 || $ ip netns does not display anything || Multinode with local storage virtual ||
 +
 
 
|}
 
|}
  
=== Simplex Bare metal ===
+
=== Simplex Bare metal - complete ===
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
|-
 
|-
| Backup and restore || || || 5 || 5
+
| Backup and restore || || 5 || || 5
 
|-
 
|-
| Fault Management || || 7 || 2 || 9
+
| Fault Management || 1 || 8 || || 9
 
|-
 
|-
| Heat || || || 3 || 3
+
| Heat || || 3 || || 3
 
|-
 
|-
| High Availability || || || 3 || 3
+
| High Availability || || 3 || || 3
 
|-
 
|-
 
| Horizon || || 2 || || 2
 
| Horizon || || 2 || || 2
 
|-
 
|-
| Installation and Config || || || 1 || 1
+
| Installation and Config || || 1 || || 1
 
|-
 
|-
 
| Maintenance || || 4 || || 4
 
| Maintenance || || 4 || || 4
 
|-
 
|-
| Networking || || 5 || 4 || 9
+
| Networking || || 7 || || 7
 
|-
 
|-
| Nova || || || 15 || 15
+
| Nova || || 15 || || 15
 
|-
 
|-
| Security || || 3 || 4 || 7
+
| Security || || 7 || || 7
 
|-
 
|-
| Simplex || || 3 || 1 || 4
+
| Simplex || || 4 || || 4
 
|-
 
|-
| Storage || || || 3 || 3
+
| Storage || || 3 || || 3
 
|-
 
|-
| System || || 3 || 3 || 6
+
| System || || 6 || || 6
 
|-
 
|-
| System Inventory || || 4 || 3 || 7
+
| System Inventory || 1 || 6    || || 7
 
|-
 
|-
| Grand Total || || 31 || 47 || 78
+
| Grand Total || 2 || 74 ||     || 76
 
|}
 
|}
  
Line 63: Line 84:
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
|-
 
|-
| Backup and restore || || || 5 || 5
+
| Backup and restore || || 5 || || 5
 
|-
 
|-
| Fault Management || || 1 || 7 || 8
+
| Fault Management || 1 || 5 || 2 || 8
 
|-
 
|-
 
| Heat || || || 3 || 3
 
| Heat || || || 3 || 3
 
|-
 
|-
| High Availability || || 3 || || 3
+
| High Availability || || 3 || || 3
 
|-
 
|-
| Horizon || || || 4 || 4
+
| Horizon || || 4 || || 4
 
|-
 
|-
| Installation and Config || || || 2 || 2
+
| Installation and Config || || || 1 || 1
 
|-
 
|-
 
| Maintenance || || 3 || || 3
 
| Maintenance || || 3 || || 3
 
|-
 
|-
| Networking || || || 10 || 10
+
| Networking || || 2 || 6 || 8
 
|-
 
|-
 
| Nova || || || 11 || 11
 
| Nova || || || 11 || 11
Line 87: Line 108:
 
| Storage || || || 2 || 2
 
| Storage || || || 2 || 2
 
|-
 
|-
| System || || 3 || 2 || 5
+
| System || || 6 || || 6
 
|-
 
|-
| System Inventory || || || 4 || 4
+
| System Inventory || || 1 || 1 || 2
 
|-
 
|-
| Grand Total || || 10 || 61 || 71
+
| Grand Total || 1 || 29 || 37 || 67
 
|}
 
|}
  
=== Duplex Bare metal ===
+
=== Duplex Bare metal - complete ===
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
|-
 
|-
| Backup and restore || || || 5 || 5
+
| Backup and restore || 2 || 3 || || 5
 
|-
 
|-
| Fault Management || || 9 || 2 || 11
+
| Fault Management || 1 || 10 || || 11
 
|-
 
|-
 
| Heat || || 3 || || 3
 
| Heat || || 3 || || 3
 
|-
 
|-
| High Availability || || 4 || 2 || 6
+
| High Availability || || 6 || || 6
 
|-
 
|-
| Horizon || || 2 || 3 || 5
+
| Horizon || || 5 || || 5
 
|-
 
|-
| Installation and Config || || || 2 || 2
+
| Installation and Config || || 2 || || 2
 
|-
 
|-
| Maintenance || || 5 || 2 || 7
+
| Maintenance || || 7 || || 7
 
|-
 
|-
| Networking || || 2 || 15 || 17
+
| Networking || || 15 || || 15
 
|-
 
|-
| Nova || || 3 || 12 || 15
+
| Nova || || 15 || || 15
 
|-
 
|-
| Security || || || 8 || 8
+
| Security || || 8 || || 8
 
|-
 
|-
 
| Simplex || || 1 || || 1
 
| Simplex || || 1 || || 1
 
|-
 
|-
| Storage || || || 2 || 2
+
| Storage || || 2 || || 2
 
|-
 
|-
| System || 1 || 10 || 1 || 12
+
| System || || 12 || || 12
 
|-
 
|-
| System Inventory || || 2 || 4 || 6
+
| System Inventory || 2 || 4 || || 6
 
|-
 
|-
| Grand Total || 1 || 41 || 58 || 100
+
| Grand Total || 5 || 93 || || 98
 
|}
 
|}
  
=== Duplex Virtual ===
+
=== Duplex Virtual - complete ===
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
|-
 
|-
| Backup and restore || || 3 || 2 || 5
+
| Backup and restore || || 5 || || 5
 
|-
 
|-
| Fault Management || || 9 || 2 || 11
+
| Fault Management || 1 || 10 || || 11
 
|-
 
|-
 
| Heat || || 3 || || 3
 
| Heat || || 3 || || 3
 
|-
 
|-
| High Availability || || 4 || 2 || 6
+
| High Availability || || 6 || || 6
 
|-
 
|-
 
| Horizon || || 2 || || 2
 
| Horizon || || 2 || || 2
 
|-
 
|-
| Installation and Config || || || 2 || 2
+
| Installation and Config || || 3 || || 3
 
|-
 
|-
| Maintenance || 1 || 5 || 1 || 7
+
| Maintenance || || 7 || || 7
 
|-
 
|-
| Networking || || || 17 || 17
+
| Networking || || 15  || || 15
 
|-
 
|-
| Nova || || 6 || 13 || 19
+
| Nova || || 19 || || 19
 
|-
 
|-
| Security || || 6 || 2 || 8
+
| Security || || 8 || || 8
 
|-
 
|-
 
| Simplex || || 1 || || 1
 
| Simplex || || 1 || || 1
 
|-
 
|-
| Storage || || 2 || 1 || 3
+
| Storage || || 3 || || 3
 
|-
 
|-
| System || || 6 || 6 || 12
+
| System || || 12 || || 12
 
|-
 
|-
| System Inventory || || 3 || 6 || 9
+
| System Inventory || 1 || 7 || || 8
 
|-
 
|-
| Grand Total || 1 || 50 || 54 || 105
+
| Grand Total || 2 || 101 || || 103
 
|}
 
|}
  
=== Multinode local storage Bare metal ===
+
=== Multinode local storage Bare metal - complete ===
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
|-
 
|-
| Backup and restore || || 3 || 2 || 5
+
| Backup and restore || || 5 || || 5
 
|-
 
|-
 
| Fault Management || 1 || 10 || || 11
 
| Fault Management || 1 || 10 || || 11
Line 177: Line 198:
 
| Heat || || 3 || || 3
 
| Heat || || 3 || || 3
 
|-
 
|-
| High Availability || || 2 || 7 || 9
+
| High Availability || 1 || 8 || || 9
 
|-
 
|-
 
| Horizon || || 2 || || 2
 
| Horizon || || 2 || || 2
 
|-
 
|-
| Installation and Config || || 2 || 1 || 3
+
| Installation and Config || || 3 || || 3
 
|-
 
|-
| Maintenance || || 6 || 5 || 11
+
| Maintenance || || 11  || || 11
 
|-
 
|-
| Networking || || || 16 || 16
+
| Networking || || 16 || || 16
 
|-
 
|-
| Nova || || 5 || 14 || 19
+
| Nova || || 19 || || 19
 
|-
 
|-
| Security || || 8 || 1 || 9
+
| Security || || 9 || || 9
 
|-
 
|-
| Simplex || || || 1 || 1
+
| Simplex || || 1 || || 1
 
|-
 
|-
| Storage || || 1 || 3 || 4
+
| Storage || 1 || 3 || || 4
 
|-
 
|-
| System || || 5 || 9 || 14
+
| System || || 15 || || 15
 
|-
 
|-
| System Inventory || || 4 || 7 || 11
+
| System Inventory || 2 || 8 || || 10
 
|-
 
|-
| Grand Total || 1 || 51 || 66 || 118
+
| Grand Total || 5 || 113  ||   || 118
 
|}
 
|}
  
=== Multinode local storage virtual ===
+
=== Multinode local storage virtual - complete ===
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
|-
 
|-
| Backup and restore || || 3 || 2 || 5
+
| Backup and restore || || 5 || || 5
 
|-
 
|-
 
| Fault Management || 1 || 11 || || 12
 
| Fault Management || 1 || 11 || || 12
 
|-
 
|-
| Heat || || || 3 || 3
+
| Heat || || 3 || || 3
 
|-
 
|-
| High Availability || 1 || 4 || 4 || 9
+
| High Availability || || 9 || || 9
 
|-
 
|-
 
| Horizon || || 5 || || 5
 
| Horizon || || 5 || || 5
 
|-
 
|-
| Installation and Config || || || 3 || 3
+
| Installation and Config || || 3 || || 3
 
|-
 
|-
| Maintenance || 2 || 10 || 1 || 13
+
| Maintenance || || 14 || || 14
 
|-
 
|-
| Networking || || || 16 || 16
+
| Networking || 3 || 12 || || 15
 
|-
 
|-
| Nova || || 2 || 14 || 16
+
| Nova || || 20 || || 20
 
|-
 
|-
| Security || || || 8 || 8
+
| Security || || 9 || || 9
 
|-
 
|-
 
| Simplex || || 1 || || 1
 
| Simplex || || 1 || || 1
 
|-
 
|-
| Storage || || 1 || 2 || 3
+
| Storage || 1 || 3 || || 4
 
|-
 
|-
 
| System || || 14 || || 14
 
| System || || 14 || || 14
 
|-
 
|-
| System Inventory || || 6 || 4 || 10
+
| System Inventory || 1 || 9 || || 10
 
|-
 
|-
| Grand Total || 4 || 57 || 57 || 118
+
| Grand Total || 6 || 118        ||   || 124
 
|}
 
|}
  
=== Multinode external storage Bare metal ===
+
=== Multinode external storage Bare metal - complete ===
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
|-
 
|-
| Backup and restore || || 3 || 2 || 5
+
| Backup and restore || || 5 ||   || 5
 
|-
 
|-
| Fault Management || || 6 || 5 || 11
+
| Fault Management || 1 || 10 || || 11
 
|-
 
|-
| Heat || || || 3 || 3
+
| Heat || || 3 || || 3
 
|-
 
|-
| High Availability || || 5 || 4 || 9
+
| High Availability || || 9 || || 9
 
|-
 
|-
| Horizon || || || 5 || 5
+
| Horizon || || 5 || || 5
 
|-
 
|-
| Installation and Config || || || 3 || 3
+
| Installation and Config || || 3 || || 3
 
|-
 
|-
| Maintenance || || || 14 || 14
+
| Maintenance || || 14 || || 14
 
|-
 
|-
| Networking || || || 16 || 16
+
| Networking || || 15 || || 15
 
|-
 
|-
| Nova || || || 14 || 14
+
| Nova || || 14 || || 14
 
|-
 
|-
| Security || || || 8 || 8
+
| Security || || 8 || || 8
 
|-
 
|-
| Simplex || || || 1 || 1
+
| Simplex || || 1 || || 1
 
|-
 
|-
| Storage || || 2 || 2 || 4
+
| Storage ||   || 3 || || 3
 
|-
 
|-
| System || || 4 || 11 || 15
+
| System || || 15  || || 15
 
|-
 
|-
| System Inventory || || || 9 || 9
+
| System Inventory || 2 || 7 || || 9
 
|-
 
|-
| Grand Total || || 20 || 97 || 117
+
| Grand Total || 3 || 112 || || 115
 
|}
 
|}
  
=== Multinode external storage virtual ===
+
=== Multinode external storage virtual - complete ===
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
! DOMAIN !! BLOCKED  !! FAIL !! PASS !! Pending !! Grand Total
+
! DOMAIN !! FAIL !! PASS !! Pending !! Grand Total
 
|-
 
|-
| Backup and restore ||   || || 3 || 2 || 5
+
| Backup and restore ||   2 || 3 || || 5
 
|-
 
|-
| Fault Management ||   || 1 || 4 || 6 || 11
+
| Fault Management ||   1 || 10 || || 11
 
|-
 
|-
| Heat ||   || || || 3 || 3
+
| Heat ||   || 3 || || 3
 
|-
 
|-
| High Availability ||   || || 3 || 6 || 9
+
| High Availability ||   1 || 8 || || 9
 
|-
 
|-
| Horizon ||   || || || 2 || 2
+
| Horizon ||   || 2 || || 2
 
|-
 
|-
| Installation and Config ||   || || || 3 || 3
+
| Installation and Config ||   || 3 || || 3
 
|-
 
|-
| Maintenance ||   || || 12 || 1 || 13
+
| Maintenance ||   || 13 || || 13
 
|-
 
|-
| Networking ||   || || || 16 || 16
+
| Networking ||   1 || 14 || || 15
 
|-
 
|-
| Nova ||   || || || 18 || 18
+
| Nova ||   1 || 17 ||   || 18
 
|-
 
|-
| Security ||   || || 3 || 5 || 8
+
| Security ||   || 8 || || 8
 
|-
 
|-
| Simplex ||   || || || 1 || 1
+
| Simplex ||   || 1 || || 1
 
|-
 
|-
| Storage ||   || 1 || 3 || 1 || 5
+
| Storage ||   || 4 || || 4
 
|-
 
|-
| System ||   11  || || 4 || || 15
+
| System ||     || 15 || || 15
 
|-
 
|-
| System Inventory ||    || || || 12 || 12
+
| System Inventory ||    2 || 9 ||   || 11
 
|-
 
|-
| Grand Total ||   11  || 2 || 32 || 76 || 121
+
| Grand Total ||     8 || 110 || || 118
 
|}
 
|}

Latest revision as of 00:08, 24 October 2018

October Release Testing Progress

Last update: 10/23/2018

Launchpads

ID Title Reproduced on Comments
https://bugs.launchpad.net/starlingx/+bug/1796420 Simplex Bare-Metal : Nova-compute with Status=disable and State=down/degraded Simplex Bare metal, simplex virtual DPDK patch
https://bugs.launchpad.net/starlingx/+bug/1796751 Inactive controller stays in booting after mgmtnetwork down Duplex bare metal, duplex virtual, multinode local storage virtual Incorrect network configuration (infrastructure), not an issue
https://bugs.launchpad.net/starlingx/+bug/1797234 Instance/VM Console is not opened, Horizon is getting back with Network Error (tcp_error) Multinode external storage virtual Might be a configuration issue, deeper debug required
https://bugs.launchpad.net/starlingx/+bug/1797217 namespace is not reasgined on swact Duplex baremetal Not an issue, expected behavior described in the bug is incorrect.
https://bugs.launchpad.net/starlingx/+bug/1797474 Simplex-Virtual, Nova-compute with Status=disable and State=down/degraded Simplex Virtual Duplicated - https://bugs.launchpad.net/starlingx/+bug/1796380
https://bugs.launchpad.net/starlingx/+bug/1797422 Admin credentials are setup on both controllers after swact Duplex bare metal, Multinode bare metal Expected behavior. Not an issue (maybe security)?
https://bugs.launchpad.net/starlingx/+bug/1797961 MemPageSIze can be empty on a flavor Duplex bare metal Upstream nova behavior. "The way the code is written, an empty value here is equivalent to not specifying a pagesize at all."
https://bugs.launchpad.net/starlingx/+bug/1798442 Changing MTU value on Data network causes reboot cycling Multinode local storage bare metal, multinode external storage bare metal, duplex bare metal Deferred to march release
https://bugs.launchpad.net/starlingx/+bug/1798631 Killing glance.api.pid process is not creating any kind of fm alarm-list Multinode external storage virtual Issue not reproducible in bare metal. Deferred to march release
https://bugs.launchpad.net/starlingx/+bug/1798994 Volume snapshot created from a cirros image can not be deleted with cli Multinode external storage virtual "If this is standard openstack behavior, we may choose not to change it. Further investigation is required." - deferred to March release
https://bugs.launchpad.net/starlingx/+bug/1799271 error on system restore attempt Duplex bare metal "Only fails on duplex bare metal setup. Might be setup specific". Assigned for deeper debug
https://bugs.launchpad.net/starlingx/+bug/1799312 Cannot launch an instance with local storage Multinode local storage bare metal, multinode local storage virtual Assigned for deeper debug, deferred to march release
https://bugs.launchpad.net/starlingx/+bug/1799517 "hw:mem_page_size=1GB" Metadata can not be assigned to a flavors with cli commands Multinode external storage virtual will try to reproduce with latest ISO
https://bugs.launchpad.net/starlingx/+bug/1799539 1G hugepages for memory allocation is not enable in Virtual external storage config Multinode external storage virtual will try to reproduce with latest ISO
https://bugs.launchpad.net/starlingx/+bug/1799590 Process 'neutron-l3-agent' does not work Multinode with local storage virtual
https://bugs.launchpad.net/starlingx/+bug/1799591 $ ip netns does not display anything Multinode with local storage virtual

Simplex Bare metal - complete

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 5 5
Fault Management 1 8 9
Heat 3 3
High Availability 3 3
Horizon 2 2
Installation and Config 1 1
Maintenance 4 4
Networking 7 7
Nova 15 15
Security 7 7
Simplex 4 4
Storage 3 3
System 6 6
System Inventory 1 6 7
Grand Total 2 74 76

Simplex Virtual

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 5 5
Fault Management 1 5 2 8
Heat 3 3
High Availability 3 3
Horizon 4 4
Installation and Config 1 1
Maintenance 3 3
Networking 2 6 8
Nova 11 11
Security 7 7
Simplex 4 4
Storage 2 2
System 6 6
System Inventory 1 1 2
Grand Total 1 29 37 67

Duplex Bare metal - complete

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 2 3 5
Fault Management 1 10 11
Heat 3 3
High Availability 6 6
Horizon 5 5
Installation and Config 2 2
Maintenance 7 7
Networking 15 15
Nova 15 15
Security 8 8
Simplex 1 1
Storage 2 2
System 12 12
System Inventory 2 4 6
Grand Total 5 93 98

Duplex Virtual - complete

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 5 5
Fault Management 1 10 11
Heat 3 3
High Availability 6 6
Horizon 2 2
Installation and Config 3 3
Maintenance 7 7
Networking 15 15
Nova 19 19
Security 8 8
Simplex 1 1
Storage 3 3
System 12 12
System Inventory 1 7 8
Grand Total 2 101 103

Multinode local storage Bare metal - complete

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 5 5
Fault Management 1 10 11
Heat 3 3
High Availability 1 8 9
Horizon 2 2
Installation and Config 3 3
Maintenance 11 11
Networking 16 16
Nova 19 19
Security 9 9
Simplex 1 1
Storage 1 3 4
System 15 15
System Inventory 2 8 10
Grand Total 5 113 118

Multinode local storage virtual - complete

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 5 5
Fault Management 1 11 12
Heat 3 3
High Availability 9 9
Horizon 5 5
Installation and Config 3 3
Maintenance 14 14
Networking 3 12 15
Nova 20 20
Security 9 9
Simplex 1 1
Storage 1 3 4
System 14 14
System Inventory 1 9 10
Grand Total 6 118 124

Multinode external storage Bare metal - complete

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 5 5
Fault Management 1 10 11
Heat 3 3
High Availability 9 9
Horizon 5 5
Installation and Config 3 3
Maintenance 14 14
Networking 15 15
Nova 14 14
Security 8 8
Simplex 1 1
Storage 3 3
System 15 15
System Inventory 2 7 9
Grand Total 3 112 115

Multinode external storage virtual - complete

DOMAIN FAIL PASS Pending Grand Total
Backup and restore 2 3 5
Fault Management 1 10 11
Heat 3 3
High Availability 1 8 9
Horizon 2 2
Installation and Config 3 3
Maintenance 13 13
Networking 1 14 15
Nova 1 17 18
Security 8 8
Simplex 1 1
Storage 4 4
System 15 15
System Inventory 2 9 11
Grand Total 8 110 118