Jump to: navigation, search

Difference between revisions of "StarlingX/stx.2018.10 WR TestStatus"

(→‎Sanity Results)
(→‎Manual Regression)
 
(13 intermediate revisions by the same user not shown)
Line 2: Line 2:
 
=== Sanity Results ===
 
=== Sanity Results ===
 
* All-in-one Simplex
 
* All-in-one Simplex
−
** Build-ID: 2018-10-09_01-52-01
+
** Build-ID: 2018-10-22_01-52-00
 
** Results: Total: 11, Passed: 11, Failed: 0
 
** Results: Total: 11, Passed: 11, Failed: 0
 
** Bugs:
 
** Bugs:
 
*** None
 
*** None
 
* All-in-one Duplex
 
* All-in-one Duplex
−
** Build-ID: 2018-10-08_01-52-01
+
** Build-ID: 2018-10-21_01-52-00
 
** Results: Total: 15, Passed: 15, Failed: 0
 
** Results: Total: 15, Passed: 15, Failed: 0
 
** Bugs:
 
** Bugs:
 
*** None
 
*** None
 
* Multi-node  
 
* Multi-node  
−
** Build-ID: 2018-10-08_01-52-01
+
** Build-ID: 2018-10-21_01-52-00
 
** Results: Total: 23, Passed: 23, Failed: 0
 
** Results: Total: 23, Passed: 23, Failed: 0
 
** Bugs:
 
** Bugs:
 
*** None
 
*** None
 
* Multi-node with ceph
 
* Multi-node with ceph
−
** Build-ID: 2018-10-09_01-52-01
+
** Build-ID: 2018-10-22_01-52-00
 
** Results: Total: 24, Passed: 24, Failed: 0
 
** Results: Total: 24, Passed: 24, Failed: 0
 
** Bugs:
 
** Bugs:
Line 23: Line 23:
  
 
=== Automated Regression ===
 
=== Automated Regression ===
 +
Build Used: 2018-10-19_01-52-00
 +
 +
{| class="wikitable"
 +
|-
 +
! Domains !! Passed !! Failed !! Total Executed !! Comments
 +
|-
 +
| Heat || 30 || 0 || 30 || None
 +
|-
 +
| Horizon || 57 || 0 || 57 || None
 +
|-
 +
| MTC General || 92 || 0 || 92 || None
 +
|-
 +
| MTC Process Monitoring || 66 || 0 || 66 || None
 +
|-
 +
| Networking || 96 || 2 || 98 || https://bugs.launchpad.net/starlingx/+bug/1790968
 +
|-
 +
| Nova || 454 || 6 || 460 || https://bugs.launchpad.net/starlingx/+bug/1797948
 +
https://bugs.launchpad.net/starlingx/+bug/1794366
 +
https://bugs.launchpad.net/starlingx/+bug/1792999
 +
https://bugs.launchpad.net/starlingx/+bug/1791685
 +
|-
 +
| REST API || 229 || 1 || 230 || https://bugs.launchpad.net/starlingx/+bug/1789979
 +
|-
 +
| Security || 47 || 37 || 84 || https://bugs.launchpad.net/starlingx/+bug/1798892
 +
|-
 +
| Storage || 79 || 0 || 79 || None
 +
|-
 +
| Sysinv || 21 || 2 || 23 || https://bugs.launchpad.net/starlingx/+bug/1792418
 +
|-
 +
| Total || 1171 || 48 || 1219 || Pass Rate = 96.0%
 +
|-
 +
|}
  
 
=== Manual Regression ===
 
=== Manual Regression ===
Line 29: Line 61:
 
! Domains !! Total Test Cases !! Passed !! Failed !! Total Executed !! Launchpad
 
! Domains !! Total Test Cases !! Passed !! Failed !! Total Executed !! Launchpad
 
|-
 
|-
−
| Backup and Restore || 4 || 0 || 1 || 1 || https://bugs.launchpad.net/starlingx/+bug/1796404
+
| Backup and Restore || 4 || 3 || 1 || 4 || https://bugs.launchpad.net/starlingx/+bug/1790968
 
|-
 
|-
−
| Distributed Cloud || 30 || 12 || 0 || 12 || None
+
| Distributed Cloud || 30 || 22 || 8 || 30 || https://bugs.launchpad.net/starlingx/+bug/1797960
 
|-
 
|-
−
| Installation and Config || 5 || 0 || 0 || 0 || None
+
| Installation and Config || 5 || 3 || 2 || 5 || https://bugs.launchpad.net/starlingx/+bug/1797187
 +
https://bugs.launchpad.net/starlingx/+bug/1797608
 
|-
 
|-
−
| Maintenance || 19 || 19 || 0 || 19 || None
+
| Maintenance || 20 || 20 || 0 || 20 || None
 
|-
 
|-
−
| Networking || 29 || 4 || 3 || 7 || https://bugs.launchpad.net/starlingx/+bug/1796198 
+
| Networking || 22 || 19 || 3 || 22 || https://bugs.launchpad.net/starlingx/+bug/1790968
−
https://bugs.launchpad.net/starlingx/+bug/1790968
+
https://bugs.launchpad.net/starlingx/+bug/1798200
 
|-
 
|-
−
| Nova || 35 || 9 || 3 || 12 || https://bugs.launchpad.net/starlingx/+bug/1796393
+
| Nova || 34 || 24 || 10 || 34 || https://bugs.launchpad.net/starlingx/+bug/1796393
 +
https://bugs.launchpad.net/starlingx/+bug/1791381
 +
https://bugs.launchpad.net/starlingx/+bug/1796952
 
|-
 
|-
−
| Security || 17 || 3 || 0 || 3 || None
+
| Security || 17 || 15 || 2 || 17 || https://bugs.launchpad.net/starlingx/+bug/1797204
 +
https://bugs.launchpad.net/starlingx/+bug/1797219
 
|-
 
|-
−
| Storage || 11 || 1 || 2 || 3 || https://bugs.launchpad.net/starlingx/+bug/1795962  
+
| Storage || 11 || 5 || 5 || 10 || https://bugs.launchpad.net/starlingx/+bug/1795962  
 +
https://bugs.launchpad.net/starlingx/+bug/1796913
 +
https://bugs.launchpad.net/starlingx/+bug/1797151
 +
https://bugs.launchpad.net/starlingx/+bug/1797391
 +
https://bugs.launchpad.net/starlingx/+bug/1797626
 
|-
 
|-
−
| System Inventory || 8 || 6 || 0 || 6 || None
+
| System Inventory || 8 || 7 || 1 || 8 || https://bugs.launchpad.net/starlingx/+bug/1797187
 
|-
 
|-
−
| System Test || 11 || 4 || 0 || 4 || None
+
| System Test || 10 || 8 || 2 || 10 || https://bugs.launchpad.net/starlingx/+bug/1798096
 
|-
 
|-
−
| Total || 169 || 57 || 10 || 67 || None
+
| Total || 161 || 126 || 34 || 160 || None
 
|}
 
|}

Latest revision as of 21:06, 23 October 2018

Sanity Results

  • All-in-one Simplex
    • Build-ID: 2018-10-22_01-52-00
    • Results: Total: 11, Passed: 11, Failed: 0
    • Bugs:
      • None
  • All-in-one Duplex
    • Build-ID: 2018-10-21_01-52-00
    • Results: Total: 15, Passed: 15, Failed: 0
    • Bugs:
      • None
  • Multi-node
    • Build-ID: 2018-10-21_01-52-00
    • Results: Total: 23, Passed: 23, Failed: 0
    • Bugs:
      • None
  • Multi-node with ceph
    • Build-ID: 2018-10-22_01-52-00
    • Results: Total: 24, Passed: 24, Failed: 0
    • Bugs:
      • None

Automated Regression

Build Used: 2018-10-19_01-52-00

Domains Passed Failed Total Executed Comments
Heat 30 0 30 None
Horizon 57 0 57 None
MTC General 92 0 92 None
MTC Process Monitoring 66 0 66 None
Networking 96 2 98 https://bugs.launchpad.net/starlingx/+bug/1790968
Nova 454 6 460 https://bugs.launchpad.net/starlingx/+bug/1797948

https://bugs.launchpad.net/starlingx/+bug/1794366 https://bugs.launchpad.net/starlingx/+bug/1792999 https://bugs.launchpad.net/starlingx/+bug/1791685

REST API 229 1 230 https://bugs.launchpad.net/starlingx/+bug/1789979
Security 47 37 84 https://bugs.launchpad.net/starlingx/+bug/1798892
Storage 79 0 79 None
Sysinv 21 2 23 https://bugs.launchpad.net/starlingx/+bug/1792418
Total 1171 48 1219 Pass Rate = 96.0%

Manual Regression

Domains Total Test Cases Passed Failed Total Executed Launchpad
Backup and Restore 4 3 1 4 https://bugs.launchpad.net/starlingx/+bug/1790968
Distributed Cloud 30 22 8 30 https://bugs.launchpad.net/starlingx/+bug/1797960
Installation and Config 5 3 2 5 https://bugs.launchpad.net/starlingx/+bug/1797187

https://bugs.launchpad.net/starlingx/+bug/1797608

Maintenance 20 20 0 20 None
Networking 22 19 3 22 https://bugs.launchpad.net/starlingx/+bug/1790968

https://bugs.launchpad.net/starlingx/+bug/1798200

Nova 34 24 10 34 https://bugs.launchpad.net/starlingx/+bug/1796393

https://bugs.launchpad.net/starlingx/+bug/1791381 https://bugs.launchpad.net/starlingx/+bug/1796952

Security 17 15 2 17 https://bugs.launchpad.net/starlingx/+bug/1797204

https://bugs.launchpad.net/starlingx/+bug/1797219

Storage 11 5 5 10 https://bugs.launchpad.net/starlingx/+bug/1795962

https://bugs.launchpad.net/starlingx/+bug/1796913 https://bugs.launchpad.net/starlingx/+bug/1797151 https://bugs.launchpad.net/starlingx/+bug/1797391 https://bugs.launchpad.net/starlingx/+bug/1797626

System Inventory 8 7 1 8 https://bugs.launchpad.net/starlingx/+bug/1797187
System Test 10 8 2 10 https://bugs.launchpad.net/starlingx/+bug/1798096
Total 161 126 34 160 None
Retrieved from "https://wiki.openstack.org/w/index.php?title=StarlingX/stx.2018.10_WR_TestStatus&oldid=166232"