Difference between revisions of "StarlingX/stx.2018.10 WR TestStatus"
Numan.waheed (talk | contribs) (→Manual Regression) |
Numan.waheed (talk | contribs) (→Manual Regression) |
||
(17 intermediate revisions by the same user not shown) | |||
Line 2: | Line 2: | ||
=== Sanity Results === | === Sanity Results === | ||
* All-in-one Simplex | * All-in-one Simplex | ||
− | ** Build-ID: 2018-10- | + | ** Build-ID: 2018-10-22_01-52-00 |
** Results: Total: 11, Passed: 11, Failed: 0 | ** Results: Total: 11, Passed: 11, Failed: 0 | ||
** Bugs: | ** Bugs: | ||
*** None | *** None | ||
* All-in-one Duplex | * All-in-one Duplex | ||
− | ** Build-ID: 2018-10- | + | ** Build-ID: 2018-10-21_01-52-00 |
** Results: Total: 15, Passed: 15, Failed: 0 | ** Results: Total: 15, Passed: 15, Failed: 0 | ||
** Bugs: | ** Bugs: | ||
*** None | *** None | ||
* Multi-node | * Multi-node | ||
− | ** Build-ID: 2018-10- | + | ** Build-ID: 2018-10-21_01-52-00 |
** Results: Total: 23, Passed: 23, Failed: 0 | ** Results: Total: 23, Passed: 23, Failed: 0 | ||
** Bugs: | ** Bugs: | ||
*** None | *** None | ||
* Multi-node with ceph | * Multi-node with ceph | ||
− | ** Build-ID: 2018-10- | + | ** Build-ID: 2018-10-22_01-52-00 |
** Results: Total: 24, Passed: 24, Failed: 0 | ** Results: Total: 24, Passed: 24, Failed: 0 | ||
** Bugs: | ** Bugs: | ||
Line 23: | Line 23: | ||
=== Automated Regression === | === Automated Regression === | ||
+ | Build Used: 2018-10-19_01-52-00 | ||
+ | |||
+ | {| class="wikitable" | ||
+ | |- | ||
+ | ! Domains !! Passed !! Failed !! Total Executed !! Comments | ||
+ | |- | ||
+ | | Heat || 30 || 0 || 30 || None | ||
+ | |- | ||
+ | | Horizon || 57 || 0 || 57 || None | ||
+ | |- | ||
+ | | MTC General || 92 || 0 || 92 || None | ||
+ | |- | ||
+ | | MTC Process Monitoring || 66 || 0 || 66 || None | ||
+ | |- | ||
+ | | Networking || 96 || 2 || 98 || https://bugs.launchpad.net/starlingx/+bug/1790968 | ||
+ | |- | ||
+ | | Nova || 454 || 6 || 460 || https://bugs.launchpad.net/starlingx/+bug/1797948 | ||
+ | https://bugs.launchpad.net/starlingx/+bug/1794366 | ||
+ | https://bugs.launchpad.net/starlingx/+bug/1792999 | ||
+ | https://bugs.launchpad.net/starlingx/+bug/1791685 | ||
+ | |- | ||
+ | | REST API || 229 || 1 || 230 || https://bugs.launchpad.net/starlingx/+bug/1789979 | ||
+ | |- | ||
+ | | Security || 47 || 37 || 84 || https://bugs.launchpad.net/starlingx/+bug/1798892 | ||
+ | |- | ||
+ | | Storage || 79 || 0 || 79 || None | ||
+ | |- | ||
+ | | Sysinv || 21 || 2 || 23 || https://bugs.launchpad.net/starlingx/+bug/1792418 | ||
+ | |- | ||
+ | | Total || 1171 || 48 || 1219 || Pass Rate = 96.0% | ||
+ | |- | ||
+ | |} | ||
=== Manual Regression === | === Manual Regression === | ||
Line 29: | Line 61: | ||
! Domains !! Total Test Cases !! Passed !! Failed !! Total Executed !! Launchpad | ! Domains !! Total Test Cases !! Passed !! Failed !! Total Executed !! Launchpad | ||
|- | |- | ||
− | | Backup and Restore || | + | | Backup and Restore || 4 || 3 || 1 || 4 || https://bugs.launchpad.net/starlingx/+bug/1790968 |
|- | |- | ||
− | | Distributed Cloud || 30 || | + | | Distributed Cloud || 30 || 22 || 8 || 30 || https://bugs.launchpad.net/starlingx/+bug/1797960 |
|- | |- | ||
− | | Installation and Config || 5 || | + | | Installation and Config || 5 || 3 || 2 || 5 || https://bugs.launchpad.net/starlingx/+bug/1797187 |
+ | https://bugs.launchpad.net/starlingx/+bug/1797608 | ||
|- | |- | ||
− | | Maintenance || 20 || | + | | Maintenance || 20 || 20 || 0 || 20 || None |
|- | |- | ||
− | | Networking || | + | | Networking || 22 || 19 || 3 || 22 || https://bugs.launchpad.net/starlingx/+bug/1790968 |
− | https://bugs.launchpad.net/starlingx/+bug/ | + | https://bugs.launchpad.net/starlingx/+bug/1798200 |
|- | |- | ||
− | | Nova || | + | | Nova || 34 || 24 || 10 || 34 || https://bugs.launchpad.net/starlingx/+bug/1796393 |
+ | https://bugs.launchpad.net/starlingx/+bug/1791381 | ||
+ | https://bugs.launchpad.net/starlingx/+bug/1796952 | ||
|- | |- | ||
− | | Security || 17 || | + | | Security || 17 || 15 || 2 || 17 || https://bugs.launchpad.net/starlingx/+bug/1797204 |
+ | https://bugs.launchpad.net/starlingx/+bug/1797219 | ||
|- | |- | ||
− | | Storage || 11 || | + | | Storage || 11 || 5 || 5 || 10 || https://bugs.launchpad.net/starlingx/+bug/1795962 |
+ | https://bugs.launchpad.net/starlingx/+bug/1796913 | ||
+ | https://bugs.launchpad.net/starlingx/+bug/1797151 | ||
+ | https://bugs.launchpad.net/starlingx/+bug/1797391 | ||
+ | https://bugs.launchpad.net/starlingx/+bug/1797626 | ||
|- | |- | ||
− | | System Inventory || 8 || | + | | System Inventory || 8 || 7 || 1 || 8 || https://bugs.launchpad.net/starlingx/+bug/1797187 |
|- | |- | ||
− | | System Test || | + | | System Test || 10 || 8 || 2 || 10 || https://bugs.launchpad.net/starlingx/+bug/1798096 |
|- | |- | ||
− | | Total || | + | | Total || 161 || 126 || 34 || 160 || None |
|} | |} |
Latest revision as of 21:06, 23 October 2018
Sanity Results
- All-in-one Simplex
- Build-ID: 2018-10-22_01-52-00
- Results: Total: 11, Passed: 11, Failed: 0
- Bugs:
- None
- All-in-one Duplex
- Build-ID: 2018-10-21_01-52-00
- Results: Total: 15, Passed: 15, Failed: 0
- Bugs:
- None
- Multi-node
- Build-ID: 2018-10-21_01-52-00
- Results: Total: 23, Passed: 23, Failed: 0
- Bugs:
- None
- Multi-node with ceph
- Build-ID: 2018-10-22_01-52-00
- Results: Total: 24, Passed: 24, Failed: 0
- Bugs:
- None
Automated Regression
Build Used: 2018-10-19_01-52-00
Domains | Passed | Failed | Total Executed | Comments |
---|---|---|---|---|
Heat | 30 | 0 | 30 | None |
Horizon | 57 | 0 | 57 | None |
MTC General | 92 | 0 | 92 | None |
MTC Process Monitoring | 66 | 0 | 66 | None |
Networking | 96 | 2 | 98 | https://bugs.launchpad.net/starlingx/+bug/1790968 |
Nova | 454 | 6 | 460 | https://bugs.launchpad.net/starlingx/+bug/1797948
https://bugs.launchpad.net/starlingx/+bug/1794366 https://bugs.launchpad.net/starlingx/+bug/1792999 https://bugs.launchpad.net/starlingx/+bug/1791685 |
REST API | 229 | 1 | 230 | https://bugs.launchpad.net/starlingx/+bug/1789979 |
Security | 47 | 37 | 84 | https://bugs.launchpad.net/starlingx/+bug/1798892 |
Storage | 79 | 0 | 79 | None |
Sysinv | 21 | 2 | 23 | https://bugs.launchpad.net/starlingx/+bug/1792418 |
Total | 1171 | 48 | 1219 | Pass Rate = 96.0% |