Difference between revisions of "StarlingX/stx.2018.10 WR TestStatus"
Numan.waheed (talk | contribs) (→Automated Regression) |
Numan.waheed (talk | contribs) (→Manual Regression) |
||
| (9 intermediate revisions by the same user not shown) | |||
| Line 2: | Line 2: | ||
=== Sanity Results === | === Sanity Results === | ||
* All-in-one Simplex | * All-in-one Simplex | ||
| − | ** Build-ID: 2018-10- | + | ** Build-ID: 2018-10-22_01-52-00 |
** Results: Total: 11, Passed: 11, Failed: 0 | ** Results: Total: 11, Passed: 11, Failed: 0 | ||
** Bugs: | ** Bugs: | ||
*** None | *** None | ||
* All-in-one Duplex | * All-in-one Duplex | ||
| − | ** Build-ID: 2018-10- | + | ** Build-ID: 2018-10-21_01-52-00 |
** Results: Total: 15, Passed: 15, Failed: 0 | ** Results: Total: 15, Passed: 15, Failed: 0 | ||
** Bugs: | ** Bugs: | ||
*** None | *** None | ||
* Multi-node | * Multi-node | ||
| − | ** Build-ID: 2018-10- | + | ** Build-ID: 2018-10-21_01-52-00 |
** Results: Total: 23, Passed: 23, Failed: 0 | ** Results: Total: 23, Passed: 23, Failed: 0 | ||
** Bugs: | ** Bugs: | ||
*** None | *** None | ||
* Multi-node with ceph | * Multi-node with ceph | ||
| − | ** Build-ID: 2018-10- | + | ** Build-ID: 2018-10-22_01-52-00 |
** Results: Total: 24, Passed: 24, Failed: 0 | ** Results: Total: 24, Passed: 24, Failed: 0 | ||
** Bugs: | ** Bugs: | ||
*** None | *** None | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
=== Automated Regression === | === Automated Regression === | ||
| − | Build Used: 2018-10- | + | Build Used: 2018-10-19_01-52-00 |
{| class="wikitable" | {| class="wikitable" | ||
| Line 66: | Line 33: | ||
| Horizon || 57 || 0 || 57 || None | | Horizon || 57 || 0 || 57 || None | ||
|- | |- | ||
| − | | MTC General || | + | | MTC General || 92 || 0 || 92 || None |
|- | |- | ||
| MTC Process Monitoring || 66 || 0 || 66 || None | | MTC Process Monitoring || 66 || 0 || 66 || None | ||
|- | |- | ||
| − | | Networking || | + | | Networking || 96 || 2 || 98 || https://bugs.launchpad.net/starlingx/+bug/1790968 |
| − | |||
|- | |- | ||
| − | | Nova || | + | | Nova || 454 || 6 || 460 || https://bugs.launchpad.net/starlingx/+bug/1797948 |
| − | https://bugs.launchpad.net/starlingx/+bug/ | + | https://bugs.launchpad.net/starlingx/+bug/1794366 |
https://bugs.launchpad.net/starlingx/+bug/1792999 | https://bugs.launchpad.net/starlingx/+bug/1792999 | ||
| + | https://bugs.launchpad.net/starlingx/+bug/1791685 | ||
|- | |- | ||
| REST API || 229 || 1 || 230 || https://bugs.launchpad.net/starlingx/+bug/1789979 | | REST API || 229 || 1 || 230 || https://bugs.launchpad.net/starlingx/+bug/1789979 | ||
|- | |- | ||
| − | | Security || | + | | Security || 47 || 37 || 84 || https://bugs.launchpad.net/starlingx/+bug/1798892 |
|- | |- | ||
| − | | Storage || | + | | Storage || 79 || 0 || 79 || None |
|- | |- | ||
| − | | Sysinv || | + | | Sysinv || 21 || 2 || 23 || https://bugs.launchpad.net/starlingx/+bug/1792418 |
|- | |- | ||
| − | | Total || | + | | Total || 1171 || 48 || 1219 || Pass Rate = 96.0% |
|- | |- | ||
|} | |} | ||
| Line 94: | Line 61: | ||
! Domains !! Total Test Cases !! Passed !! Failed !! Total Executed !! Launchpad | ! Domains !! Total Test Cases !! Passed !! Failed !! Total Executed !! Launchpad | ||
|- | |- | ||
| − | | Backup and Restore || 4 || 3 || 1 || 4 || https://bugs.launchpad.net/starlingx/+bug/ | + | | Backup and Restore || 4 || 3 || 1 || 4 || https://bugs.launchpad.net/starlingx/+bug/1790968 |
|- | |- | ||
| − | | Distributed Cloud || 30 || | + | | Distributed Cloud || 30 || 22 || 8 || 30 || https://bugs.launchpad.net/starlingx/+bug/1797960 |
|- | |- | ||
| − | | Installation and Config || 5 || | + | | Installation and Config || 5 || 3 || 2 || 5 || https://bugs.launchpad.net/starlingx/+bug/1797187 |
| + | https://bugs.launchpad.net/starlingx/+bug/1797608 | ||
|- | |- | ||
| − | | Maintenance || | + | | Maintenance || 20 || 20 || 0 || 20 || None |
|- | |- | ||
| − | | Networking || | + | | Networking || 22 || 19 || 3 || 22 || https://bugs.launchpad.net/starlingx/+bug/1790968 |
| − | https://bugs.launchpad.net/starlingx/+bug/ | + | https://bugs.launchpad.net/starlingx/+bug/1798200 |
|- | |- | ||
| − | | Nova || | + | | Nova || 34 || 24 || 10 || 34 || https://bugs.launchpad.net/starlingx/+bug/1796393 |
| + | https://bugs.launchpad.net/starlingx/+bug/1791381 | ||
| + | https://bugs.launchpad.net/starlingx/+bug/1796952 | ||
|- | |- | ||
| − | | Security || 17 || | + | | Security || 17 || 15 || 2 || 17 || https://bugs.launchpad.net/starlingx/+bug/1797204 |
| + | https://bugs.launchpad.net/starlingx/+bug/1797219 | ||
|- | |- | ||
| − | | Storage || 11 || | + | | Storage || 11 || 5 || 5 || 10 || https://bugs.launchpad.net/starlingx/+bug/1795962 |
| − | https://bugs.launchpad.net/starlingx/+bug/1796913 | + | https://bugs.launchpad.net/starlingx/+bug/1796913 |
| + | https://bugs.launchpad.net/starlingx/+bug/1797151 | ||
| + | https://bugs.launchpad.net/starlingx/+bug/1797391 | ||
| + | https://bugs.launchpad.net/starlingx/+bug/1797626 | ||
|- | |- | ||
| − | | System Inventory || 8 || 7 || 1 || 8 || | + | | System Inventory || 8 || 7 || 1 || 8 || https://bugs.launchpad.net/starlingx/+bug/1797187 |
|- | |- | ||
| − | | System Test || | + | | System Test || 10 || 8 || 2 || 10 || https://bugs.launchpad.net/starlingx/+bug/1798096 |
|- | |- | ||
| − | | Total || | + | | Total || 161 || 126 || 34 || 160 || None |
|} | |} | ||
Latest revision as of 21:06, 23 October 2018
Sanity Results
- All-in-one Simplex
- Build-ID: 2018-10-22_01-52-00
- Results: Total: 11, Passed: 11, Failed: 0
- Bugs:
- None
- All-in-one Duplex
- Build-ID: 2018-10-21_01-52-00
- Results: Total: 15, Passed: 15, Failed: 0
- Bugs:
- None
- Multi-node
- Build-ID: 2018-10-21_01-52-00
- Results: Total: 23, Passed: 23, Failed: 0
- Bugs:
- None
- Multi-node with ceph
- Build-ID: 2018-10-22_01-52-00
- Results: Total: 24, Passed: 24, Failed: 0
- Bugs:
- None
Automated Regression
Build Used: 2018-10-19_01-52-00
| Domains | Passed | Failed | Total Executed | Comments |
|---|---|---|---|---|
| Heat | 30 | 0 | 30 | None |
| Horizon | 57 | 0 | 57 | None |
| MTC General | 92 | 0 | 92 | None |
| MTC Process Monitoring | 66 | 0 | 66 | None |
| Networking | 96 | 2 | 98 | https://bugs.launchpad.net/starlingx/+bug/1790968 |
| Nova | 454 | 6 | 460 | https://bugs.launchpad.net/starlingx/+bug/1797948
https://bugs.launchpad.net/starlingx/+bug/1794366 https://bugs.launchpad.net/starlingx/+bug/1792999 https://bugs.launchpad.net/starlingx/+bug/1791685 |
| REST API | 229 | 1 | 230 | https://bugs.launchpad.net/starlingx/+bug/1789979 |
| Security | 47 | 37 | 84 | https://bugs.launchpad.net/starlingx/+bug/1798892 |
| Storage | 79 | 0 | 79 | None |
| Sysinv | 21 | 2 | 23 | https://bugs.launchpad.net/starlingx/+bug/1792418 |
| Total | 1171 | 48 | 1219 | Pass Rate = 96.0% |
