Difference between revisions of "StarlingX/stx.2018.10 WR TestStatus"
Numan.waheed (talk | contribs) (→Sanity Results) |
Numan.waheed (talk | contribs) (→Manual Regression) |
||
Line 63: | Line 63: | ||
| Backup and Restore || 4 || 3 || 1 || 4 || https://bugs.launchpad.net/starlingx/+bug/1796404 | | Backup and Restore || 4 || 3 || 1 || 4 || https://bugs.launchpad.net/starlingx/+bug/1796404 | ||
|- | |- | ||
− | | Distributed Cloud || 30 || | + | | Distributed Cloud || 30 || 15 || 0 || 15 || None |
|- | |- | ||
− | | Installation and Config || 5 || | + | | Installation and Config || 5 || 3 || 2 || 5 || https://bugs.launchpad.net/starlingx/+bug/1797187 |
+ | https://bugs.launchpad.net/starlingx/+bug/1797608 | ||
|- | |- | ||
| Maintenance || 19 || 19 || 0 || 19 || None | | Maintenance || 19 || 19 || 0 || 19 || None | ||
|- | |- | ||
− | | Networking || | + | | Networking || 22 || 10 || 4 || 14 || https://bugs.launchpad.net/starlingx/+bug/1796198 |
https://bugs.launchpad.net/starlingx/+bug/1790968 | https://bugs.launchpad.net/starlingx/+bug/1790968 | ||
|- | |- | ||
− | | Nova || 35 || | + | | Nova || 35 || 15 || 6 || 21 || https://bugs.launchpad.net/starlingx/+bug/1796393 |
|- | |- | ||
− | | Security || 17 || | + | | Security || 17 || 8 || 3 || 11 || https://bugs.launchpad.net/starlingx/+bug/1797204 |
+ | https://bugs.launchpad.net/starlingx/+bug/1797219 | ||
+ | https://bugs.launchpad.net/starlingx/+bug/1797569 | ||
|- | |- | ||
− | | Storage || 11 || | + | | Storage || 11 || 4 || 5 || 9 || https://bugs.launchpad.net/starlingx/+bug/1795962 |
− | https://bugs.launchpad.net/starlingx/+bug/1796913 | + | https://bugs.launchpad.net/starlingx/+bug/1796913 |
+ | https://bugs.launchpad.net/starlingx/+bug/1797151 | ||
+ | https://bugs.launchpad.net/starlingx/+bug/1797391 | ||
|- | |- | ||
− | | System Inventory || 8 || 7 || 1 || 8 || | + | | System Inventory || 8 || 7 || 1 || 8 || https://bugs.launchpad.net/starlingx/+bug/1797187 |
|- | |- | ||
− | | System Test || | + | | System Test || 10 || 8 || 0 || 8 || None |
|- | |- | ||
− | | Total || | + | | Total || 161 || 92 || 22 || 114 || None |
|} | |} |
Revision as of 20:25, 12 October 2018
Sanity Results
- All-in-one Simplex
- Build-ID: 2018-10-10_01-52-00
- Results: Total: 11, Passed: 11, Failed: 0
- Bugs:
- None
- All-in-one Duplex
- Build-ID: 2018-10-12_01-52-00
- Results: Total: 15, Passed: 15, Failed: 0
- Bugs:
- None
- Multi-node
- Build-ID: 2018-10-08_01-52-01
- Results: Total: 23, Passed: 23, Failed: 0
- Bugs:
- None
- Multi-node with ceph
- Build-ID: 2018-10-10_01-52-00
- Results: Total: 24, Passed: 24, Failed: 0
- Bugs:
- None
Automated Regression
Build Used: 2018-10-05_01-52-00
Domains | Passed | Failed | Total Executed | Comments |
---|---|---|---|---|
Heat | 30 | 0 | 30 | None |
Horizon | 57 | 0 | 57 | None |
MTC General | 87 | 4 | 91 | None |
MTC Process Monitoring | 66 | 0 | 66 | None |
Networking | 80 | 24 | 104 | https://bugs.launchpad.net/starlingx/+bug/1790968 |
Nova | 447 | 11 | 458 | https://bugs.launchpad.net/starlingx/+bug/1791685
https://bugs.launchpad.net/starlingx/+bug/1792945 https://bugs.launchpad.net/starlingx/+bug/1792999 |
REST API | 229 | 1 | 230 | https://bugs.launchpad.net/starlingx/+bug/1789979 |
Security | 49 | 38 | 87 | https://bugs.launchpad.net/starlingx/+bug/1792418 |
Storage | 74 | 1 | 75 | https://bugs.launchpad.net/starlingx/+bug/1796912 |
Sysinv | 22 | 1 | 23 | https://bugs.launchpad.net/starlingx/+bug/1792418 |
Total | 1141 | 80 | 1221 | Pass Rate = 93.4%, Adjusted Pass Rate = 96.9% |
Manual Regression
Domains | Total Test Cases | Passed | Failed | Total Executed | Launchpad |
---|---|---|---|---|---|
Backup and Restore | 4 | 3 | 1 | 4 | https://bugs.launchpad.net/starlingx/+bug/1796404 |
Distributed Cloud | 30 | 15 | 0 | 15 | None |
Installation and Config | 5 | 3 | 2 | 5 | https://bugs.launchpad.net/starlingx/+bug/1797187 |
Maintenance | 19 | 19 | 0 | 19 | None |
Networking | 22 | 10 | 4 | 14 | https://bugs.launchpad.net/starlingx/+bug/1796198 |
Nova | 35 | 15 | 6 | 21 | https://bugs.launchpad.net/starlingx/+bug/1796393 |
Security | 17 | 8 | 3 | 11 | https://bugs.launchpad.net/starlingx/+bug/1797204
https://bugs.launchpad.net/starlingx/+bug/1797219 https://bugs.launchpad.net/starlingx/+bug/1797569 |
Storage | 11 | 4 | 5 | 9 | https://bugs.launchpad.net/starlingx/+bug/1795962
https://bugs.launchpad.net/starlingx/+bug/1796913 https://bugs.launchpad.net/starlingx/+bug/1797151 https://bugs.launchpad.net/starlingx/+bug/1797391 |
System Inventory | 8 | 7 | 1 | 8 | https://bugs.launchpad.net/starlingx/+bug/1797187 |
System Test | 10 | 8 | 0 | 8 | None |
Total | 161 | 92 | 22 | 114 | None |