Jump to: navigation, search

Difference between revisions of "QA"

(Projects)
 
(66 intermediate revisions by 8 users not shown)
Line 1: Line 1:
 
__TOC__
 
__TOC__
  
QA is an official OpenStack project team.
+
QA (Quality Assurance) is an official OpenStack project team.
  
 
== Project Team Definition ==
 
== Project Team Definition ==
Line 7: Line 7:
 
'''Official Title:''' OpenStack Quality Assurance<br />
 
'''Official Title:''' OpenStack Quality Assurance<br />
  
'''PTL:''' Matthew Treinish (mtreinish)<br />
+
'''PTL:''' Martin Kopec (kopecmartin) <br />
  
 
'''Mission Statement:''' <blockquote> Develop, maintain, and initiate tools and plans to ensure the upstream stability and quality of OpenStack, and its release readiness at any point during the release cycle.
 
'''Mission Statement:''' <blockquote> Develop, maintain, and initiate tools and plans to ensure the upstream stability and quality of OpenStack, and its release readiness at any point during the release cycle.
 
</blockquote>
 
</blockquote>
 +
 +
== How to add new Project under QA program ==
 +
 +
Any new tool or project contributing towards the QA mission can be added under QA program. Below are the steps to do that.
 +
 +
* Discuss the idea on #openstack-qa channel or [http://lists.openstack.org/pipermail/openstack-discuss/ openstack-discuss] ML with [qa] tag in the subject line.
 +
 +
* You need to propose a QA spec with all the details.
 +
** Example: https://review.opendev.org/#/c/656890/
 +
 +
* Once Spec is merged then follow this [https://docs.opendev.org/opendev/infra-manual/latest/creators.html process] to add your project under QA via OpenStack Governance
 +
** Example: https://review.opendev.org/#/c/714478/ https://review.opendev.org/#/c/714480/
 +
 +
== Feature Proposal & Design discussions ==
 +
 +
Any feature for any of the QA projects which need design discussions can be done via proposing the spec in qa-specs repository. Refer [https://specs.openstack.org/openstack/qa-specs/README.html  qa-specs-process] for details.
 +
 +
Not all features need QA spec, to know that if your proposal needs QA spec please feel free to reach out to QA team in #openstack-qa IRC channel or [http://lists.openstack.org/pipermail/openstack-discuss/ openstack-discuss] ML with [qa] tag in the subject line.
 +
 +
=== QA Specification ===
 +
 +
==== [https://review.opendev.org/#/admin/groups/470,members QA Specs Core Team]====
 +
 +
{| border="1" cellpadding="2"
 +
| Source code
 +
| https://opendev.org/openstack/qa-specs
 +
|}
 +
 +
== Releases Process ==
 +
Along with the release of few projects as per the release team process, QA needs to do some extra steps during OpenStack release to set up the infra for in DevStack and Grenade.
 +
The complete process for project releases and QA responsibilities are documented here: [[QA/releases]]
 +
 +
== Community ==
 +
* IRC Channel: #openstack-qa on OFTC
 +
* Email: [http://lists.openstack.org/pipermail/openstack-discuss/ openstack-discuss] ML with [qa] tag in the subject line.
 +
 +
== Meetings ==
 +
The QA project team has a weekly IRC meeting, for more details see: [[Meetings/QATeamMeeting]]
  
 
== Projects ==
 
== Projects ==
  
The OpenStack QA project team is made of multiple projects which each run independently towards the goals of the project team. Each project maintains a seperate core team based on who provides reviews in those projects.
+
The OpenStack QA project team is made of multiple projects which each run independently towards the goals of the project team. Each project maintains a separate core team based on who provides reviews in those projects.
  
 
For the purposes of voting on QA Project Team activities, anyone that's core on any of the projects gets a vote.
 
For the purposes of voting on QA Project Team activities, anyone that's core on any of the projects gets a vote.
  
 
=== Tempest ===
 
=== Tempest ===
 +
 +
==== [https://review.opendev.org/#/admin/groups/42,members Tempest Core Team]====
 +
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack/tempest/
+
| https://opendev.org/openstack/tempest/
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/tempest+status:open
 
|-
 
|-
 
| Bug tracker
 
| Bug tracker
Line 28: Line 72:
 
| Feature tracker
 
| Feature tracker
 
| https://blueprints.launchpad.net/tempest
 
| https://blueprints.launchpad.net/tempest
 +
|-
 +
| Documentation
 +
| https://docs.openstack.org/tempest/latest//
 +
|}
 +
 +
=== DevStack ===
 +
 +
==== [https://review.opendev.org/#/admin/groups/50,members Devstack Core Team] ====
 +
 +
''As of 19Aug2014 'DevStack is part of the [[QA]] program.''
 +
 +
==== Mission Statement ====
 +
 +
DevStack's mission is to provide and maintain tools used for the installation of the central OpenStack services from source (git repository master, or specific branches) suitable for development and operational testing.  It also demonstrates and documents examples of configuring and running services as well as command line client usage.
 +
 +
==== Description ====
 +
 +
DevStack is an opinionated script to quickly create an OpenStack development environment. It can also be used to demonstrate starting/running OpenStack services and provide examples of using them from a command line. The example exercises were fleshed out beyond simple examples and became useful as a quick sanity check for the OpenStack installation. That sanity check became the basis for the Gerrit gate tests for all OpenStack checkins and continues in that role until Tempest takes over. These remain as the driving priorities for ongoing DevStack development.
 +
 +
DevStack is not and has never been intended to be a general OpenStack installer. It has evolved to support a large number of configuration options and alternative platforms and support services. However, that evolution has grown well beyond what was originally intended and unfortunately many of the configuration combinations are rarely, if ever, tested.
 +
 +
 +
The simplest way to try DevStack is to run script https://github.com/makelinux/devstack-install-on-iso, which automatically installs Ubuntu in VM and DevStack without any manual configuration.
 +
 +
{| border="1" cellpadding="2" cellspacing="0"
 +
| Source Code
 +
| https://opendev.org/openstack/devstack
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/devstack+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/devstack
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/devstack
 
|-
 
|-
 
| Developer Documentation
 
| Developer Documentation
| http://docs.openstack.org/developer/tempest/
+
| https://docs.openstack.org/devstack/latest/
 +
|}
 +
 
 +
=== Grenade ===
 +
 
 +
==== [https://review.opendev.org/#/admin/groups/188,members Grenade Core Team] ====
 +
 
 +
For more information see: [[Grenade]]
 +
{| border="1" cellpadding="2"
 +
| Source code
 +
| https://opendev.org/openstack/grenade
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/grenade+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/grenade
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/grenade
 +
|-
 +
| Documentation
 +
| https://docs.openstack.org/grenade/latest
 
|}
 
|}
  
 +
===Hacking===
  
====Test removal procedure:====
+
==== [https://review.opendev.org/#/admin/groups/153,members Hacking Core Team] ====
[[QA/Tempest-test-removal]]
 
  
=== Tempest-lib ===
 
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack/tempest-lib/
+
| https://opendev.org/openstack/hacking
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/hacking+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/hacking
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/hacking
 +
|-
 +
|  Documentation
 +
| https://docs.openstack.org/hacking/latest
 +
|}
 +
 
 +
===os-testr===
 +
 
 +
==== [https://review.opendev.org/#/admin/groups/667,members OS Testr Core Team] ====
 +
 
 +
{| border="1" cellpadding="2"
 +
| Source code
 +
| https://opendev.org/openstack/os-testr/
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/os-testr+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/os-testr
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/os-testr
 +
|-
 +
|  Documentation
 +
| https://docs.openstack.org/os-testr/latest/
 +
|}
 +
 
 +
===Stackviz===
 +
 
 +
==== [https://review.opendev.org/#/admin/groups/1072,members Stackviz Core Team] ====
 +
 
 +
{| border="1" cellpadding="2"
 +
| Source code
 +
| https://opendev.org/openstack/stackviz/
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/stackviz+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/tempest
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/tempest
 +
|-
 +
|  Documentation
 +
| https://docs.openstack.org/stackviz/latest/
 +
|}
 +
 
 +
=== coverage2sql ===
 +
 
 +
==== [https://review.opendev.org/#/admin/groups/1627,members Coverage2sql Core Team]====
 +
 
 +
{| border="1" cellpadding="2"
 +
| Source code
 +
| https://opendev.org/openstack/coverage2sql
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/coverage2sql+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/coverage2sql
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/coverage2sql
 +
|-
 +
| Documentation
 +
| https://docs.openstack.org/coverage2sql/latest//
 +
|}
 +
 
 +
===OS Performance Tools===
 +
 
 +
==== [https://review.opendev.org/#/admin/groups/1126,members OS Performance Tools Core Team] ====
 +
 
 +
{| border="1" cellpadding="2"
 +
| Source code
 +
| https://opendev.org/openstack/os-performance-tools/
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/os-performance-tools+status:open
 
|-
 
|-
 
| Bug tracker
 
| Bug tracker
Line 48: Line 236:
 
| https://blueprints.launchpad.net/tempest
 
| https://blueprints.launchpad.net/tempest
 
|-
 
|-
| Developer Documentation
+
| Documentation
| http://docs.openstack.org/developer/tempest-lib/
+
| https://docs.openstack.org/os-performance-tools/latest/
 
|}
 
|}
==== Tempest -> Tempest-lib migration ====
 
To migrate a module from tempest into tempest-lib follow these instructions: [[tempest-lib-migration]]
 
  
===Tempest Plugin Cookiecutter===
+
===Bashate===
 +
 
 +
==== [https://review.opendev.org/#/admin/groups/333,members Bashate Core Team] ====
 +
 
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack/tempest-plugin-cookiecutter
+
| https://opendev.org/openstack/bashate
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/bashate+status:open
 
|-
 
|-
 
| Bug tracker
 
| Bug tracker
 
| https://bugs.launchpad.net/tempest
 
| https://bugs.launchpad.net/tempest
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/tempest
 +
|-
 +
|  Documentation
 +
| https://docs.openstack.org/bashate/latest/
 
|}
 
|}
  
=== Grenade ===
+
===Devstack Plugin Container===
For more information see: [[Grenade]]
+
 
 +
====[https://review.opendev.org/#/admin/groups/1751,members Devstack Plugin Container Core Team]====
 +
 
 +
{| border="1" cellpadding="2"
 +
| Source code
 +
| https://opendev.org/openstack/devstack-plugin-container
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/devstack-plugin-container+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/devstack
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/devstack
 +
|}
 +
 
 +
===Devstack Plugin Ceph===
 +
 
 +
====[https://review.opendev.org/#/admin/groups/1196,members Devstack Plugin Ceph Core Team]====
 +
 
 +
{| border="1" cellpadding="2"
 +
| Source code
 +
| https://opendev.org/openstack/devstack-plugin-ceph
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/devstack-plugin-ceph+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/devstack-plugin-ceph
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/devstack-plugin-ceph
 +
|-
 +
| Documentation
 +
| https://docs.openstack.org/devstack-plugin-ceph/latest/
 +
|}
 +
 
 +
===Devstack Plugin Open Cas===
 +
 
 +
====[https://review.opendev.org/#/admin/groups/2082,members Devstack Plugin Open Cas Core Team]====
 +
 
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack-dev/grenade/
+
| https://opendev.org/openstack/devstack-plugin-open-cas
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/devstack-plugin-open-cas+status:open
 
|-
 
|-
 
| Bug tracker
 
| Bug tracker
| https://bugs.launchpad.net/grenade
+
| https://bugs.launchpad.net/devstack
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/devstack
 
|}
 
|}
  
=== DevStack ===
+
===Devstack Plugin NFS===
For more information see: [[DevStack]]
+
 
 +
====[https://review.opendev.org/#/admin/groups/1330,members Devstack Plugin NFS Core Team]====
  
{| border="1" cellpadding="2" cellspacing="0"
+
{| border="1" cellpadding="2"
| '''Documentation'''
+
| Source code
| http://docs.openstack.org/developer/devstack/
+
| https://opendev.org/openstack/devstack-plugin-nfs
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/devstack-plugin-nfs+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/devstack-plugin-nfs
 
|-
 
|-
| '''GitHub'''
+
| Feature tracker
| https://github.com/openstack-dev/devstack
+
| https://blueprints.launchpad.net/devstack-plugin-nfs
 
|-
 
|-
| '''Bug tracker'''
+
| Documentation
| https://bugs.launchpad.net//devstack
+
| https://docs.openstack.org/devstack-plugin-nfs/latest/
 
|}
 
|}
  
===Devstack Plugin Cookiecutter===
+
===Devstack Tools===
 +
 
 +
====[https://review.opendev.org/#/admin/groups/50,members Devstack Tools Core Team]====
 +
 
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack-dev/devstack-plugin-cookiecutter
+
| https://opendev.org/openstack/devstack-tools
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/devstack-tools+status:open
 
|-
 
|-
 
| Bug tracker
 
| Bug tracker
 
| https://bugs.launchpad.net/devstack
 
| https://bugs.launchpad.net/devstack
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/devstack
 +
|-
 +
| Documentation
 +
| https://docs.openstack.org/devstack-tools/latest/
 
|}
 
|}
  
 
===Devstack Vagrant===
 
===Devstack Vagrant===
 +
 +
====[https://review.opendev.org/#/admin/groups/50,members Devstack Vagrant Core Team]====
 +
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack-dev/devstack-vagrant
+
| https://opendev.org/openstack/devstack-vagrant
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/devstack-vagrant+status:open
 
|-
 
|-
 
| Bug tracker
 
| Bug tracker
 
| https://bugs.launchpad.net/devstack
 
| https://bugs.launchpad.net/devstack
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/devstack
 +
|}
 +
 +
===Eslint Config Openstack===
 +
 +
==== [https://review.opendev.org/#/admin/groups/991,members Eslint Config Openstack Core Team] ====
 +
 +
{| border="1" cellpadding="2"
 +
| Source code
 +
| https://opendev.org/openstack/eslint-config-openstack
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/eslint-config-openstack+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/eslint-config-openstack
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/eslint-config-openstack
 
|}
 
|}
  
===Hacking===
+
===Karma Subunit Reporter===
 +
 
 +
==== [https://review.opendev.org/#/admin/groups/1426,members Karma Subunit Reporter Core Team] ====
 +
 
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack-dev/hacking
+
| https://opendev.org/openstack/karma-subunit-reporter
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/karma-subunit-reporter+status:open
 
|-
 
|-
 
| Bug tracker
 
| Bug tracker
| https://bugs.launchpad.net/hacking
+
| https://bugs.launchpad.net/tempest
 
|-
 
|-
| Documentation
+
| Feature tracker
| http://docs.openstack.org/developer/hacking
+
| https://blueprints.launchpad.net/tempest
 
|}
 
|}
  
===Bashate===
+
===Tempest Stress===
 +
 
 +
==== [https://review.opendev.org/#/admin/groups/1860,members Tempest Stress Core Team] ====
 +
 
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack-dev/bashate
+
| https://opendev.org/openstack/tempest-stress
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/tempest-stress+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/tempest
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/tempest
 
|-
 
|-
 +
| Documentation
 +
| https://docs.openstack.org/tempest-stress/latest/
 
|}
 
|}
  
===os-testr===
+
===Tempest Plugin Cookiecutter===
 +
 
 +
==== [https://review.opendev.org/#/admin/groups/42,members Tempest Plugin Cookiecutter Core Team] ====
 +
 
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack/os-testr
+
| https://opendev.org/openstack/tempest-plugin-cookiecutter/
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/tempest-plugin-cookiecutter+status:open
 
|-
 
|-
 
| Bug tracker
 
| Bug tracker
| https://bugs.launchpad.net/os-testr
+
| https://bugs.launchpad.net/tempest
 
|-
 
|-
| Documentation
+
| Feature tracker
| http://docs.openstack.org/developer/os-testr
+
| https://blueprints.launchpad.net/tempest
 
|}
 
|}
  
===openstack-health===
+
===Devstack Plugin Cookiecutter===
 +
 
 +
====[https://review.opendev.org/#/admin/groups/50,members Devstack Plugin Cookiecutter Core Team]====
 +
 
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack/openstack-health
+
| https://opendev.org/openstack/devstack-plugin-cookiecutter
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/devstack-plugin-cookiecutter+status:open
 
|-
 
|-
 
| Bug tracker
 
| Bug tracker
| https://bugs.launchpad.net/openstack-health
+
| https://bugs.launchpad.net/devstack
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/devstack
 
|}
 
|}
  
===stackviz===
+
=== Whitebox Tempest Plugin ===
 +
 
 +
====[https://review.opendev.org/#/admin/groups/2020,members Whitebox Tempest Plugin Core Team]====
 +
 
 
{| border="1" cellpadding="2"
 
{| border="1" cellpadding="2"
 
| Source code
 
| Source code
| http://git.openstack.org/cgit/openstack/stackviz
+
| https://opendev.org/openstack/whitebox-tempest-plugin
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/whitebox-tempest-plugin+status:open
 +
|-
 +
| Bug tracker
 +
| https://storyboard.openstack.org/#!/project/1162
 +
|-
 +
| Feature tracker
 +
| NA
 
|}
 
|}
  
 +
=== Tempest-lib (RETIRED) ===
 +
As of the 1.0.0 release tempest-lib as a separate repository and project is deprecated. The library now exists as part of the tempest project, all future development will occur there. To use the library for future releases update your imports from tempest_lib to tempest.lib, and add tempest>=10 to your project requirements
 +
 +
After several years of deprecation, this project got retired (April 6th 2022) after an agreement on Zed PTG:
 +
* https://etherpad.opendev.org/p/qa-zed-ptg
 +
 +
===Openstack Health (RETIRED) ===
 +
 +
==== [https://review.opendev.org/#/admin/groups/1078,members Openstack Health Core Team] ====
 +
 +
{| border="1" cellpadding="2"
 +
| Source code
 +
| https://opendev.org/openstack/openstack-health/
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/openstack-health+status:open
 +
|-
 +
| Bug tracker
 +
| https://bugs.launchpad.net/openstack-health
 +
|-
 +
| Feature tracker
 +
| https://blueprints.launchpad.net/openstack-health
 +
|}
  
== Project liaisons ==
+
=== Patrole (RETIRED) ===
To make cross project communication easier and fill gaps in domain expertise between projects and QA (bidirectionally) each project designates a liaison for handling integration issues. See [[QA/ProjectLiaisons]].
+
====  [https://review.opendev.org/#/admin/groups/1673,members Patrole Core Team] ====
  
== Feature proposals ==
+
{| border="1" cellpadding="2"
To propose a feature to any of the QA projects you first need to file a spec in qa-specs. The entire process is outlined here: [[qa-specs-process]]
+
| Source code
 +
| https://opendev.org/openstack/patrole/
 +
|-
 +
| Reviews
 +
| https://review.opendev.org/q/project:openstack/patrole+status:open
 +
|-
 +
| Bug & Feature tracker
 +
| https://storyboard.openstack.org/#!/project/1040
 +
|-
 +
| Documentation
 +
| https://docs.openstack.org/patrole/latest/
 +
|}
  
=== Pushing Releases ===
+
== Project liaisons ==
The process for pushing project releases is documented here: [[QA/releases]]
+
To make cross project communication easier and fill gaps in domain expertise between projects and QA (bidirectionally) each project designates a liaison for handling integration issues. See [[CrossProjectLiaisons#QA|QAProjectLiaisons]].
  
== Community ==
+
== History ==
IRC Channel: #openstack-qa on freenode
+
* Previous PTLs
=== Meetings ===
+
** Sean Dague  (sdague), ..Havana and Icehouse release
The QA project team has a weekly IRC meeting, for more details see:  
+
** Matthew Treinish (mtreinish): Juno, Kilo, Liberty and Mitaka releases
 +
** Ken'ichi Ohmichi (oomichi): Newton and Ocata releases
 +
** Andrea Frittoli (andreaf): Pike and Queens releases
 +
** Ghanshyam Mann (gmann): Rocky, Stein, Train and Ussuri release
 +
** Masayuki Igawa (masayukig): Victoria and Wallaby release
 +
** Martin Kopec (kopecmartin): Xena, Yoga, Zed and Antelope
  
[[Meetings/QATeamMeeting]]
 
  
 
[[Category: Horizontal_Team]]
 
[[Category: Horizontal_Team]]

Latest revision as of 08:43, 13 April 2023

Contents

QA (Quality Assurance) is an official OpenStack project team.

Project Team Definition

Official Title: OpenStack Quality Assurance

PTL: Martin Kopec (kopecmartin)

Mission Statement:
Develop, maintain, and initiate tools and plans to ensure the upstream stability and quality of OpenStack, and its release readiness at any point during the release cycle.

How to add new Project under QA program

Any new tool or project contributing towards the QA mission can be added under QA program. Below are the steps to do that.

  • Discuss the idea on #openstack-qa channel or openstack-discuss ML with [qa] tag in the subject line.

Feature Proposal & Design discussions

Any feature for any of the QA projects which need design discussions can be done via proposing the spec in qa-specs repository. Refer qa-specs-process for details.

Not all features need QA spec, to know that if your proposal needs QA spec please feel free to reach out to QA team in #openstack-qa IRC channel or openstack-discuss ML with [qa] tag in the subject line.

QA Specification

QA Specs Core Team

Source code https://opendev.org/openstack/qa-specs

Releases Process

Along with the release of few projects as per the release team process, QA needs to do some extra steps during OpenStack release to set up the infra for in DevStack and Grenade. The complete process for project releases and QA responsibilities are documented here: QA/releases

Community

  • IRC Channel: #openstack-qa on OFTC
  • Email: openstack-discuss ML with [qa] tag in the subject line.

Meetings

The QA project team has a weekly IRC meeting, for more details see: Meetings/QATeamMeeting

Projects

The OpenStack QA project team is made of multiple projects which each run independently towards the goals of the project team. Each project maintains a separate core team based on who provides reviews in those projects.

For the purposes of voting on QA Project Team activities, anyone that's core on any of the projects gets a vote.

Tempest

Tempest Core Team

Source code https://opendev.org/openstack/tempest/
Reviews https://review.opendev.org/q/project:openstack/tempest+status:open
Bug tracker https://bugs.launchpad.net/tempest
Feature tracker https://blueprints.launchpad.net/tempest
Documentation https://docs.openstack.org/tempest/latest//

DevStack

Devstack Core Team

As of 19Aug2014 'DevStack is part of the QA program.

Mission Statement

DevStack's mission is to provide and maintain tools used for the installation of the central OpenStack services from source (git repository master, or specific branches) suitable for development and operational testing. It also demonstrates and documents examples of configuring and running services as well as command line client usage.

Description

DevStack is an opinionated script to quickly create an OpenStack development environment. It can also be used to demonstrate starting/running OpenStack services and provide examples of using them from a command line. The example exercises were fleshed out beyond simple examples and became useful as a quick sanity check for the OpenStack installation. That sanity check became the basis for the Gerrit gate tests for all OpenStack checkins and continues in that role until Tempest takes over. These remain as the driving priorities for ongoing DevStack development.

DevStack is not and has never been intended to be a general OpenStack installer. It has evolved to support a large number of configuration options and alternative platforms and support services. However, that evolution has grown well beyond what was originally intended and unfortunately many of the configuration combinations are rarely, if ever, tested.


The simplest way to try DevStack is to run script https://github.com/makelinux/devstack-install-on-iso, which automatically installs Ubuntu in VM and DevStack without any manual configuration.

Source Code https://opendev.org/openstack/devstack
Reviews https://review.opendev.org/q/project:openstack/devstack+status:open
Bug tracker https://bugs.launchpad.net/devstack
Feature tracker https://blueprints.launchpad.net/devstack
Developer Documentation https://docs.openstack.org/devstack/latest/

Grenade

Grenade Core Team

For more information see: Grenade

Source code https://opendev.org/openstack/grenade
Reviews https://review.opendev.org/q/project:openstack/grenade+status:open
Bug tracker https://bugs.launchpad.net/grenade
Feature tracker https://blueprints.launchpad.net/grenade
Documentation https://docs.openstack.org/grenade/latest

Hacking

Hacking Core Team

Source code https://opendev.org/openstack/hacking
Reviews https://review.opendev.org/q/project:openstack/hacking+status:open
Bug tracker https://bugs.launchpad.net/hacking
Feature tracker https://blueprints.launchpad.net/hacking
Documentation https://docs.openstack.org/hacking/latest

os-testr

OS Testr Core Team

Source code https://opendev.org/openstack/os-testr/
Reviews https://review.opendev.org/q/project:openstack/os-testr+status:open
Bug tracker https://bugs.launchpad.net/os-testr
Feature tracker https://blueprints.launchpad.net/os-testr
Documentation https://docs.openstack.org/os-testr/latest/

Stackviz

Stackviz Core Team

Source code https://opendev.org/openstack/stackviz/
Reviews https://review.opendev.org/q/project:openstack/stackviz+status:open
Bug tracker https://bugs.launchpad.net/tempest
Feature tracker https://blueprints.launchpad.net/tempest
Documentation https://docs.openstack.org/stackviz/latest/

coverage2sql

Coverage2sql Core Team

Source code https://opendev.org/openstack/coverage2sql
Reviews https://review.opendev.org/q/project:openstack/coverage2sql+status:open
Bug tracker https://bugs.launchpad.net/coverage2sql
Feature tracker https://blueprints.launchpad.net/coverage2sql
Documentation https://docs.openstack.org/coverage2sql/latest//

OS Performance Tools

OS Performance Tools Core Team

Source code https://opendev.org/openstack/os-performance-tools/
Reviews https://review.opendev.org/q/project:openstack/os-performance-tools+status:open
Bug tracker https://bugs.launchpad.net/tempest
Feature tracker https://blueprints.launchpad.net/tempest
Documentation https://docs.openstack.org/os-performance-tools/latest/

Bashate

Bashate Core Team

Source code https://opendev.org/openstack/bashate
Reviews https://review.opendev.org/q/project:openstack/bashate+status:open
Bug tracker https://bugs.launchpad.net/tempest
Feature tracker https://blueprints.launchpad.net/tempest
Documentation https://docs.openstack.org/bashate/latest/

Devstack Plugin Container

Devstack Plugin Container Core Team

Source code https://opendev.org/openstack/devstack-plugin-container
Reviews https://review.opendev.org/q/project:openstack/devstack-plugin-container+status:open
Bug tracker https://bugs.launchpad.net/devstack
Feature tracker https://blueprints.launchpad.net/devstack

Devstack Plugin Ceph

Devstack Plugin Ceph Core Team

Source code https://opendev.org/openstack/devstack-plugin-ceph
Reviews https://review.opendev.org/q/project:openstack/devstack-plugin-ceph+status:open
Bug tracker https://bugs.launchpad.net/devstack-plugin-ceph
Feature tracker https://blueprints.launchpad.net/devstack-plugin-ceph
Documentation https://docs.openstack.org/devstack-plugin-ceph/latest/

Devstack Plugin Open Cas

Devstack Plugin Open Cas Core Team

Source code https://opendev.org/openstack/devstack-plugin-open-cas
Reviews https://review.opendev.org/q/project:openstack/devstack-plugin-open-cas+status:open
Bug tracker https://bugs.launchpad.net/devstack
Feature tracker https://blueprints.launchpad.net/devstack

Devstack Plugin NFS

Devstack Plugin NFS Core Team

Source code https://opendev.org/openstack/devstack-plugin-nfs
Reviews https://review.opendev.org/q/project:openstack/devstack-plugin-nfs+status:open
Bug tracker https://bugs.launchpad.net/devstack-plugin-nfs
Feature tracker https://blueprints.launchpad.net/devstack-plugin-nfs
Documentation https://docs.openstack.org/devstack-plugin-nfs/latest/

Devstack Tools

Devstack Tools Core Team

Source code https://opendev.org/openstack/devstack-tools
Reviews https://review.opendev.org/q/project:openstack/devstack-tools+status:open
Bug tracker https://bugs.launchpad.net/devstack
Feature tracker https://blueprints.launchpad.net/devstack
Documentation https://docs.openstack.org/devstack-tools/latest/

Devstack Vagrant

Devstack Vagrant Core Team

Source code https://opendev.org/openstack/devstack-vagrant
Reviews https://review.opendev.org/q/project:openstack/devstack-vagrant+status:open
Bug tracker https://bugs.launchpad.net/devstack
Feature tracker https://blueprints.launchpad.net/devstack

Eslint Config Openstack

Eslint Config Openstack Core Team

Source code https://opendev.org/openstack/eslint-config-openstack
Reviews https://review.opendev.org/q/project:openstack/eslint-config-openstack+status:open
Bug tracker https://bugs.launchpad.net/eslint-config-openstack
Feature tracker https://blueprints.launchpad.net/eslint-config-openstack

Karma Subunit Reporter

Karma Subunit Reporter Core Team

Source code https://opendev.org/openstack/karma-subunit-reporter
Reviews https://review.opendev.org/q/project:openstack/karma-subunit-reporter+status:open
Bug tracker https://bugs.launchpad.net/tempest
Feature tracker https://blueprints.launchpad.net/tempest

Tempest Stress

Tempest Stress Core Team

Source code https://opendev.org/openstack/tempest-stress
Reviews https://review.opendev.org/q/project:openstack/tempest-stress+status:open
Bug tracker https://bugs.launchpad.net/tempest
Feature tracker https://blueprints.launchpad.net/tempest
Documentation https://docs.openstack.org/tempest-stress/latest/

Tempest Plugin Cookiecutter

Tempest Plugin Cookiecutter Core Team

Source code https://opendev.org/openstack/tempest-plugin-cookiecutter/
Reviews https://review.opendev.org/q/project:openstack/tempest-plugin-cookiecutter+status:open
Bug tracker https://bugs.launchpad.net/tempest
Feature tracker https://blueprints.launchpad.net/tempest

Devstack Plugin Cookiecutter

Devstack Plugin Cookiecutter Core Team

Source code https://opendev.org/openstack/devstack-plugin-cookiecutter
Reviews https://review.opendev.org/q/project:openstack/devstack-plugin-cookiecutter+status:open
Bug tracker https://bugs.launchpad.net/devstack
Feature tracker https://blueprints.launchpad.net/devstack

Whitebox Tempest Plugin

Whitebox Tempest Plugin Core Team

Source code https://opendev.org/openstack/whitebox-tempest-plugin
Reviews https://review.opendev.org/q/project:openstack/whitebox-tempest-plugin+status:open
Bug tracker https://storyboard.openstack.org/#!/project/1162
Feature tracker NA

Tempest-lib (RETIRED)

As of the 1.0.0 release tempest-lib as a separate repository and project is deprecated. The library now exists as part of the tempest project, all future development will occur there. To use the library for future releases update your imports from tempest_lib to tempest.lib, and add tempest>=10 to your project requirements

After several years of deprecation, this project got retired (April 6th 2022) after an agreement on Zed PTG:

Openstack Health (RETIRED)

Openstack Health Core Team

Source code https://opendev.org/openstack/openstack-health/
Reviews https://review.opendev.org/q/project:openstack/openstack-health+status:open
Bug tracker https://bugs.launchpad.net/openstack-health
Feature tracker https://blueprints.launchpad.net/openstack-health

Patrole (RETIRED)

Patrole Core Team

Source code https://opendev.org/openstack/patrole/
Reviews https://review.opendev.org/q/project:openstack/patrole+status:open
Bug & Feature tracker https://storyboard.openstack.org/#!/project/1040
Documentation https://docs.openstack.org/patrole/latest/

Project liaisons

To make cross project communication easier and fill gaps in domain expertise between projects and QA (bidirectionally) each project designates a liaison for handling integration issues. See QAProjectLiaisons.

History

  • Previous PTLs
    • Sean Dague (sdague), ..Havana and Icehouse release
    • Matthew Treinish (mtreinish): Juno, Kilo, Liberty and Mitaka releases
    • Ken'ichi Ohmichi (oomichi): Newton and Ocata releases
    • Andrea Frittoli (andreaf): Pike and Queens releases
    • Ghanshyam Mann (gmann): Rocky, Stein, Train and Ussuri release
    • Masayuki Igawa (masayukig): Victoria and Wallaby release
    • Martin Kopec (kopecmartin): Xena, Yoga, Zed and Antelope