Jump to: navigation, search

Difference between revisions of "Meetings/QATeamMeeting"

m (Agenda for next Office hours)
 
(812 intermediate revisions by 62 users not shown)
Line 1: Line 1:
 +
__TOC__
  
 
= Weekly QA Team meeting =
 
= Weekly QA Team meeting =
The OpenStack QA Team holds public weekly meetings in <code><nowiki>#openstack-meeting</nowiki></code>, '''Thursday at 1:00 EDT (17:00 UTC)'''.<br />
+
The [[QA|OpenStack Quality Assurance (QA)]] team Develop, maintain, and initiate tools and plans to ensure the upstream stability and quality of OpenStack, and its release readiness at any point during the release cycle.
Everyone interested in testing, quality assurance, performance engineering, etc, should attend!
 
  
The meeting minutes of can be found here: [http://eavesdrop.openstack.org/meetings/qa meeting minutes on everdrop]
+
The [[QA|OpenStack Quality Assurance (QA)]] team holds public weekly Office hours:
 +
* Channel:  <code><nowiki>#openstack-qa</nowiki></code>
 +
* Time:
 +
** Tuesdays biweekly at 15:00 UTC (even weeks, starting week 46, 2023)
 +
** Wednesday biweekly at 17:00 UTC (odd weeks, starting week 45, 2023)
 +
* ical - http://eavesdrop.openstack.org/#QA_Team_Office_hours
  
''Rules for adding to the agenda'':
+
Everyone interested in testing, quality assurance, performance engineering, etc, should attend! The meeting minutes of previous meetings can be found here: [http://eavesdrop.openstack.org/meetings/qa meeting minutes on eavesdrop]
* anyone is free to add to proposed agenda, please do so by 1 hr before the meeting
+
 
 +
'''''Rules for adding to the agenda''''':
 +
* anyone is free to add to proposed agenda, please do so by 1 hr before the Office hours
 
* if you add an item to the agenda, please include your ircnick (i.e. sdague) to the end of your item, so we know who did, and who should lead the discussion
 
* if you add an item to the agenda, please include your ircnick (i.e. sdague) to the end of your item, so we know who did, and who should lead the discussion
  
=== Proposed Agenda for November 21 2013 ===
 
*  Blueprints
 
* Negative testing (mkoderer/dkranz)
 
* Neutron testing
 
* Critical Reviews (???)
 
 
== Previous meetings ==
 
All previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/qa/.
 
  
=== Agenda for November 14 2013 ===
+
'''''Tips to Chair the Office hours''''':
* Possible Meeting Time change to include .jp (sdague)
+
* Start this meeting using: #startmeeting qa
* Blueprints
+
* If nothing much to discuss then we can always finish Office hours any time before 1 hour.
** Blueprints breakdown (sdague)
+
* Announcement and Priority Items progress (first 2 items of Agenda) can be skipped and need not to be tracked every week.
** Negative testing (mkoderer/dkranz)
+
* End this meeting using: #endmeeting
* Neutron testing
 
** Negative tests coverage: neutron status (EmilienM)
 
** Progress on https://bugs.launchpad.net/swift/+bug/1224001 (mlavalle)
 
* How should we sync the teams (neutron/scenario test)? One BP with work items, bugs or ML? (mkoderer)
 
* Onboarding documentation - where should we put it? (mkoderer)
 
* Critical Reviews (sdague)
 
  
=== Agenda for October 24 2013 ===
+
== Agenda for next Office hours ==
* Design Summit Schedule (sdague)
+
PING LIST-
** http://icehousedesignsummit.sched.org/ - figure out if there are last minute changes we need (note: many time blocks are fixed due to conflicts, so wiggle room is limited)
+
* Announcement and Action Item (Optional)
* Neutron job status (mtreinish)
+
* Priority Items progress
* Scope and place for performance testing such as Rally (dkranz)
+
** go through the zed priority items list and try to plan the work / highlight milestones
* Status and roll-out plan for failing the gate on log errors (dkranz)
+
*** https://etherpad.opendev.org/p/qa-caracal-priority
* State of 'smoke' tagging: can we make it useful? (dkranz)
+
* OpenStack Events Updates and Planning (Optional)
* Tempest config reorg and cleanup (mtreinish)
+
** <This includes the OpenStack Summit and PTG updates and planning>
 +
** Summit & PTG
 +
*** the next PTG is gonna be held virtually, April 8-12, 2024
 +
**** etherpad: https://etherpad.opendev.org/p/apr2024-ptg-qa
 +
**** framadate: https://framadate.org/pklG59pH47w6ZdJI (vote for the time of the PTG session)
 +
* Gate Status / Fix Checks
 +
** <not just QA projects gate but any other project gate also where QA team can help>
 +
** Gate Blocker Fix / Urgent Change
 +
*** https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)
 +
** Bare Recheck tracking:
 +
*** https://etherpad.opendev.org/p/recheck-weekly-summary
 +
*** #info STOP DOING BARE RECHECKS aka. 'recheck' https://docs.openstack.org/project-team-guide/testing.html#how-to-handle-test-failures
 +
* Changes with Review-Priority == +1
 +
** https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)
 +
* Periodic jobs Status Checks
 +
** Periodic stable full: https://zuul.openstack.org/builds?pipeline=periodic-stable&job_name=tempest-full-yoga&job_name=tempest-full-xena&job_name=tempest-full-zed&job_name=tempest-full-2023-1&job_name=tempest-full-2023-2
 +
** Periodic stable slow: https://zuul.openstack.org/builds?job_name=tempest-slow-2023-2&job_name=tempest-slow-2023-1&job_name=tempest-slow-zed&job_name=tempest-slow-yoga&job_name=tempest-slow-xena
 +
** Periodic extra tests: https://zuul.openstack.org/builds?job_name=tempest-full-2023-2-extra-tests&job_name=tempest-full-2023-1-extra-tests&job_name=tempest-full-zed-extra-tests&job_name=tempest-full-yoga-extra-tests&job_name=tempest-full-xena-extra-tests
 +
** Periodic master: https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic
 +
* Distros check:
 +
** Centos 9: https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=0
 +
** Debian: https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&job_name=devstack-platform-debian-bookworm&skip=0
 +
** Rocky: https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx
 +
** openEuler: https://zuul.openstack.org/builds?job_name=devstack-platform-openEuler-22.03-ovn-source&job_name=devstack-platform-openEuler-22.03-ovs&skip=0
 +
** jammy: https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-ubuntu-jammy-ovn-source&job_name=devstack-platform-ubuntu-jammy-ovs&skip=0
 +
/devstack+OR+project:openstack/grenade)
 +
* Sub Teams highlights (Sub Teams means individual projects under QA program)
 +
** Tempest: https://review.openstack.org/#/q/project:openstack/tempest+status:open
 +
** Patrole: https://review.openstack.org/#/q/project:openstack/patrole+status:open
 +
** Devstack: https://review.openstack.org/#/q/project:openstack/devstack+status:open
 +
** Grenade: https://review.openstack.org/#/q/project:openstack/grenade+status:open
 +
** Hacking: https://review.opendev.org/#/q/project:openstack/hacking+status:open
 +
* Open Discussion
 +
** [everyone feel free to add their topics under Open Discussion prior to the Office hours with your irc nickname]
  
=== Agenda for October 17 2013 ===
+
* Bug Triage (last 30 min)
* Unblocking of Ceilometer QA testing (jd__, sileht)
+
** https://etherpad.openstack.org/p/qa-bug-triage-caracal
** https://review.openstack.org/#/c/49394/
 
  
=== Agenda for October 10 2013 ===
+
== Previous meetings ==
* Blueprints (sdague)
+
* All previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/qa/.
** started cleaning up blueprints, need to start a purge of all the Unknown items
+
* Old agendas are stored on [[Meetings/QATeamMeeting/OldAgendas]]
* Neutron job status (sdague)
 
* Elastic Recheck Top issues (mtreinish)
 
* Stable branch timing (sdague)
 
* Design Summit Initial Planning (sdague)
 
** QA sessions needed at DS - https://etherpad.openstack.org/icehouse-qa-session-planning
 
* Lot's of new negative tests. Do we want that? (dkranz)
 
** some are "validating strings", like passing long strings or checking for invalid vs. non existent uuids (gfidente)
 
** some are "traversing" the components, like ensuring we can't attach resources to non existent servers (gfidente)
 
** I've the feeling they should not be tagged as 'smoke' ... and maybe a lot not even 'gate'?
 
* Rollout plan for failing builds that pass tempest but with spurious log ERRORs (dkranz)
 
** https://review.openstack.org/#/c/50795/
 
 
 
=== Agenda for October 3 2013 ===
 
* Blueprints (sdague)
 
** started cleaning up blueprints, need to start a purge of all the Unknown items
 
* Neutron job status (sdague)
 
* Elastic Recheck Top issues (mtreinish)
 
* Stable branch timing (sdague)
 
* Design Summit Initial Planning (sdague)
 
** QA sessions needed at DS - https://etherpad.openstack.org/icehouse-qa-session-planning
 
 
 
=== Agenda for September 26 2013 ===
 
* Blueprints (sdague)
 
** neutron testing status (mlavalle)
 
** Bogus errors in logs (dkranz)
 
* rework "skip test" functionality, reprises mkoderer's proposal (gfidente)
 
* Critical Reviews (sdague)
 
=== Agenda for September 19 2013 ===
 
* Blueprints (mtreinish)
 
** neutron testing status (mlavalle)
 
* Critical Reviews (mtreinish)
 
* How to handle bug fixes in launchpad (mtreinish)
 
* Bogus errors in logs one more time (dkranz)
 
 
 
=== Agenda for September 12 2013 ===
 
* Leader for next week's meeting - sdague on a plane back from LinuxCon during this time
 
* New core members (sdague)
 
* Summit planning (sdague)
 
** my intent is to wait until October to evaluate the agenda we want, however as ideas come forward now feel free to register
 
* Blueprints (sdague)
 
* neutron testing status (mlavalle)
 
* whitebox test removal (sdague)
 
** need a volunteer to ensure these tests are covered in Nova unit tests
 
* Critical Reviews (sdague)
 
* OpenStack qa repo for test plans that can be pointed at from blueprints (mkollaro)
 
 
 
=== Agenda for August 29 2013 ===
 
 
 
* Blueprints (mtreinish)
 
** testr status (mtreinish)
 
*** Do we need a way to "incubate" new tests to avoid flakiness with parallel testr? (dkranz)
 
*** Now that parallel testr is in place (wow) maybe we should organize another bug triage day? (gfidente)
 
** stress tests (mkoderer)
 
** neutron testing status (mlavalle)
 
* Update on slow heat gating job (dkranz)
 
* Critical Reviews (mtreinish)
 
* Testing client library compatibility (dkranz)
 
* Devstack independent tempest usage (afazekas)
 
* BP proposal: rework "skip test" functionaly (mkoderer)
 
 
 
 
 
=== Agenda for August 22 2013 ===
 
* Blueprints (mtreinish)
 
** testr parallel status (mtreinish)
 
** stress tests (mkoderer)
 
* Critical Reviews (mtreinish)
 
* Heat test merge (afazekas)
 
* Devstack independent tempest usage (afazekas)
 
* Adding test plans for new features into the tempest repo (mkollaro)
 
 
 
=== Agenda for August 15 2013 ===
 
* Blueprints (mtreinish)
 
** testr parallel status (mtreinish)
 
** stress tests (mkoderer)
 
* Critical Reviews (mtreinish)
 
 
 
=== Agenda for August 8 2013 ===
 
* Volunteers to run meeting while sdague out (sdague)
 
* Blueprints (sdague)
 
* Critical Reviews (sdague)
 
* Stress tests scope and behaviour, also see reviews on https://review.openstack.org/#/c/39752 (gfidente)
 
* Status of slow heat tests (dkranz)
 
 
 
=== Agenda of August 1 2013 ===
 
''See the [http://eavesdrop.openstack.org/meetings/qa/2013/qa.2013-08-01-16.59.html meeting minutes for July 1 on eavesdrop].''
 
 
 
* Blueprints (sdague)
 
* Critical Reviews (sdague)
 
* Call for more Core reviewers (dkranz)
 
 
 
=== Agenda of July 25 2013 ===
 
''See the [http://eavesdrop.openstack.org/meetings/qa/2013/qa.2013-07-25-17.00.html meeting minutes for July 25 on eavesdrop].''
 
 
 
* Blueprints (sdague)
 
** Current state of implementation
 
** Stress Tests https://blueprints.launchpad.net/tempest/+spec/stress-tests (mkoderer)
 
* WebDav status codes in nova? Consistently using the 404 or 422 on actions.
 
* Adding test cases with skip attribute vote? Exact rule (afazekas)
 
* py26 compatibility (afazekas)
 
* Consistent reviewing (afazekas)
 
* Critical Reviews (sdague)
 
* Separate heat job and slow tests in general (dkranz)
 
 
 
 
 
===Agenda of July 18 2013 ===
 
''See the [http://eavesdrop.openstack.org/meetings/qa/2013/qa.2013-07-18-17.00.html meeting minutes for July 18 on eavesdrop].''
 
 
 
* Blueprints (sdague)
 
** Havana-2 status check in - https://launchpad.net/tempest/+milestone/havana-2 (sdague .. et al)
 
** Testr Progress - https://blueprints.launchpad.net/tempest/+spec/speed-up-tempest (mtreinish)
 
** Stress Tests (new Blueprint and findings) - https://blueprints.launchpad.net/tempest/+spec/stress-tests (mkoderer)
 
* Mailing list move (voting on moving to -dev) (sdague)
 
* White Box Tests (owner for discussion?)
 
** Should they really be unit tests?
 
** Current state of implementation
 
** Integration in CI
 
** Adding test cases with skip attribute (afazekas)
 
* Critical Reviews (sdague)
 
 
 
=== Agenda of July 11 2013 ===
 
''See the [http://eavesdrop.openstack.org/meetings/qa/2013/qa.2013-07-11-17.03.html meeting minutes for July 11 on eavesdrop].''
 
 
 
* QA Program Business
 
** PTL Nominations close - see if we need to run election
 
** Program Description
 
* Blueprints
 
** Havana-2 status check in - https://launchpad.net/tempest/+milestone/havana-2
 
** Testr Progress - https://blueprints.launchpad.net/tempest/+spec/speed-up-tempest
 
* Critical Reviews
 
* Stress Tests in CI
 
* Full Open Stack networking gate job
 
* New stress tests in tempest --[[User:M-koderer|m-koderer]] ([[User talk:M-koderer|talk]]) 16:36, 11 July 2013 (UTC)
 
 
 
 
 
=== Agenda of June 27 2013 ===
 
''See the [http://eavesdrop.openstack.org/meetings/qa/2013/qa.2013-06-27-17.01.html meeting minutes for June 27 on eavesdrop].''
 
 
 
* ''nothing in Agenda ... only QA as OpenStack Program, QA Leader and testr topics were discussed little bit''
 

Latest revision as of 14:55, 19 March 2024

Weekly QA Team meeting

The OpenStack Quality Assurance (QA) team Develop, maintain, and initiate tools and plans to ensure the upstream stability and quality of OpenStack, and its release readiness at any point during the release cycle.

The OpenStack Quality Assurance (QA) team holds public weekly Office hours:

Everyone interested in testing, quality assurance, performance engineering, etc, should attend! The meeting minutes of previous meetings can be found here: meeting minutes on eavesdrop

Rules for adding to the agenda:

  • anyone is free to add to proposed agenda, please do so by 1 hr before the Office hours
  • if you add an item to the agenda, please include your ircnick (i.e. sdague) to the end of your item, so we know who did, and who should lead the discussion


Tips to Chair the Office hours:

  • Start this meeting using: #startmeeting qa
  • If nothing much to discuss then we can always finish Office hours any time before 1 hour.
  • Announcement and Priority Items progress (first 2 items of Agenda) can be skipped and need not to be tracked every week.
  • End this meeting using: #endmeeting

Agenda for next Office hours

PING LIST-

/devstack+OR+project:openstack/grenade)

Previous meetings