Latest revision as of 15:27, 5 September 2023

Weekly QA Team meeting

The OpenStack Quality Assurance (QA) team Develop, maintain, and initiate tools and plans to ensure the upstream stability and quality of OpenStack, and its release readiness at any point during the release cycle.

The OpenStack Quality Assurance (QA) team holds public weekly Office hours:

• Channel: #openstack-qa
• Time: Tuesday every week at 15:00 UTC.
• ical - http://eavesdrop.openstack.org/#QA_Team_Office_hours

Everyone interested in testing, quality assurance, performance engineering, etc, should attend! The meeting minutes of previous meetings can be found here: meeting minutes on eavesdrop

Rules for adding to the agenda:

• anyone is free to add to proposed agenda, please do so by 1 hr before the Office hours
• if you add an item to the agenda, please include your ircnick (i.e. sdague) to the end of your item, so we know who did, and who should lead the discussion

Tips to Chair the Office hours:

• Start this meeting using: #startmeeting qa
• If nothing much to discuss then we can always finish Office hours any time before 1 hour.
• Announcement and Priority Items progress (first 2 items of Agenda) can be skipped and need not to be tracked every week.
• End this meeting using: #endmeeting

Agenda for next Office hours

PING LIST-

• Announcement and Action Item (Optional)
• Bobcat Priority Items progress
  • go through the zed priority items list and try to plan the work / highlight milestones
    • https://etherpad.opendev.org/p/qa-bobcat-priority
• OpenStack Events Updates and Planning
  • <This includes the OpenStack Summit and PTG updates and planning>
  • Summit & PTG
    • the next PTG will be held virtually, October 23-27, 2023 - https://openinfra.dev/ptg/
      • etherpad: TBA
      • registration: http://ptg2023.openinfra.dev/
    • PTG in person during the summit, June 13-15, 2023 - https://openinfra.dev/summit/vancouver-2023/
      • etherpad: https://etherpad.opendev.org/p/vancouver-june2023-qa
• Gate Status / Fix Checks
  • <not just QA projects gate but any other project gate also where QA team can help>
  • Gate Blocker Fix / Urgent Change
    • https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)
  • Bare Recheck tracking:
    • https://etherpad.opendev.org/p/recheck-weekly-summary
      • QA is doing 68.42 % of recheck as bare recheck which is not good.
        • update from August 2nd - 33,33%
        • update from November 1st - 14,29%
        • update from November 29th - 18% (out of 28 rechecks)
        • update from January 10th - 18% (out of 158 rechecks)
        • update from May 9th - 11% (out of 223 rechecks)
    • #info STOP DOING BARE RECHECKS aka. 'recheck' https://docs.openstack.org/project-team-guide/testing.html#how-to-handle-test-failures
• Periodic jobs Status Checks
  • Periodic stable full: https://zuul.openstack.org/builds?pipeline=periodic-stable&job_name=tempest-full-yoga&job_name=tempest-full-xena&job_name=tempest-full-zed&job_name=tempest-full-2023-1
  • Periodic stable slow: https://zuul.openstack.org/builds?job_name=tempest-slow-2023-1&job_name=tempest-slow-zed&job_name=tempest-slow-yoga&job_name=tempest-slow-xena
  • Periodic extra tests: https://zuul.openstack.org/builds?job_name=tempest-full-2023-1-extra-tests&job_name=tempest-full-zed-extra-tests&job_name=tempest-full-yoga-extra-tests&job_name=tempest-full-xena-extra-tests
  • Periodic master: https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic
• Distros check:
  • Centos 9: https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=0
  • Debian: https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&job_name=devstack-platform-debian-bookworm&skip=0
  • Rocky: https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx
  • openEuler: https://zuul.openstack.org/builds?job_name=devstack-platform-openEuler-22.03-ovn-source&skip=0
  • jammy: https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-ubuntu-jammy-ovn-source&job_name=devstack-platform-ubuntu-jammy-ovs&skip=0
• Sub Teams highlights (Sub Teams means individual projects under QA program)
  • Tempest
    • https://review.openstack.org/#/q/project:openstack/tempest+status:open
  • Patrole
    • https://review.openstack.org/#/q/project:openstack/patrole+status:open
  • Devstack
    • https://review.openstack.org/#/q/project:openstack/devstack+status:open
  • Grenade
    • https://review.openstack.org/#/q/project:openstack/grenade+status:open
  • Hacking
    • https://review.opendev.org/#/q/project:openstack/hacking+status:open
  • Changes with Review-Priority == +1
    • https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)
• Open Discussion
  • [everyone feel free to add their topics under Open Discussion prior to the Office hours with your irc nickname]

• Bug Triage (last 30 min)
  • https://etherpad.openstack.org/p/qa-bug-triage-bobcat

Previous meetings

• All previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/qa/.
• Old agendas are stored on Meetings/QATeamMeeting/OldAgendas