Jump to: navigation, search

Difference between revisions of "Meetings/QATeamMeeting"

(Proposed Agenda for December 12 2013 (22 UTC))
(Proposed Agenda for December 12 2013 (22 UTC))
Line 19: Line 19:
 
** Report on https://bugs.launchpad.net/neutron/+bug/1251448 (sixth top bug in the gate this week) and its relationship to https://bugs.launchpad.net/tempest/+bug/1259282 (mlavalle)
 
** Report on https://bugs.launchpad.net/neutron/+bug/1251448 (sixth top bug in the gate this week) and its relationship to https://bugs.launchpad.net/tempest/+bug/1259282 (mlavalle)
 
* Bug status
 
* Bug status
 +
** How should we handle bug traffic after we finish the current purge to make sure the noise doesn't come back?
 +
** Rotating dispatcher for incoming bugs?
 +
** Ask people to put a logstash query in bug tickets that are about test failures?
 
* Critical Reviews
 
* Critical Reviews
 
* We should consider putting a fast-track on heat and ceilometer tests since they are integrated but lacking. (dkranz)
 
* We should consider putting a fast-track on heat and ceilometer tests since they are integrated but lacking. (dkranz)

Revision as of 18:34, 12 December 2013

Weekly QA Team meeting

The OpenStack QA Team holds public weekly meetings in #openstack-meeting, 'Thursday alternating every week between 17:00 UTC and 22:00 UTC.
Everyone interested in testing, quality assurance, performance engineering, etc, should attend!

The meeting minutes of can be found here: meeting minutes on everdrop

Rules for adding to the agenda:

  • anyone is free to add to proposed agenda, please do so by 1 hr before the meeting
  • if you add an item to the agenda, please include your ircnick (i.e. sdague) to the end of your item, so we know who did, and who should lead the discussion

Proposed Agenda for December 12 2013 (22 UTC)

  • Blueprints
    • Current state
    • Status updates from people
  • Neutron testing
  • Bug status
    • How should we handle bug traffic after we finish the current purge to make sure the noise doesn't come back?
    • Rotating dispatcher for incoming bugs?
    • Ask people to put a logstash query in bug tickets that are about test failures?
  • Critical Reviews
  • We should consider putting a fast-track on heat and ceilometer tests since they are integrated but lacking. (dkranz)
  • Should we have more specialization on the Core review team? e.g. I am comfortable with the nova v3 patches, but no where on neutron. (dkranz)
  • What shall we do with the blueprints asking for more tests on specific functionalities of "covered" components? And, are bugs instead appropriate for these? Would a *single* wiki page work for the purpose? (gfidente)

Previous meetings

All previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/qa/.

Agenda for December 5 2013

  • Meeting time change proposal
  • Getting additional folks signed up as point people
    • Meeting organizer - mtreinish voluteered
    • Blueprint Triage point person - need volunteer
    • Bug Triage point person - need volunteer
  • Blueprints
    • Current state
    • Status updates from people
  • Neutron testing
  • Critical Reviews
  • How can we make sure reviews don't slide >1 week (dkranz)

Agenda for November 21 2013

  • Blueprints
  • Negative testing (mkoderer/dkranz)
  • Neutron testing: Discussion of what needs to happen for the sprint in January to take place / succeed? What do we need to accomplish by mid-December to make sure the sprint happens? (mlavalle)
  • Critical Reviews

Agenda for November 14 2013

  • Possible Meeting Time change to include .jp (sdague)
  • Blueprints
    • Blueprints breakdown (sdague)
    • Negative testing (mkoderer/dkranz)
  • Neutron testing
  • How should we sync the teams (neutron/scenario test)? One BP with work items, bugs or ML? (mkoderer)
  • Onboarding documentation - where should we put it? (mkoderer)
  • Critical Reviews (sdague)

Agenda for October 24 2013

  • Design Summit Schedule (sdague)
  • Neutron job status (mtreinish)
  • Scope and place for performance testing such as Rally (dkranz)
  • Status and roll-out plan for failing the gate on log errors (dkranz)
  • State of 'smoke' tagging: can we make it useful? (dkranz)
  • Tempest config reorg and cleanup (mtreinish)

Agenda for October 17 2013

Agenda for October 10 2013

  • Blueprints (sdague)
    • started cleaning up blueprints, need to start a purge of all the Unknown items
  • Neutron job status (sdague)
  • Elastic Recheck Top issues (mtreinish)
  • Stable branch timing (sdague)
  • Design Summit Initial Planning (sdague)
  • Lot's of new negative tests. Do we want that? (dkranz)
    • some are "validating strings", like passing long strings or checking for invalid vs. non existent uuids (gfidente)
    • some are "traversing" the components, like ensuring we can't attach resources to non existent servers (gfidente)
    • I've the feeling they should not be tagged as 'smoke' ... and maybe a lot not even 'gate'?
  • Rollout plan for failing builds that pass tempest but with spurious log ERRORs (dkranz)

Agenda for October 3 2013

  • Blueprints (sdague)
    • started cleaning up blueprints, need to start a purge of all the Unknown items
  • Neutron job status (sdague)
  • Elastic Recheck Top issues (mtreinish)
  • Stable branch timing (sdague)
  • Design Summit Initial Planning (sdague)

Agenda for September 26 2013

  • Blueprints (sdague)
    • neutron testing status (mlavalle)
    • Bogus errors in logs (dkranz)
  • rework "skip test" functionality, reprises mkoderer's proposal (gfidente)
  • Critical Reviews (sdague)

Agenda for September 19 2013

  • Blueprints (mtreinish)
    • neutron testing status (mlavalle)
  • Critical Reviews (mtreinish)
  • How to handle bug fixes in launchpad (mtreinish)
  • Bogus errors in logs one more time (dkranz)

Agenda for September 12 2013

  • Leader for next week's meeting - sdague on a plane back from LinuxCon during this time
  • New core members (sdague)
  • Summit planning (sdague)
    • my intent is to wait until October to evaluate the agenda we want, however as ideas come forward now feel free to register
  • Blueprints (sdague)
  • neutron testing status (mlavalle)
  • whitebox test removal (sdague)
    • need a volunteer to ensure these tests are covered in Nova unit tests
  • Critical Reviews (sdague)
  • OpenStack qa repo for test plans that can be pointed at from blueprints (mkollaro)

Agenda for August 29 2013

  • Blueprints (mtreinish)
    • testr status (mtreinish)
      • Do we need a way to "incubate" new tests to avoid flakiness with parallel testr? (dkranz)
      • Now that parallel testr is in place (wow) maybe we should organize another bug triage day? (gfidente)
    • stress tests (mkoderer)
    • neutron testing status (mlavalle)
  • Update on slow heat gating job (dkranz)
  • Critical Reviews (mtreinish)
  • Testing client library compatibility (dkranz)
  • Devstack independent tempest usage (afazekas)
  • BP proposal: rework "skip test" functionaly (mkoderer)


Agenda for August 22 2013

  • Blueprints (mtreinish)
    • testr parallel status (mtreinish)
    • stress tests (mkoderer)
  • Critical Reviews (mtreinish)
  • Heat test merge (afazekas)
  • Devstack independent tempest usage (afazekas)
  • Adding test plans for new features into the tempest repo (mkollaro)

Agenda for August 15 2013

  • Blueprints (mtreinish)
    • testr parallel status (mtreinish)
    • stress tests (mkoderer)
  • Critical Reviews (mtreinish)

Agenda for August 8 2013

  • Volunteers to run meeting while sdague out (sdague)
  • Blueprints (sdague)
  • Critical Reviews (sdague)
  • Stress tests scope and behaviour, also see reviews on https://review.openstack.org/#/c/39752 (gfidente)
  • Status of slow heat tests (dkranz)

Agenda of August 1 2013

See the meeting minutes for July 1 on eavesdrop.

  • Blueprints (sdague)
  • Critical Reviews (sdague)
  • Call for more Core reviewers (dkranz)

Agenda of July 25 2013

See the meeting minutes for July 25 on eavesdrop.

  • Blueprints (sdague)
  • WebDav status codes in nova? Consistently using the 404 or 422 on actions.
  • Adding test cases with skip attribute vote? Exact rule (afazekas)
  • py26 compatibility (afazekas)
  • Consistent reviewing (afazekas)
  • Critical Reviews (sdague)
  • Separate heat job and slow tests in general (dkranz)


Agenda of July 18 2013

See the meeting minutes for July 18 on eavesdrop.

Agenda of July 11 2013

See the meeting minutes for July 11 on eavesdrop.


Agenda of June 27 2013

See the meeting minutes for June 27 on eavesdrop.

  • nothing in Agenda ... only QA as OpenStack Program, QA Leader and testr topics were discussed little bit