Jump to: navigation, search

Difference between revisions of "BugTriage"

(Task 1: Confirm new bugs (anyone))
(Add Tempest links)
Line 36: Line 36:
 
[https://bugs.launchpad.net/keystone/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Keystone],
 
[https://bugs.launchpad.net/keystone/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Keystone],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Horizon],
[https://bugs.launchpad.net/quantum/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Quantum]
+
[https://bugs.launchpad.net/quantum/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Quantum],
 +
[https://bugs.launchpad.net/tempest/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Tempest],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Oslo]
 
[https://bugs.launchpad.net/oslo/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Oslo]
  
Line 60: Line 61:
 
[https://bugs.launchpad.net/keystone/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Keystone],
 
[https://bugs.launchpad.net/keystone/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Keystone],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Horizon],
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Quantum]
+
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Quantum],
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Oslo]
+
[https://bugs.launchpad.net/tempest/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Tempest],
 +
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Documentation]
  
Line 74: Line 76:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Quantum],
 +
[https://bugs.launchpad.net/tempest/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Tempest],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Oslo],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Documentation]
Line 87: Line 90:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Quantum],
 +
[https://bugs.launchpad.net/tempest/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Tempest],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Oslo],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Documentation]
Line 116: Line 120:
 
[https://bugs.launchpad.net/horizon/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Quantum],
 +
[https://bugs.launchpad.net/tempest/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Tempest],
 
[https://bugs.launchpad.net/oslo/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Oslo],
 
[https://bugs.launchpad.net/oslo/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Documentation]
Line 129: Line 134:
 
[https://bugs.launchpad.net/keystone/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Keystone],
 
[https://bugs.launchpad.net/keystone/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Keystone],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Horizon],
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Quantum]
+
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Quantum],
 +
[https://bugs.launchpad.net/tempest/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Tempest],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Oslo]
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Oslo]
  
Line 143: Line 149:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Quantum],
 +
[https://bugs.launchpad.net/tempest/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Tempest],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Oslo],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Documentation]
Line 157: Line 164:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Quantum],
 +
[https://bugs.launchpad.net/tempest/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Tempest],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Oslo],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Documentation]
Line 175: Line 183:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Quantum],
 +
[https://bugs.launchpad.net/tempest/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Tempest],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Oslo],
 
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Documentation]

Revision as of 17:20, 5 June 2013

These are the bug triaging tasks, in descending order of priority. Some tasks are accessible to everyone, while some others require bug supervisor rights (usually limited to core teams). Before you start triaging, please learn everything on how we use Bugs !

Task 1: Confirm new bugs (anyone)

When someone files a bug, its state is set to New. The most important step in bug triaging is to provide feedback on that bug and make sure it's a genuine bug.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Tempest, Oslo, Documentation API Docs

Graphs for: Nova, Swift, Glance

  • If the bug description is incomplete or the report is lacking the information necessary to reproduce the issue, you should ask the reporter to provide missing information, and set the bug status to Incomplete
  • If the bug report contains enough information, you can reproduce it (or it looks valid), then you should set its status to Confirmed
  • If the bug has security implications, you should set the security flag (under "This report is public" on the top right)
  • If the bug affects a specific area covered by an official tag, you should set the tag. For example, if the bug is likely to be quite easy to solve, add the low-hanging-fruit tag

While they are at it, people with bug supervisors rights can complete task 2 for the same bug.

Task 2: Prioritize confirmed bugs (bug supervisors)

When someone files a bug, its importance is set to Undecided. Setting importance is pretty critical as it allows to prioritize all the rest of the work correctly.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Tempest, Oslo

  • Based on the bug information, set priority to:
    • Critical if the bug prevents a key feature from working properly (regression) for all users (or without a simple workaround) or result in data loss
    • High if the bug prevents a key feature from working properly for some users (or with a workaround)
    • Medium if the bug prevents a secondary feature from working properly
    • Low if the bug is mostly cosmetic
    • Wishlist if the bug is not really a bug, but rather a welcome change in behavior
  • If the bug contains the solution, or a patch, set the bug status to Triaged

Task 3: Solve inconsistencies (anyone)

Some bugs might end up in an incorrect state. You should fix:

New bugs with a priority set

Status should be set to Confirmed (or In progress if an assignee is set):

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Tempest, Oslo, Documentation

In progress bugs without an assignee

An assignee should bet set, or the bug should return to Confirmed status:

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Tempest, Oslo, Documentation

Task 4: Review incomplete bugs (anyone)

Incomplete bugs should be reassessed regularly.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Tempest, Oslo, Documentation

  • If the reporter provided the requested answer: bug status should be set to Confirmed
  • If the reporter did provide information, but more detail is required: ask for missing information
  • If the reporter did not answer within 2 weeks: Politely remind the reporter to provide missing information, for example:
We cannot solve the issue you reported without more information. Could you please provide the requested information ?
  • If the reporter did not answer the reminder for another 4 weeks: Set the bug status to Invalid with a comment, for example:
This bug lacks the necessary information to effectively reproduce and fix it, therefore it has been closed. Feel free to reopen the bug by providing the requested information and set the bug status back to ''New''.


Task 5: Review stale In Progress bugs (anyone)

Make sure In Progress bugs are actually in progress. Unassign them and set them back to Confirmed or Triaged if not.

Look at first hits in the following lists: Nova, Swift, Glance, Keystone, Horizon, Quantum, Tempest, Oslo, Documentation

Task 6: Review bugs with a patch (bug supervisors)

Some bugs are filed with an attached patch. We should review if the patch looks indeed like a patch, and if yes, set the bug status to Triaged to show that it comes with a likely solution, ready to be implemented.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Tempest, Oslo

Task 7: Review Critical/High bugs (bug supervisors)

We should review all Critical and High bugs to make sure they are still relevant and properly prioritized.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Tempest, Oslo, Documentation

Task 8: Review Medium/Low bugs (bug supervisors)

We should review all Medium and Low bugs to make sure they are still relevant and properly prioritized.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Tempest, Oslo, Documentation

Task 9: Deprecate old wishlist bugs (bug supervisors)

We should review all Wishlist bugs to make sure they are still relevant. Old wishlist bugs (created more than a year ago) should be reviewed to see if they were not accidentally implemented or improperly prioritized. If they really are wishlist items that nobody seems to be interested in implementing, they can be closed as "Opinion" to reduce bug list clutter. You can use the following message:

This wishlist bug has been open a year without any activity. I'm going to move it to "Opinion / Wishlist", which is an easily-obtainable queue of older requests that have come on. This bug can be reopened (set back to "New") if someone decides to work on this.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Tempest, Oslo, Documentation

Task 10: Celebrate!

If you've reached this step, have a beer, it's on me.