Jump to: navigation, search

Difference between revisions of "BugTriage"

(adding openstack-manuals)
Line 14: Line 14:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status=NEW&field.importance=UNDECIDED Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status=NEW&field.importance=UNDECIDED Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status=NEW&field.importance=UNDECIDED Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status=NEW&field.importance=UNDECIDED Quantum],
 +
[https://bugs.launchpad.net/oslo/+bugs?field.status=NEW&field.importance=UNDECIDED Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status=NEW&field.importance=UNDECIDED Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status=NEW&field.importance=UNDECIDED Documentation]
  
Line 37: Line 38:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Quantum]
 
[https://bugs.launchpad.net/quantum/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Quantum]
 +
[https://bugs.launchpad.net/oslo/+bugs?field.status=CONFIRMED&field.importance=UNDECIDED Oslo]
  
 
* Based on the bug information, set priority to:
 
* Based on the bug information, set priority to:
Line 60: Line 62:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Quantum]
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Quantum]
 +
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Oslo]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=NEW&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW&field.importance%3Alist=WISHLIST Documentation]
  
Line 72: Line 75:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Quantum],
 +
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=INPROGRESS&assignee_option=none Documentation]
  
Line 84: Line 88:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Quantum],
 +
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE Documentation]
  
Line 112: Line 117:
 
[https://bugs.launchpad.net/horizon/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Quantum],
 +
[https://bugs.launchpad.net/oslo/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?orderby=date_last_updated&field.status%3Alist=INPROGRESS&assignee_option=any Documentation]
  
Line 125: Line 131:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Quantum]
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Quantum]
 +
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.has_patch=on Oslo]
  
 
== Task 7: Review Critical/High bugs (bug supervisors) ==
 
== Task 7: Review Critical/High bugs (bug supervisors) ==
Line 137: Line 144:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Quantum],
 +
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH Documentation]
  
Line 150: Line 158:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Quantum],
 +
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance%3Alist=MEDIUM&field.importance%3Alist=LOW Documentation]
  
Line 163: Line 172:
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Horizon],
 
[https://bugs.launchpad.net/horizon/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Horizon],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Quantum],
 
[https://bugs.launchpad.net/quantum/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Quantum],
 +
[https://bugs.launchpad.net/oslo/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Oslo],
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Documentation]
 
[https://bugs.launchpad.net/openstack-manuals/+bugs?field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.importance=WISHLIST Documentation]
  

Revision as of 12:20, 12 January 2013

How to triage OpenStack bugs

These are the bug triaging tasks, in descending order of priority. Some tasks are accessible to everyone, while some others require bug supervisor rights (usually limited to core teams). Before you start triaging, please learn everything on how we use Bugs !

Task 1: Confirm new bugs (anyone)

When someone files a bug, its state is set to New. The most important step in bug triaging is to provide feedback on that bug and make sure it's a genuine bug.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Oslo, Documentation

Graphs for: Nova, Swift, Glance

  • If the bug description is incomplete or the report is lacking the information necessary to reproduce the issue, you should ask the reporter to provide missing information, and set the bug status to Incomplete
  • If the bug report contains enough information, you can reproduce it (or it looks valid), then you should set its status to Confirmed
  • If the bug has security implications, you should set the security flag (under "This report is public" on the top right)
  • If the bug affects a specific area covered by an official tag, you should set the tag. For example, if the bug is likely to be quite easy to solve, add the low-hanging-fruit tag

While they are at it, people with bug supervisors rights can complete task 2 for the same bug.

Task 2: Prioritize confirmed bugs (bug supervisors)

When someone files a bug, its importance is set to Undecided. Setting importance is pretty critical as it allows to prioritize all the rest of the work correctly.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum Oslo

  • Based on the bug information, set priority to:
    • Critical if the bug prevents a key feature from working properly (regression) for all users (or without a simple workaround) or result in data loss
    • High if the bug prevents a key feature from working properly for some users (or with a workaround)
    • Medium if the bug prevents a secondary feature from working properly
    • Low if the bug is mostly cosmetic
    • Wishlist if the bug is not really a bug, but rather a welcome change in behavior
  • If the bug contains the solution, or a patch, set the bug status to Triaged

Task 3: Solve inconsistencies (anyone)

Some bugs might end up in an incorrect state. You should fix:

New bugs with a priority set

Status should be set to Confirmed (or In progress if an assignee is set):

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum Oslo Documentation

In progress bugs without an assignee

An assignee should bet set, or the bug should return to Confirmed status:

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Oslo, Documentation

Task 4: Review incomplete bugs (anyone)

Incomplete bugs should be reassessed regularly.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Oslo, Documentation

  • If the reporter provided the requested answer: bug status should be set to Confirmed
  • If the reporter did provide information, but more detail is required: ask for missing information
  • If the reporter did not answer within 2 weeks: Politely remind the reporter to provide missing information, for example:
We cannot solve the issue you reported without more information. Could you please provide the requested information ?
  • If the reporter did not answer the reminder for another 4 weeks: Set the bug status to Invalid with a comment, for example:
This bug lacks the necessary information to effectively reproduce and fix it, therefore it has been closed. Feel free to reopen the bug by providing the requested information and set the bug status back to ''New''.


Task 5: Review stale In Progress bugs (anyone)

Make sure In Progress bugs are actually in progress. Unassign them and set them back to Confirmed or Triaged if not.

Look at first hits in the following lists: Nova, Swift, Glance, Keystone, Horizon, Quantum, Oslo, Documentation

Task 6: Review bugs with a patch (bug supervisors)

Some bugs are filed with an attached patch. We should review if the patch looks indeed like a patch, and if yes, set the bug status to Triaged to show that it comes with a likely solution, ready to be implemented.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum Oslo

Task 7: Review Critical/High bugs (bug supervisors)

We should review all Critical and High bugs to make sure they are still relevant and properly prioritized.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Oslo, Documentation

Task 8: Review Medium/Low bugs (bug supervisors)

We should review all Medium and Low bugs to make sure they are still relevant and properly prioritized.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Oslo, Documentation

Task 9: Review wishlist bugs (bug supervisors)

We should review all Wishlist bugs to make sure they are still relevant and properly prioritized.

Lists for: Nova, Swift, Glance, Keystone, Horizon, Quantum, Oslo, Documentation

Task 10: Celebrate !

If you've reached this step, have a beer, it's on me.