Jump to: navigation, search

Difference between revisions of "Documentation/ReviewGuidelines"

(Considerations for Documentation Aligned with Release Cycles)
(Review Scoring and Approvals)
Line 61: Line 61:
 
## A core reviewer can approve a patch with +4 points, typically after it obtains two +2 scores from other core reviewers.
 
## A core reviewer can approve a patch with +4 points, typically after it obtains two +2 scores from other core reviewers.
 
## A core reviewer can +2 score a patch with a +2 score from another core reviewer and approve it.
 
## A core reviewer can +2 score a patch with a +2 score from another core reviewer and approve it.
 +
## A core reviewer can +2 score a patch with two +1 from other reviewers and approve it.
  
 
Note: If you find an issue with a patch that already has a +2 score from another core reviewer, consider commenting on the issue and scoring the patch with a 0 rather than scoring it with a -1.
 
Note: If you find an issue with a patch that already has a +2 score from another core reviewer, consider commenting on the issue and scoring the patch with a 0 rather than scoring it with a -1.

Revision as of 05:17, 27 July 2014

Goal

Provide guidelines to improve the quality and speed of the documentation review process.

Critique Categories

Objective

  1. Commit message
    1. Content
    2. Conventions
      1. Tags
  2. Patch
    1. Content
    2. Conventions
    3. Grammar
    4. Style/Phrasing/Wording
    5. Spelling

Subjective

  1. Commit message
    1. Grammar
    2. Spelling
    3. Style/Phrasing/Wording
  2. Patch
    1. Grammar
    2. Style/Phrasing/Wording
    3. Other suggestions

Scope

  1. Try to keep reviews limited to the contents of the bug, contents of the commit message, and changes made by the patch. In other words, if the patch solves the stated problem, but there are other improvements it could lead to, approve the patch and file a subsequent bug, rather than -1'ing the patch with a comment about improvements.

Consistency

  1. If you find an issue, do your best to mark all instances of it.
    1. If the author uploads a patch correcting your objective issue and you find another instance that you didn't mark, comment on it and score with a -1. Preferably, upload a patch to fix it.
    2. If the author uploads a patch correcting your subjective issue and you find another instance that you didn't mark, comment on it and score with a 0.
    3. If the author uploads a patch correcting your objective and/or subjective issue and you find another objective issue, comment on it and score with a -1. Preferably, upload a patch to fix it.
    4. If the author uploads a patch correcting your objective and/or subjective issue and you find another subjective issue, comment on it and score with a 0.
  2. If you find an issue that could affect other portions of a book, provide appropriate comments, score the patch with a -1, and consider mentioning your issue on the mailing list or in a meeting.
    1. Example: A new service uses "key = value" in the configuration file and all other services use "key=value" in their configuration files. Both methods work, but the book should maintain consistency.

Tagging Additional Reviewers

  1. In some cases, you should tag one or more people with interest in or experience with the content of your patch to review it.
    1. How long should an author wait for reviews by these people?

The Waiting Game

  1. After the first review with a 0 or -1 score, how long should an author wait for additional reviews before addressing issues in the first review?

Review Scoring and Approvals

  1. Scores available to contributors
    1. -1, 0, +1
  2. Scores available to core reviewers
    1. -2, -1, 0, +1, +2
  3. Approvals
    1. A core reviewer can approve a patch with +4 points, typically after it obtains two +2 scores from other core reviewers.
    2. A core reviewer can +2 score a patch with a +2 score from another core reviewer and approve it.
    3. A core reviewer can +2 score a patch with two +1 from other reviewers and approve it.

Note: If you find an issue with a patch that already has a +2 score from another core reviewer, consider commenting on the issue and scoring the patch with a 0 rather than scoring it with a -1.

Considerations for Documentation Aligned with Release Cycles

  1. Beginning with milestone releases, shift focus to objective issues, especially with new services and existing services with significant changes. Only patches with significant subjective issues should receive a -1 score. Otherwise, comment on subjective issues and score with a 0.
  2. Beginning with release candidates, focus almost entirely on content issues. Only comment on subjective issues if the patch should receive a -1 score for objective issues.