paw-review-critic

Evaluate generated PR review comments for usefulness and accuracy.

39|6|Updated Oct 8, 2025
One-click install
npx skills add https://github.com/lossyrob/phased-agent-workflow --skill paw-review-critic
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: paw-review-critic
Source: https://github.com/lossyrob/phased-agent-workflow/tree/main/skills/paw-review-critic
Command: npx skills add https://github.com/lossyrob/phased-agent-workflow --skill paw-review-critic

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps reviewers and teams improve PR feedback by critically evaluating generated review comments for usefulness, accuracy, and appropriateness, ensuring decisions are well-supported by evidence.

Core Features & Use Cases

  • Assessment engine: Reads ReviewComments.md and all related artifacts (GapAnalysis.md, CodeResearch.md, ImpactAnalysis.md, DerivedSpec.md) to form a comprehensive evaluation of each comment.
  • Structured reasoning: Adds detailed assessments after each comment rationale, including usefulness, accuracy, alternative perspectives, trade-offs, and recommendations.
  • Quality gate for posting: Produces clear guidance for whether a comment should be posted, modified, or skipped, and aggregates an iteration summary for auditability.

Quick Start

To begin, load the ReviewComments.md and supporting artifacts, generate internal assessments for every inline and thread comment, then append the assessments and an Iteration Summary to the document.

Frequently Asked Questions about paw-review-critic

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate the usefulness and accuracy of automated pull request review comments?

To evaluate pull request review comments, load ReviewComments.md and related artifacts like GapAnalysis.md and CodeResearch.md to form a comprehensive assessment of each comment's usefulness, accuracy, and appropriateness before posting.

What is the best way to ensure automated code review feedback is actionable?

The best way to ensure actionable code review feedback is to apply an internal assessment protocol that adds detailed reasoning, alternative perspectives, and trade-offs to each comment, producing clear guidance to post, modify, or skip feedback.

How do I assess batched and threaded PR comments for alignment with impact analysis artifacts?

Assess batched and threaded PR comments by reading ReviewComments.md alongside ImpactAnalysis.md and DerivedSpec.md, generating internal evaluations that check alignment with these supporting artifacts for evidence-based decisions.

Can I generate an audit trail for skipped or modified code review comments?

Yes, you can generate an audit trail by appending an Iteration Summary to the review document, which aggregates clear guidance on whether each comment was posted, modified, or skipped for full auditability.

Does this PR comment assessment approach work without dependency on external comment analysis tools?

Yes, the PR comment assessment approach works without external dependencies, relying solely on loading internal markdown artifacts and applying a structured reasoning protocol to evaluate comment quality.