evaluate-issue-pr

Evaluate pull requests against approved implementation plans with CI checks.

Updated Apr 10, 2026
One-click install
npx skills add https://github.com/rjskene/pipeline --skill evaluate-issue-pr
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: evaluate-issue-pr
Source: https://github.com/rjskene/pipeline/tree/main/skills/evaluate-issue-pr
Command: npx skills add https://github.com/rjskene/pipeline --skill evaluate-issue-pr

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires gh, jq, timeout, bash, realpath, npm, npx tsc.

What problem does it solve?

It independently checks whether a submitted pull request correctly implements an already-approved implementation plan, and produces a clear approval or flagged verdict to protect merges.

Core Features & Use Cases

  • Trust-gated plan retrieval: Only a trusted-authored “Implementation Plan” comment is used as the source of truth for what the PR must implement.
  • Plan compliance verification: Confirms each plan item’s “Files to change” and required categories (DB schema/API/frontend/tests), and flags missing or incorrect work while avoiding unnecessary refactors.
  • Quality and safety review: Runs typechecking and tests, then inspects the diff for issues like leftover debug code, missing error handling, injection/XSS risks, and insufficient test coverage.
  • CI-aware decisioning: Detects failed/cancelled CI checks and prevents approval when the PR is red, retrying with a fix when allowed by budget.
  • Optional visual proof adjudication: For PRs/issue flows that require browser evidence, it invokes the relevant visual-proof skill and flags unsatisfied claims for human review.
  • Auto-merge gate enforcement: When conditions are satisfied (and not opted out), it performs a controlled merge with safeguards like base-branch TOCTOU re-checks and screenshot URL rewriting for durability.

Quick Start

Use /pipeline:evaluate-issue-pr <issue_number> inside the feature worktree to review the PR against its trusted implementation plan and post an evaluation verdict.

Frequently Asked Questions about evaluate-issue-pr

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify a pull request matches an approved implementation plan?

To verify a pull request matches an approved implementation plan, you can use an automated evaluation gate that retrieves the trusted plan, checks the diff against required files and categories, and runs typecheck and tests to produce a clear approval verdict.

Can I prevent merging when CI checks fail on a pull request?

Yes, you can prevent merging when CI checks fail by using a merge gate that detects failed or cancelled CI statuses, blocks approval for red PRs, and optionally retries with a fix when permitted by budget.

How do I check the diff for security risks and missing error handling automatically?

You can check the diff automatically for security risks and missing error handling by running a quality review that inspects PR changes to flag leftover debug code, injection/XSS risks, and insufficient test coverage.

Does the PR review process support visual proof verification for browser evidence?

Yes, the PR review process supports visual proof verification by invoking a visual-proof skill to adjudicate browser evidence, checking screenshot claims and flagging unsatisfied requirements for human review.

What dependencies do I need to run typecheck and merge gate verification on GitHub PRs?

To run typecheck and merge gate verification on GitHub PRs, you need command-line dependencies including gh, jq, timeout, bash, realpath, npm, and npx tsc installed in your execution environment.

When should I not use an automated auto-merge gate for pull requests?

You should not use an automated auto-merge gate when you need manual control over the integration process, or when your workflow does not rely on a pre-approved implementation plan to dictate the required file changes and test coverage.