evaluate-issue-plan

Evaluate GitHub issue implementation plans against repository code and issue requirements.

Updated Apr 10, 2026
One-click install
npx skills add https://github.com/rjskene/pipeline --skill evaluate-issue-plan
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: evaluate-issue-plan
Source: https://github.com/rjskene/pipeline/tree/main/skills/evaluate-issue-plan
Command: npx skills add https://github.com/rjskene/pipeline --skill evaluate-issue-plan

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill helps teams avoid shipping incorrect or unimplementable work by independently checking a GitHub issue’s posted implementation plan against the actual repository code and context.

Core Features & Use Cases

  • Plan verification against the codebase: Confirms the plan’s factual claims by checking that referenced paths and described behaviors actually exist.
  • Two-phase rigor (spec + implementability): Evaluates whether the plan satisfies the issue requirements without adding scope, and whether an executor could implement it without guessing.
  • Workflow safety via human gates: Enforces trust-based selection of the “Implementation Plan” comment, refuses to proceed on untrusted input, and posts a structured evaluation verdict.

Quick Start

Request evaluation for an issue by telling the AI to run /pipeline:evaluate-issue-plan for issue number N and produce a verdict with discrepancies, missing files, spec gaps, conflict risk, and recommendations.

Frequently Asked Questions about evaluate-issue-plan

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify a GitHub issue implementation plan against my actual codebase?

To verify an implementation plan against your codebase, you can evaluate the posted plan comments for factual accuracy by checking referenced paths and described behaviors against repository code and issue requirements. This process confirms spec compliance and implementability.

What does checking an issue plan for spec compliance and implementability involve?

Checking spec compliance and implementability involves a two-phase evaluation ensuring the plan satisfies issue requirements without adding scope, and confirming an executor could implement it without guessing. This verifies factual claims against existing repository paths and behaviors.

How do I detect file overlap conflicts between an implementation plan and open pull requests?

Detecting file overlap conflicts requires checking the implementation plan's referenced paths against open pull request files. This read-only repo context check identifies potential conflict risks before execution begins, preventing unimplementable work.

Can I apply automated label management to GitHub issues after evaluating a plan?

Yes, you can apply automated label management after evaluating an implementation plan. Following a structured plan evaluation comment, the workflow updates GitHub issue labels to indicate the verified status and readiness for action.

How do I enforce trust-based selection for implementation plan comments in issue triage?

Enforcing trust-based selection involves applying trust-gated logic to only process implementation plan comments authored by trusted users. The evaluation refuses to proceed on untrusted input, ensuring workflow safety during issue triage.

What are the limitations of automated issue plan evaluation for complex workflows?

Automated issue plan evaluation requires trusted-authored implementation plan comments to proceed and relies on read-only repo context checks. It will refuse evaluation on untrusted input and cannot validate plans without explicit pipeline configuration access.