internal-eval-capture
CommunityConvert merged PRs into evaluative harness cases.
Authorpaulingham
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Turns real merged PRs into evaluated harness cases for backfill and oracle detection in internal evaluation workflows.
Core Features & Use Cases
- Backfill: scan merged PRs, detect oracle-paths matches, and create candidate harness cases for evaluation.
- Promote: move a candidate from the .candidates pool into the active eval suite.
- Auto-capture: PostToolUse hook automatically flags and captures harness PRs for evaluation.
Quick Start
Run backfill.sh to generate candidate eval cases from recent merged PRs.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: internal-eval-capture Download link: https://github.com/paulingham/.claude/archive/main.zip#internal-eval-capture Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 545,000+ vetted skills library on demand.