internal-eval-capture

Community

Convert merged PRs into evaluative harness cases.

Authorpaulingham
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Turns real merged PRs into evaluated harness cases for backfill and oracle detection in internal evaluation workflows.

Core Features & Use Cases

  • Backfill: scan merged PRs, detect oracle-paths matches, and create candidate harness cases for evaluation.
  • Promote: move a candidate from the .candidates pool into the active eval suite.
  • Auto-capture: PostToolUse hook automatically flags and captures harness PRs for evaluation.

Quick Start

Run backfill.sh to generate candidate eval cases from recent merged PRs.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: internal-eval-capture
Download link: https://github.com/paulingham/.claude/archive/main.zip#internal-eval-capture

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 545,000+ vetted skills library on demand.