Coordinate capture, run, score, and validate sub-skills into an end-to-end evaluation workflow.
npx skills add https://github.com/paulingham/.claude --skill internal-eval
Please help me install this Agent Skill. Skill: internal-eval Source: https://github.com/paulingham/.claude/tree/main/skills/internal-eval Command: npx skills add https://github.com/paulingham/.claude --skill internal-eval
Coordinates the end-to-end evaluation of harness runs by orchestrating intake, planning, building, reviewing, final verification, shipping, deploying learnings, and recording verdicts to gate changes.
Run the top-level run-suite.sh to execute the full evaluation pipeline across all cases.
High-intent search queries and answers about installing and using this skill.
To orchestrate end-to-end harness evaluation, you can coordinate capture, run, score, and validate sub-skills to produce deterministic per-run verdicts and regression reports. This workflow gates harness changes consistently across privacy, baseline capture, and diffing tasks.
Test harness isolation separates inner pipelines from outer orchestration during nested runs to prevent state leakage. It enforces governance rules across evaluation phases, ensuring that baseline capture and regression scoring remain accurate and deterministic.
You generate audit-friendly regression reports by running the full evaluation pipeline, which coordinates intake, scoring, and validation. It writes structured results for downstream tooling, tracking improvements and regressions to gate harness changes.
Yes, you can use this evaluation orchestration workflow without external dependencies. It operates standalone to coordinate intake, planning, building, reviewing, and shipping phases, producing structured verdicts to gate changes across privacy and diffing tasks.
You run the full evaluation pipeline across all cases by executing the top-level run-suite.sh script. This coordinates the end-to-end workflow across multiple phases and sub-skills, producing per-run verdicts and deploying learnings.
paulinghamOrchestrate isolated inner-pipeline eval runs with concurrency and structured JSON reporting.
profmikegreeneParses pilot plans and hypotheses into structured JSON or tabular data for downstream analysis.
yiwei79Evaluate Architect Review deliverables against Stage 6 PASS/FAIL criteria.
project-axAutomate AX platform regression tests with Node.js and Bun test runners.
