evals-e2e-run

Score a feature's storm, design, plan, and implementation artefacts for quality and consistency.

Updated May 26, 2026
One-click install
npx skills add https://github.com/cagriy/dev-skills --skill evals-e2e-run-cagriy
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: evals-e2e-run
Source: https://github.com/cagriy/dev-skills/tree/main/skills/evals-e2e-run
Command: npx skills add https://github.com/cagriy/dev-skills --skill evals-e2e-run-cagriy

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? After a feature travels through brainstorm, design, plan, and implementation stages, there is no objective measure of whether each artefact was well-made or whether each stage faithfully carried forward the previous one's commitments. This Skill scores that entire chain so quality is measured rather than assumed. ## Core Features & Use Cases - Artefact quality scoring: Judges storm, design, and plan documents against detailed rubrics (testability, scope decisiveness, component decomposition, TDD discipline, and more), producing 0-100 scores. - Stage-to-stage consistency checks: Verifies that the design honors the storm, the plan honors the design, and the implementation commits honor all three, flagging silently dropped or contradicted requirements. - Parallel subagent evaluation: Runs one read-only subagent per eval with a strict output contract, then validates, recomputes, and appends results as JSON entries to ~/.claude/evals/design.json. - Use Case: Right after /feature-implement lands its stage commits, run this Skill to get a score table showing how well each artefact and hand-off performed, plus improvement recommendations for any score below 80. ## Quick Start Ask the assistant to run end-to-end evals on the feature you just implemented so it scores the storm, design, plan, and code consistency and appends the results to the eval log.

Frequently Asked Questions about evals-e2e-run

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate a feature after implementing it with AI?

Run the evals-e2e-run skill after the implementation stage commits land. It resolves the latest feature folder, scores the storm, design, and plan artefacts plus code consistency, and appends one JSON entry per eval to ~/.claude/evals/design.json.

What does end-to-end feature evaluation score?

It scores artefact quality (storm_quality, design_quality, plan_quality) against fixed rubrics and stage-to-stage consistency (design vs storm, plan vs design, code vs each artefact). Every score is 0-100, and scores below 80 include a recommendation for the responsible skill.

Does the eval skill modify my repository or commits?

No. It is strictly read-only with respect to the repo: it never modifies, stages, commits, or pushes project files. Its only write is the eval log at ~/.claude/evals/design.json, plus a backup copy if that log is corrupt.

What happens if my branch has no upstream or no stage commits?

The skill falls back to the highest-versioned feature folder and skips the three code_* consistency evals when there is no implementation change set. Artefact quality evals still run, and skipped evals are noted in the summary without writing log entries.

Why did an eval get skipped or produce no log entry?

An eval is skipped when its required inputs are missing, such as a storm document or an implementation change set. Skipped evals write nothing to the log, so consumers must key on the eval-type field rather than entry position.