eval-driven-development

Define rubrics, run baseline evaluations, and compare before-and-after outcomes.

Updated Oct 17, 2017
One-click install
npx skills add https://github.com/NAKKA-K/dotfiles --skill eval-driven-development-nakka-k
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: eval-driven-development
Source: https://github.com/NAKKA-K/dotfiles/tree/main/claude/skills/eval-driven-development
Command: npx skills add https://github.com/NAKKA-K/dotfiles --skill eval-driven-development-nakka-k

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

ルーブリック駆動で計測可能な改善を行うための EDD ワークフロー。スキル、プロンプト、設定など、変更前後で品質を評価できるあらゆる成果物を変更するときに使用する。先に評価基準を定義し、現状をベースラインとして採点し、変更を実施してから、変更前後を比較して改善を確認する。

Core Features & Use Cases

  • ルーブリック作成と適用: 変更を評価するための基準を設計・適用します。
  • ベースライン評価と比較: 変更前後の成果物を定量的に比較します。
  • Use Case: Claude Code ワークフローの品質向上を、定義済み基準で検証する。

Quick Start

Define your rubric and run the evaluation to compare baseline and post-change outcomes.

Frequently Asked Questions about eval-driven-development

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I measure prompt quality improvements using a rubric?

To measure prompt quality improvements, this Skill helps you define an evaluation rubric, score the baseline prompt, implement changes, and compare the before-and-after outcomes quantitatively. It provides a structured workflow to verify that modifications actually enhance performance against your defined criteria.

What is rubric-driven evaluation for software artifacts?

Rubric-driven evaluation is a workflow where you define explicit quality criteria before making changes to artifacts like skills, prompts, or configurations. It establishes a baseline measurement and then compares post-change outcomes to ensure improvements are measurable and aligned with your standards.

How do I compare baseline and post-change outcomes for configuration updates?

You can compare baseline and post-change outcomes by first scoring the current configuration against a designed rubric. After implementing the configuration updates, the Skill evaluates the new version and contrasts the scores to validate whether the changes produced the desired quality gains.

Can I use this workflow to evaluate Claude Code configurations?

Yes, you can use this workflow to evaluate Claude Code configurations and workflows. It is applicable to any artifact where explicit before-and-after evaluation is required, allowing you to validate quality assurance improvements against predefined rubric standards.

What is the best way to establish a baseline before modifying a prompt?

The best way to establish a baseline is to define your evaluation rubric first, then apply it to score the current prompt before making any modifications. This baseline score serves as the quantitative reference point for comparing post-change results.