Skills
.Work. You
Rest

create-evals

Community

Guides your skill to its first eval suite.

Software Engineering#workflow#onboarding#benchmark#skill-evaluation#test-scenarios#evals.json
Authormatantsach
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Onboarding new skills into an eval workflow can be time-consuming. This skill automates the initiation by analyzing the target SKILL.md, outlining required evals.json structure, and guiding through a phased setup.

Core Features & Use Cases

  • Analyzes the SKILL.md to map core behaviors, input dimensions, and gaps.
  • Generates a plan for 5-8 test scenarios covering happy paths, edge cases, and negatives.
  • Produces an initial evals.json and a safe execution plan for the first benchmark.
  • Asks 1-3 targeted clarifying questions before writing config.

Quick Start

Run this guided flow to generate an initial evals.json and a benchmark plan for a new skill.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: create-evals
Download link: https://github.com/matantsach/snapeval/archive/main.zip#create-evals

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.