skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

Updated Aug 5, 2026
One-click install
npx skills add https://github.com/amirbiron/claude-skills --skill skill-creator-amirbiron
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/amirbiron/claude-skills/tree/main/skills/skill-creator
Command: npx skills add https://github.com/amirbiron/claude-skills --skill skill-creator-amirbiron

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing a skill that triggers reliably and produces good outputs is hard to do by intuition alone. This Skill guides the full lifecycle of skill development: drafting SKILL.md files, running test prompts with and without the skill, grading results against assertions, and optimizing the description field so the skill triggers when it should. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user about intent, trigger contexts, and output formats, then writes a structured SKILL.md following progressive disclosure and writing-style best practices. - Evaluation Loop: Spawns parallel with-skill and baseline runs, drafts quantitative assertions, grades outputs, and aggregates pass rates, timing, and token usage into benchmark.json via scripts/aggregate_benchmark.py. - Description Optimization: Generates realistic should-trigger and should-not-trigger queries, reviews them in an HTML template, and runs an automated train/test optimization loop to improve triggering accuracy. - Use Case: You want a skill that formats weekly sales reports. This Skill helps you draft it, runs three realistic test prompts against it, shows you a side-by-side review viewer, and iterates until the outputs pass your assertions. ## Quick Start Ask Claude to help you create a new skill for your workflow, and it will interview you, draft the SKILL.md, and set up test cases to verify it works.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?

Start by defining what the skill should do, when it should trigger, and its expected output format. Then write a SKILL.md with name and description frontmatter, draft 2-3 realistic test prompts, and run them with and without the skill to compare results.

How do I test whether my skill actually improves outputs?

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark to see the delta.

How do I optimize a skill description for better triggering?

Generate about 20 realistic queries split between should-trigger and should-not-trigger cases, including tricky near-misses. Run the optimization loop, which evaluates candidate descriptions on a train split and selects the best by held-out test score.

What makes a good skill description for triggering?

A good description states both what the skill does and specific contexts when to use it, since all triggering information lives in the description field. Slightly pushy phrasing listing related keywords and scenarios helps combat undertriggering.

Does skill evaluation work on Claude.ai without subagents?

Yes, but with limitations. Without subagents you run test prompts sequentially yourself, skip baseline comparisons and quantitative benchmarking, and collect qualitative feedback inline instead of using the browser-based review viewer.

Why does my skill keep failing the same assertion across runs?

An assertion that always fails in both configurations may be broken or beyond current capability, while one that always passes everywhere does not differentiate skill value. Check the analyzer notes for non-discriminating or flaky assertions before rewriting the skill.