skill-creator

Create, evaluate, and iteratively improve SKILL.md skills with benchmarked test runs.

Updated May 24, 2026
One-click install
npx skills add https://github.com/MWest2020/skill-forge --skill skill-creator-mwest2020
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/MWest2020/skill-forge/tree/main/skills/skill-creator
Command: npx skills add https://github.com/MWest2020/skill-forge --skill skill-creator-mwest2020

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) and assets (resource) components.

What problem does it solve? Writing effective agent skills is hard to do blind — descriptions may not trigger, instructions may underperform, and there is no feedback loop. This Skill provides a structured draft-test-review-improve workflow with quantitative benchmarks so skills are validated against real prompts before shipping. ## Core Features & Use Cases - Guided skill authoring: Interview-driven capture of intent, trigger conditions, and output formats, then generation of a well-structured SKILL.md following progressive disclosure and writing-style best practices. - Evaluation harness: Runs test prompts with and without the skill via parallel subagents, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark.json and benchmark.md. - Description optimization: Generates realistic should-trigger and should-not-trigger queries, reviews them in an HTML template, and runs an automated loop (run_eval.py + improve_description.py) that rewrites the description and selects the best by held-out test score. - Packaging: Validates frontmatter and bundles the skill folder into a distributable .skill zip file. - Use Case: A user says "turn this workflow into a skill." The Skill drafts the SKILL.md, creates test prompts, runs with-skill vs baseline comparisons, presents results in a browser viewer, iterates on feedback, and finally optimizes the trigger description. ## Quick Start Ask the agent to create a new skill for your workflow and run its test cases with benchmark comparison.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?

Start by capturing intent: what the skill should do, when it should trigger, and its output format. Then write the SKILL.md with name and description frontmatter, create 2-3 realistic test prompts, run them with and without the skill, and iterate based on feedback.

How do I test whether a skill description triggers correctly?

Build an eval set of about 20 realistic queries labeled should_trigger true or false, then run scripts/run_eval.py against the skill. It spawns claude -p processes and measures trigger rates, passing queries above the threshold.

How do I benchmark a skill against a baseline?

Run each test case with the skill and without it (or against a snapshot of the old version), grade outputs against assertions, then run scripts/aggregate_benchmark.py on the iteration directory. It produces benchmark.json and benchmark.md with pass rate, time, and token deltas.

Does skill-creator work on Claude.ai without subagents?

Yes, with adaptations. Run test prompts sequentially yourself instead of spawning subagents, skip baseline runs and quantitative benchmarking, present outputs inline for feedback, and skip description optimization since it requires the claude CLI.

Why does my skill description fail to trigger on simple queries?

Claude only consults skills for tasks it cannot easily handle alone, so simple one-step queries may not trigger regardless of description quality. Write eval queries that are substantive, multi-step, and realistic rather than trivial commands.

What are the limits of a SKILL.md file?

Keep the body under roughly 500 lines and push detail into references/ files. The name must be kebab-case under 64 characters, and the description must stay under 1024 characters with no angle brackets.