What problem does it solve?
Reduces the friction of designing, testing, and iterating Claude skills by providing a structured, repeatable workflow for drafting SKILL.md, generating test prompts, executing paired with-skill and baseline runs, grading outputs, and aggregating benchmark results. It helps teams move from an informal prompt to a packaged, evaluated skill with clear quantitative and qualitative feedback.
Core Features & Use Cases
- Skill authoring: Guided capture of intent, frontmatter drafting, and SKILL.md composition to improve discoverability and triggering.
- Eval creation & execution: Produce realistic test prompts, run with-skill and baseline comparisons, capture timing/tokens, and grade against assertions using provided scripts.
- Benchmarking & analysis: Aggregate run results, compute pass rates/time/tokens deltas, launch an HTML viewer, and generate analyst observations and comparator analyses.
- Iteration & optimization: Improve skill descriptions automatically via a description-optimization loop, package skills into distributable .skill files, and add reusable scripts to the skill bundle.
- Use cases: Build a new skill from scratch, improve an existing skill's accuracy and triggers, benchmark two versions, or optimize the SKILL.md description for better invocation rates.
Quick Start
Ask for help defining intent, draft SKILL.md, and produce 2-3 realistic test prompts plus basic eval assertions so the skill-creator scripts can run an initial iteration.