What problem does it solve?
Building effective AI skills requires more than writing good prompts—it needs systematic testing, evaluation, and iteration to ensure they trigger correctly and perform reliably across diverse user queries.
Core Features & Use Cases
- Skill Creation: Guide users through capturing intent, drafting SKILL.md files, and structuring bundled resources like scripts and references.
- Evaluation & Benchmarking: Run quantitative evals with baseline comparisons, generate benchmark reports with pass rates and timing data, and analyze performance patterns.
- Description Optimization: Automatically improve skill descriptions for better triggering accuracy using train/test splits and iterative refinement.
- Use Case: A developer building a custom code review skill can use this to draft the skill, run test cases comparing outputs with and without the skill, analyze benchmark results, and optimize the description so Claude invokes it when users mention code reviews.
Quick Start
Use the skill-creator skill to design a new skill for summarizing meeting transcripts, then run the evaluation loop to test its outputs and optimize its description for better triggering.