What problem does it solve?
Writing an effective agent skill is hard to get right on the first try: descriptions undertrigger, instructions overfit to a few examples, and there is no systematic way to know whether a change actually improved the skill. This Skill provides a structured create-test-iterate workflow with quantitative benchmarks and human review loops.
Core Features & Use Cases
- Guided Skill Authoring: Captures intent through interview questions, searches community skills for proven structural patterns, and plans directory structure (scripts/, references/, assets/, agents/) before writing SKILL.md.
- Evaluation Harness: Runs with-skill and baseline subagent runs in parallel, drafts assertions, captures timing and token data, and aggregates results into benchmark.json with pass-rate, time, and token statistics.
- Review & Iteration Loop: Launches an HTML eval viewer for qualitative feedback, supports blind A/B comparison between skill versions, and optimizes the skill description for triggering accuracy using train/test query sets.
- Use Case: A user wants a skill that generates changelogs from git history. This Skill interviews them, drafts the skill, runs test prompts with and without the skill, shows benchmark results in a browser viewer, and iterates until the user is satisfied.
Quick Start
Help me create a new skill that generates changelog entries from my git commit history, then test and refine it.