skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

Updated Aug 20, 2026
One-click install
npx skills add https://github.com/bittlinkm/claude-setup --skill skill-creator-bittlinkm
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/bittlinkm/claude-setup/tree/main/skills/skill-creator
Command: npx skills add https://github.com/bittlinkm/claude-setup --skill skill-creator-bittlinkm

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing a skill that reliably triggers and produces good outputs is hard to do by intuition alone. This Skill guides the full lifecycle of skill development: drafting SKILL.md files, running test prompts with and without the skill, grading results against assertions, and optimizing the description field for accurate triggering. ## Core Features & Use Cases - Skill Drafting and Iteration: Interview the user, write a SKILL.md draft following progressive disclosure patterns, and refine it through repeated feedback loops. - Benchmarked Evaluation: Run test cases in parallel with-skill and baseline configurations, grade outputs against assertions, and aggregate pass rates, timing, and token usage into benchmark reports with an HTML review viewer. - Description Optimization: Generate trigger/no-trigger eval queries, run an automated optimization loop with train/test splits, and apply the best-performing description to improve skill triggering accuracy. - Use Case: You want to build a skill that formats weekly sales reports. This Skill helps you draft it, creates realistic test prompts, runs comparative evaluations, shows you results in a browser viewer, and iterates until the outputs meet your standards. ## Quick Start Help me create a new skill that converts meeting transcripts into structured action-item lists, then test and improve it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?

Start by defining what the skill should do and when it should trigger, then write a SKILL.md with name and description frontmatter plus markdown instructions. This Skill guides the interview, drafting, test case creation, and iterative improvement process.

How do I test whether my skill actually improves outputs?

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both against assertions, aggregate pass rates and timing into a benchmark, and review outputs side by side in the HTML viewer.

How do I improve a skill description for better triggering?

Generate 20 realistic eval queries split between should-trigger and should-not-trigger cases, then run the automated optimization loop. It tests description variants against train and held-out queries and returns the best-scoring description.

Does skill evaluation work on Claude.ai without subagents?

Yes, but with adaptations. Run test prompts sequentially yourself instead of spawning subagents, skip baseline comparisons and quantitative benchmarking, and present results inline in the conversation for qualitative feedback.

What makes a good skill test assertion?

Good assertions are objectively verifiable conditions with descriptive names, such as checking that an output file exists or contains specific data. Subjective qualities like writing style are better evaluated through human review than forced assertions.