skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

Updated May 28, 2026
One-click install
npx skills add https://github.com/changfengpro/agent-skills --skill skill-creator-changfengpro
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/changfengpro/agent-skills/tree/main/skills/skill-creator
Command: npx skills add https://github.com/changfengpro/agent-skills --skill skill-creator-changfengpro

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing a skill that triggers reliably and produces good outputs is hard to do by intuition alone. This Skill guides you through drafting a skill, running structured test cases with baselines, collecting quantitative benchmarks and qualitative feedback, and iterating until the skill performs well. ## Core Features & Use Cases - Guided Skill Authoring: Interviews you about intent, trigger contexts, and output formats, then writes a well-structured SKILL.md following progressive disclosure and writing-style best practices. - Evaluation & Benchmarking: Runs test prompts with and without the skill in parallel, grades assertions, aggregates pass rates, timing, and token usage into benchmark reports, and renders an interactive HTML review viewer. - Description Optimization: Generates realistic trigger/no-trigger eval queries and runs an automated optimization loop with train/test splits to improve the skill description's triggering accuracy. - Use Case: You want a skill that formats weekly sales spreadsheets. This Skill helps you draft it, creates test prompts, runs them with and without the skill, shows you side-by-side results in a browser viewer, and rewrites the skill based on your feedback until it works. ## Quick Start Help me create a new skill that converts meeting transcripts into structured action-item lists, then test and improve it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?

Start by defining what the skill should do, when it should trigger, and its output format. Then write a SKILL.md with name and description frontmatter plus markdown instructions, draft 2-3 realistic test prompts, and iterate based on evaluation results.

How do I test whether my skill actually improves outputs?

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both against objective assertions, aggregate pass rates and timing into a benchmark, and review outputs side by side in the HTML viewer.

How do I improve a skill description so it triggers correctly?

Generate about 20 realistic should-trigger and should-not-trigger queries, review them with the user, then run the automated optimization loop. It evaluates description variants on train and held-out test splits and returns the best-performing description.

What makes a good skill description for triggering?

A good description states both what the skill does and specific contexts when to use it, including phrases users actually say. Slightly pushy wording helps because Claude tends to undertrigger skills by default.

When should a skill include scripts or reference files?

Add scripts when test runs show the model repeatedly writing the same helper code across cases, since bundling it saves future invocations. Use reference files when instructions exceed roughly 500 lines or cover multiple domain variants.

Can I use skill-creator on Claude.ai without subagents?

Yes, but with adaptations: run test cases sequentially yourself instead of with subagents, skip baseline runs and quantitative benchmarking, present results inline instead of the browser viewer, and skip description optimization which requires the claude CLI.