skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarks and description optimization.

Updated Aug 10, 2026
One-click install
npx skills add https://github.com/Choi-Keith/skill-arsenal-ultra --skill skill-creator-choi-keith
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/Choi-Keith/skill-arsenal-ultra/tree/main/skills/skill-creator
Command: npx skills add https://github.com/Choi-Keith/skill-arsenal-ultra --skill skill-creator-choi-keith

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing effective skills for AI agents is hard: descriptions fail to trigger reliably, instructions overfit to a few examples, and there is no systematic way to know whether a change actually improved the skill. This Skill provides a complete workflow for drafting skills, running test prompts with and without the skill, collecting human feedback through a review viewer, benchmarking results quantitatively, and optimizing the trigger description. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user about intent, trigger conditions, and output formats, then drafts a SKILL.md following progressive-disclosure and writing-style best practices. - Evaluation & Benchmarking: Runs test prompts in parallel with-skill and baseline configurations, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark reports. - Interactive Review Viewer: Generates an HTML viewer (server or static file) so users can inspect outputs side by side, leave feedback per test case, and compare across iterations. - Description Optimization: Builds trigger/no-trigger eval query sets, runs an automated optimization loop with train/test splits, and applies the best-performing description. - Use Case: You want to turn a repeated workflow into a reusable skill. The Skill helps you draft it, creates realistic test prompts, runs blind baseline comparisons, shows you the results in a browser, and iterates until the skill generalizes. ## Quick Start Ask the agent to help you create a new skill for your workflow, or to evaluate and improve an existing skill using test prompts and benchmarks.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?

Start by defining what the skill should do, when it should trigger, and its expected output format. Then draft a SKILL.md with name and description frontmatter, create 2-3 realistic test prompts, run them with the skill, and iterate based on feedback.

How do I test whether my skill actually improves results?

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade outputs against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark comparing both configurations.

How do I optimize a skill description for better triggering?

Create about 20 realistic eval queries mixing should-trigger and should-not-trigger cases, review them in the HTML template, then run the optimization loop. It splits queries into train and test sets and iteratively rewrites the description, selecting the best by held-out test score.

Does skill evaluation work in Claude.ai without subagents?

Yes, but with adjustments. Without subagents you run test prompts sequentially yourself, skip baseline comparisons and quantitative benchmarks, present outputs directly in conversation, and skip description optimization since it requires the claude CLI.

What makes a good skill description for triggering?

State both what the skill does and concrete usage scenarios, phrased slightly assertively to counter under-triggering. Include trigger conditions in the description rather than the body, and cover varied phrasings users might actually type.

Why does my skill fail to trigger on simple queries?

Claude only consults skills for tasks it cannot easily handle with base tools. Simple one-step requests like reading a file may never trigger a skill regardless of description quality, so eval queries need enough substance to benefit from the skill.