skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarks and description optimization.

Updated Jul 16, 2026
One-click install
npx skills add https://github.com/JamesMitofsky/tag-archive --skill skill-creator-jamesmitofsky
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/JamesMitofsky/tag-archive/tree/main/.claude/skills/skill-creator
Command: npx skills add https://github.com/JamesMitofsky/tag-archive --skill skill-creator-jamesmitofsky

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing a skill that triggers reliably and produces good outputs is hard to do by intuition alone. This Skill guides you through drafting a SKILL.md, running structured test cases with baselines, collecting human feedback, and optimizing the description for accurate triggering. ## Core Features & Use Cases - Guided Skill Authoring: Interviews you about intent, edge cases, and output formats, then drafts a SKILL.md following progressive-disclosure and writing-style best practices. - Evaluation & Benchmarking: Runs test prompts with and without the skill in parallel, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark reports with an interactive HTML review viewer. - Description Optimization: Generates realistic trigger/no-trigger eval queries, runs an automated optimization loop with train/test splits, and applies the best-performing description. - Use Case: You want a skill that formats weekly sales spreadsheets. This Skill helps you draft it, tests it on realistic prompts, shows you side-by-side results in a browser viewer, and iterates until the outputs meet your bar. ## Quick Start Ask the assistant to create a new skill for your workflow, for example: help me build a skill that converts meeting notes into structured action items.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?

Start by describing what the skill should do and when it should trigger. The skill-creator interviews you about edge cases and output formats, drafts a SKILL.md with proper frontmatter, then runs test prompts to validate behavior before iterating.

How do I test whether my skill actually improves outputs?

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both against assertions, then aggregate results with the benchmark script to compare pass rates, timing, and token usage.

How do I improve a skill description so it triggers correctly?

Generate 20 realistic should-trigger and should-not-trigger queries, review them in the HTML eval editor, then run the optimization loop. It tests description variants against train and held-out queries and returns the best-scoring description.

What is the required structure of a SKILL.md file?

SKILL.md needs YAML frontmatter with name and description fields, followed by Markdown instructions. Keep the body under 500 lines and move detailed content into references/, scripts/, or assets/ directories for progressive disclosure.

Does skill evaluation work without subagents or a browser?

Yes. On Claude.ai or headless environments, run test prompts sequentially yourself, present outputs inline for feedback, and use the --static flag to generate a standalone HTML review file instead of a server.

When should I not add quantitative assertions to a skill eval?

Skip assertions for subjective outputs like writing style or design quality, where human judgment matters more than programmatic checks. Assertions work best for objectively verifiable results like file formats, extracted values, or workflow steps.