skill-creator

Create, evaluate, and iteratively improve agent skills with benchmarked test runs.

Updated Jun 12, 2026
One-click install
npx skills add https://github.com/taylorelley/skills --skill skill-creator-taylorelley
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/taylorelley/skills/tree/main/skills/workflow/skill-creator
Command: npx skills add https://github.com/taylorelley/skills --skill skill-creator-taylorelley

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing an effective agent skill is hard to get right on the first try, and there is no built-in way to know whether a skill actually improves results or triggers when it should. This Skill provides a structured draft-test-review-iterate loop with quantitative benchmarking and description optimization. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user to capture intent, then drafts a SKILL.md with proper frontmatter, progressive disclosure structure, and writing-style guidance. - Evaluation Harness: Runs test prompts with and without the skill in parallel, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark reports. - Description Optimization: Generates realistic trigger/no-trigger queries and runs an automated loop that rewrites the skill description to improve triggering accuracy, validated on a held-out test set. - Use Case: You want a skill that formats weekly sales spreadsheets. This Skill helps you draft it, runs three realistic test prompts, shows you side-by-side results in a browser viewer, and iterates until the outputs pass your review. ## Quick Start Help me create a new skill that converts meeting notes into structured action items, then test and refine it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new agent skill from scratch?

Start by defining what the skill should do, when it should trigger, and its expected output format. Then draft a SKILL.md with name and description frontmatter, write 2-3 realistic test prompts, run them with and without the skill, and iterate based on the results.

How do I test whether my skill actually improves results?

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both outputs against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark comparing the two configurations.

How can I improve a skill description so it triggers correctly?

Generate about 20 realistic queries split between should-trigger and should-not-trigger cases, then run the optimization loop. It evaluates description variants on a train split, selects the best by held-out test score, and updates the SKILL.md frontmatter.

What makes a good skill evaluation assertion?

Good assertions are objectively verifiable checks with descriptive names, such as confirming an output file exists or contains specific data. Subjective qualities like writing style are better evaluated through human review rather than forced into assertions.

When should a skill not include test cases?

Skills with subjective outputs like writing style or visual design often do not benefit from quantitative test cases, since pass/fail assertions cannot capture quality. Skills with verifiable outputs like file transforms or data extraction benefit most from test cases.