skill-creator

Create, evaluate, and iteratively improve agent skills with benchmarked test runs.

Updated Aug 2, 2026
One-click install
npx skills add https://github.com/leonardoacosta/skills --skill skill-creator-leonardoacosta
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/leonardoacosta/skills/tree/main/meta/skills/skill-creator
Command: npx skills add https://github.com/leonardoacosta/skills --skill skill-creator-leonardoacosta

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing an effective agent skill is hard to get right on the first try: descriptions undertrigger, instructions overfit to examples, and there is no systematic way to know whether a change actually improved the skill. This Skill provides a structured draft-test-review-iterate workflow with quantitative benchmarks so skill quality is measured rather than guessed. ## Core Features & Use Cases - Guided skill authoring: Interviews the user about intent, trigger contexts, and output formats, then drafts a SKILL.md following progressive-disclosure and writing-style best practices. - Parallel evaluation harness: Runs test prompts with and without the skill via subagents, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark.json with mean and standard deviation. - Description optimization loop: Generates realistic should-trigger and should-not-trigger queries, then iteratively rewrites the skill description and scores it on train and held-out test splits to improve triggering accuracy. - Use Case: You want a skill that converts meeting notes into Jira tickets. This Skill helps you draft it, runs three realistic test prompts with and without the skill, shows results in a browser-based review viewer, collects your feedback, and iterates until the outputs pass your assertions. ## Quick Start Help me create a new skill that turns my weekly meeting notes into structured Jira tickets, then test it with a few realistic prompts.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new agent skill from scratch?

Start by defining what the skill should do, when it should trigger, and its expected output format. Then draft a SKILL.md with name and description frontmatter, write 2-3 realistic test prompts, and run them with and without the skill to compare results before iterating.

How do I test whether a skill actually improves results?

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both outputs against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark to see the measurable delta.

How do I improve a skill description for better triggering?

Generate about 20 realistic queries split between should-trigger and should-not-trigger cases, including tricky near-misses. The optimization loop rewrites the description iteratively and scores it on held-out test queries to avoid overfitting.

What makes a good skill description for triggering?

A good description states both what the skill does and specific contexts when to use it, since all triggering decisions come from the description. Slightly assertive phrasing helps because models tend to undertrigger skills on borderline queries.

Can I run skill evaluations without subagents or a browser?

Yes. On Claude.ai or headless environments, run test prompts sequentially yourself, present outputs inline for feedback, and skip quantitative benchmarking. The eval viewer supports a --static flag that writes a standalone HTML file instead of starting a server.

When should a skill bundle scripts instead of instructions?

Bundle a script when test runs show subagents repeatedly writing the same helper code across cases, or when a task is deterministic and repetitive. Scripts in the scripts/ directory execute without loading into context, saving tokens on every invocation.