skill-creator

Create, evaluate, and iteratively improve AI agent skills with benchmarked test runs.

1|Updated Aug 11, 2026
One-click install
npx skills add https://github.com/Chia1104/agent-air --skill skill-creator-chia1104
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/Chia1104/agent-air/tree/main/skills/claude/synced/b066812a-c7a5-4354-b574-f3c218098a45_0fdbac1f-d2db-4307-8341-b45c4d0d68f9/skill-creator
Command: npx skills add https://github.com/Chia1104/agent-air --skill skill-creator-chia1104

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and assets (resource) components.

What problem does it solve? Writing effective agent skills is hard to get right on the first try, and there is no built-in way to know whether a skill actually improves agent behavior or triggers when it should. This Skill provides a structured draft-test-review-iterate workflow with quantitative benchmarking so skill quality is measured rather than guessed. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user to capture intent, then drafts a SKILL.md with proper frontmatter, progressive disclosure structure, and writing-style guidance. - Evaluation Harness: Runs test prompts in parallel with-skill and baseline subagents, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark reports. - Description Optimization: Generates realistic trigger/no-trigger eval queries and runs an automated loop that rewrites the skill description to improve triggering accuracy, selecting the best version by held-out test score. - Use Case: You want to build a skill that formats weekly sales reports. This Skill helps you draft it, creates test prompts, runs comparative evaluations, shows results in a browser-based review viewer, and iterates until the outputs pass your review. ## Quick Start Ask the agent to help you create a new skill for your workflow, or to evaluate and improve an existing skill using test cases and benchmarks.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new skill for an AI agent?▼

Start by defining what the skill should do and when it should trigger, then write a SKILL.md with name and description frontmatter plus markdown instructions. This Skill guides the interview, drafting, test case creation, and iterative refinement process.

How do I test whether a skill actually improves agent output?▼

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both outputs against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark comparison.

How can I improve a skill description so it triggers correctly?▼

Generate 20 realistic should-trigger and should-not-trigger queries, then run the automated optimization loop. It evaluates description variants on a train split and selects the best by held-out test score to avoid overfitting.

What is the required structure of a SKILL.md file?▼

A SKILL.md requires YAML frontmatter with name and description fields, followed by markdown instructions. Optional sibling directories include scripts for executable code, references for on-demand docs, and assets for templates.

Does skill evaluation work without subagents, such as on Claude.ai?▼

Yes, but with adaptations: run test cases sequentially by following the skill yourself, skip baseline runs and quantitative benchmarking, and collect feedback inline in the conversation instead of using the browser viewer.

When should a skill not include quantitative test assertions?▼

Skip assertions for skills with subjective outputs like writing style or design quality, where human judgment is required. Assertions work best for objectively verifiable outputs such as file transforms, data extraction, and fixed workflows.