skill-creator

Create, evaluate, and iteratively improve AI agent skills with benchmarked test runs.

Updated May 19, 2026
One-click install
npx skills add https://github.com/costrict-plugins-repo/anthropic-netlify-skills --skill skill-creator-costrict-plugins-repo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/costrict-plugins-repo/anthropic-netlify-skills/tree/main/.claude/skills/skill-creator
Command: npx skills add https://github.com/costrict-plugins-repo/anthropic-netlify-skills --skill skill-creator-costrict-plugins-repo

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and assets (resource) components.

What problem does it solve? Writing effective skills for AI agents is hard to get right on the first try, and there is no systematic way to know whether a skill actually improves agent behavior. This Skill provides a structured workflow for drafting skills, running test cases with and without the skill, grading results against assertions, and iterating based on quantitative benchmarks and user feedback. ## Core Features & Use Cases - Guided Skill Authoring: Walks through intent capture, interviewing, and writing SKILL.md files with proper frontmatter, progressive disclosure, and writing-style guidance. - Evaluation Harness: Spawns parallel with-skill and baseline runs, drafts verifiable assertions, captures timing and token data, and aggregates results into benchmark.json with pass rates and deltas. - Description Optimization: Generates trigger/no-trigger eval queries, runs an automated optimization loop with train/test splits, and applies the best-performing description for accurate skill triggering. - Use Case: You want to build a skill that formats weekly sales reports. Use this Skill to draft it, run three realistic test prompts against baseline runs, review outputs in the HTML viewer, and iterate until the benchmark shows consistent improvement. ## Quick Start Help me create a new skill that converts meeting transcripts into structured action-item lists, then test and improve it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new skill for an AI agent?

Start by capturing intent: what the skill should do, when it should trigger, and the expected output format. Then write a SKILL.md with name and description frontmatter, draft 2-3 realistic test prompts, and iterate based on evaluation results.

How do I test whether a skill actually improves agent performance?

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both against objective assertions, then aggregate results into a benchmark comparing pass rates, execution time, and token usage.

What makes a good skill description for triggering?

A good description states both what the skill does and specific contexts when to use it, since all triggering decisions come from the description. Slightly pushy phrasing that lists related user intents helps combat undertriggering.

Can I use skill-creator on Claude.ai without subagents?

Yes, but with adaptations: run test cases sequentially yourself instead of spawning subagents, skip baseline runs and quantitative benchmarking, and present results inline in conversation rather than using the browser-based review viewer.

Why do skill evaluations need baseline runs?

Baseline runs without the skill show what the agent achieves unaided, so the benchmark delta isolates the skill's actual contribution. Without baselines, high pass rates might reflect task ease rather than skill value.

When should a skill bundle scripts instead of instructions?

Bundle a script when test runs show agents repeatedly writing the same helper code across cases, or when a task is deterministic and repetitive. Scripts save every future invocation from reinventing the wheel and reduce errors.