skill-creator

Create, iterate, and benchmark SKILL.md skill definitions with eval harnesses.

2|2|Updated Mar 1, 2026
One-click install
npx skills add https://github.com/pynbj1001/agent-workspace --skill skill-creator-pynbj1001
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/pynbj1001/agent-workspace/tree/main/skills/anthropic-skill-creator
Command: npx skills add https://github.com/pynbj1001/agent-workspace --skill skill-creator-pynbj1001

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires anthropic, PyYAML, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

Helps teams and builders create, evaluate, and iteratively improve self-contained Claude/assistant Skills (SKILL.md) so those skills reliably trigger and perform for real user intents instead of being under- or over-triggered or under-tested.

Core Features & Use Cases

  • Draft & Authoring: Guide interviews, capture intent, and produce a SKILL.md with required frontmatter and operational instructions.
  • Evaluation & Benchmarking: Generate test prompts, run trigger and functional evals, spawn with-skill/baseline comparisons, grade runs, and aggregate benchmark reports with timing/tokens.
  • Optimization Loop: Produce and iterate on description improvements, run train/test splits to avoid overfitting, and package skills for distribution.

Quick Start

Ask the assistant to "Help me create a new SKILL.md for [task], produce 2–3 test prompts saved to evals/evals.json, and draft evaluation assertions to run the evaluation loop."

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create and evaluate Claude skills to ensure they trigger reliably?

To create and evaluate Claude skills, use a structured workflow to draft a SKILL.md with required frontmatter, generate test prompts, and run trigger and functional evaluations to ensure reliable activation for real user intents.

What is a SKILL.md evaluation harness and how does benchmarking work?

A SKILL.md evaluation harness generates test prompts and runs parallel with-skill and baseline comparisons, grading outputs to aggregate benchmark reports with timing and token usage for performance measurement.

How do I optimize AI skill descriptions to prevent over-triggering?

Optimize AI skill descriptions by iterating on frontmatter text and running train/test split evaluations, which prevents overfitting and ensures the skill triggers appropriately for intended user intents.

Can I use Python and YAML to automate skill generation and benchmarking?

Yes, you can use Python with the anthropic client and PyYAML dependencies to automate skill generation, run evaluation loops, aggregate benchmark artifacts, and support description optimization.

What is the best way to package self-contained assistant skills for distribution?

The best way to package self-contained assistant skills is to finalize the SKILL.md frontmatter, save test prompts to evals/evals.json, complete the description optimization loop, and aggregate reviewer artifacts.