skill-creator

Create and iteratively improve Claude Code skill definitions and evaluation pipelines.

23|3|Updated Mar 4, 2026
One-click install
npx skills add https://github.com/MidnightV1/Claude-Code-Feishu --skill skill-creator-midnightv1
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/MidnightV1/Claude-Code-Feishu/tree/main/.claude/skills/skill-creator
Command: npx skills add https://github.com/MidnightV1/Claude-Code-Feishu --skill skill-creator-midnightv1

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires anthropic, pyyaml, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

Helps users create, test, and iteratively improve Claude Code skills by providing a structured authoring workflow, automated evaluation/benchmarking tools, and utilities to optimize skill descriptions so the right skill triggers in real sessions. It removes the repetitive, error-prone steps of drafting SKILL.md, designing evals, running with-skill vs baseline comparisons, grading results, and packaging a final skill.

Core Features & Use Cases

  • Skill authoring: Guided process for drafting SKILL.md, capturing intent, and writing examples and test prompts.
  • Automated evaluation & benchmarking: Run parallel with-skill and baseline runs, capture timing/tokens, grade expectations, and aggregate benchmark summaries.
  • Analysis & improvement: Tools to generate a reviewer UI, run blind comparisons, analyze why one version won, and iteratively improve descriptions to boost triggering accuracy.
  • Packaging & deployment: Validate and package skills for distribution and include helper scripts for common workflows.

Quick Start

Ask the skill-creator to draft a SKILL.md for a new skill, produce 2–3 realistic test prompts, run the eval loop, and return a benchmark summary and suggested description improvements.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create and evaluate Claude skills using a structured workflow?

To create and evaluate Claude skills, draft a SKILL.md with YAML frontmatter, generate realistic test prompts, and run parallel with-skill versus baseline evaluations to grade expectations and aggregate benchmark summaries.

What is the best way to optimize skill descriptions for triggering accuracy?

The best way to optimize skill descriptions is by running blind comparisons between versions, analyzing why one won, and iteratively improving the triggering descriptions to boost accuracy in real sessions.

How does automated benchmarking work for Claude Code skill development?

Automated benchmarking works by running parallel with-skill and baseline executions, capturing timing and token usage, grading results against expectations, and generating a reviewer UI for analysis.

Do I need Python dependencies to run skill evaluation pipelines?

Yes, you need Python dependencies including anthropic and pyyaml to run skill evaluation pipelines, execute benchmarking scripts, and process the YAML frontmatter required by SKILL.md files.

Can I package and validate skills for deployment after benchmarking?

Yes, you can package and validate skills for deployment after benchmarking by using helper scripts to ensure the SKILL.md, optional scripts, references, and assets are correctly structured for distribution.

Why are my Claude skill triggering descriptions not matching real sessions?

Triggering descriptions may not match real sessions due to vague intent capture; iteratively improve them by running blind comparisons, analyzing winning versions, and testing with realistic prompts.