skill-creator

Create, evaluate, and iterate Claude skills with automated test prompts.

426|199|Updated Aug 13, 2025
One-click install
npx skills add https://github.com/leonvanzyl/agentic-coding-starter-kit --skill skill-creator-leonvanzyl
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/leonvanzyl/agentic-coding-starter-kit/tree/main/.agents/skills/skill-creator
Command: npx skills add https://github.com/leonvanzyl/agentic-coding-starter-kit --skill skill-creator-leonvanzyl

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) components.

What problem does it solve?

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize a skill's description for better triggering accuracy.

Core Features & Use Cases

  • Automate the end-to-end skill lifecycle: drafting, testing prompts, evaluating results, and iterating based on feedback.
  • Run controlled evals and compare triggering accuracy across iterations to guide improvements.
  • Generate and refine the skill description to maximize triggering reliability and user understanding.
  • Package skills for distribution and reuse across projects.

Quick Start

Initialize a new skill project, run automated eval loops, and review results to iterate quickly.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate Claude skill evaluation and iteration?

You automate Claude skill evaluation by running controlled eval loops that test prompts, analyze results, and iterate descriptions across multiple cycles to improve triggering accuracy. This Skill coordinates automated test prompts and collects metrics to guide improvements.

What is the best way to optimize a Claude skill description for better triggering accuracy?

The best way to optimize a Claude skill description is to run controlled evals that compare triggering accuracy across iterations. This Skill generates and refines descriptions based on automated test feedback to maximize triggering reliability and user understanding.

Can I create a Claude skill from scratch using automation scripts?

Yes, you can create a Claude skill from scratch using automation scripts. This Skill enables rapid creation by initializing new skill projects, running automated eval loops, and packaging the final skills for distribution across projects.

Do I need Python and pyyaml installed to run skill management workflows?

Yes, you need Python and the pyyaml dependency installed to run skill management workflows. This Skill relies on pyyaml to execute scripts that automate the end-to-end skill lifecycle, from drafting and testing to packaging.

How does skill experimentation measure performance across multiple iterations?

Skill experimentation measures performance by running controlled evaluations that collect metrics on triggering accuracy across multiple iterations. This Skill provides tooling and scripts to run experiments, analyze results, and guide improvements based on quantitative feedback.

When should I package a Claude skill for distribution and reuse?

You should package a Claude skill for distribution after completing automated eval loops and refining its description for optimal triggering accuracy. This Skill provides tooling to package finalized skills for reuse across multiple projects.