skill-creator

Automate creation, evaluation, and refinement of Claude Skills with trigger-evaluation loops.

Updated Mar 27, 2026
One-click install
npx skills add https://github.com/dipandhali2021/shipwright --skill skill-creator-dipandhali2021
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/dipandhali2021/shipwright/tree/main/skills/skill-creator
Command: npx skills add https://github.com/dipandhali2021/shipwright --skill skill-creator-dipandhali2021

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) components.

What problem does it solve?

Skill-creator provides a structured workflow to create new Claude Skills, modify and improve existing ones, and measure skill performance through automated evaluation loops. It enables users to capture intent, generate SKILL.md frontmatter, assemble the instructional body, and iterate based on objective evals, reducing guesswork and accelerating skill maturation.

Core Features & Use Cases

  • Automates end-to-end skill creation, including drafting frontmatter and the body
  • Orchestrates trigger-evaluation loops, holdout testing, and iterative description improvement
  • Generates live reports and benchmarks to guide decision-making
  • Supports packaging and distribution of finalized skills for reuse

Quick Start

Create or modify a skill, run the trigger-evaluation loop, and iterate until the evaluated results show improvement

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate Claude Skill creation and frontmatter generation?

You can automate Claude Skill creation by capturing intent to generate SKILL.md frontmatter and assemble the instructional body. This streamlines drafting metadata and building the skill structure end-to-end without manual formatting.

What is a trigger-evaluation loop for refining Claude Skills?

A trigger-evaluation loop is an automated testing process that measures Claude Skill performance against holdout tests. It iterates skill descriptions based on objective eval results to continuously improve trigger accuracy and response quality.

Do I need pyyaml to run automated skill evaluation loops?

Yes, pyyaml is required as a dependency to run automated skill evaluation loops. It provides the necessary YAML parsing functionality to handle SKILL.md frontmatter processing and generation during the refinement workflow.

What's the best way to iterate and improve Claude Skill descriptions?

The best way to iterate Claude Skill descriptions is running trigger-evaluation loops with holdout testing. This generates live reports and benchmarks, guiding data-driven improvements until evaluated results show measurable performance progress.

Can I package and distribute refined Claude Skills for reuse?

Yes, you can package and distribute finalized Claude Skills for reuse after completing the evaluation and refinement workflow. This supports sharing optimized skills with verified trigger-evaluation benchmarks across different environments.

Why does my Claude Skill trigger incorrectly without evaluation testing?

Skills trigger incorrectly without evaluation testing because descriptions lack objective benchmarking against holdout tests. Running automated trigger-evaluation loops identifies mismatches and iterates descriptions to improve trigger accuracy.