skill-creator

Automates creation, evaluation, and iterative improvement of Claude skills.

Updated Apr 8, 2026
One-click install
npx skills add https://github.com/mashharuki/flare-sample --skill skill-creator-mashharuki
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/mashharuki/flare-sample/tree/main/.claude/skills/skill-creator
Command: npx skills add https://github.com/mashharuki/flare-sample --skill skill-creator-mashharuki

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires claude, pyyaml, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

Capture, evaluate, and iteratively improve Claude Skill definitions and workflows so authors can reliably produce repeatable, testable, and well-triggering skills without manual trial-and-error.

Core Features & Use Cases

  • Skill authoring workflow: Guided process for drafting SKILL.md, defining triggers, and organizing scripts/references/assets for a new skill.
  • Evaluation & benchmarking: Tools and scripts to run trigger/eval suites, spawn with-skill vs baseline comparisons, aggregate metrics, and surface pass rates, timing, and token usage.
  • Iteration & optimization: Automates drafting assertions, running with/without-skill baselines, generating an HTML review viewer, and optimizing SKILL.md descriptions to improve trigger accuracy.
  • Use case: A skill maintainer wanting to add a new capability can draft a skill, generate test prompts, run parallel evaluations, inspect outputs in the viewer, collect feedback, and iterate until results meet acceptance criteria.

Quick Start

Tell the assistant to help you create a new Claude skill by drafting SKILL.md, authoring test prompts, running the eval loop, reviewing results in the viewer, and iterating on the skill and description until benchmarks and human feedback are satisfactory.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate and benchmark Claude skills to improve trigger accuracy?

You can evaluate Claude skills by running bundled scripts for eval orchestration, spawning with-skill versus baseline comparisons, and aggregating pass rates, timing, and token usage metrics to measure trigger accuracy.

What is the process for creating and authoring a new Claude skill?

The skill authoring workflow involves drafting SKILL.md, defining triggers, organizing scripts, references, and assets, then authoring test prompts and running the eval loop to iterate until benchmarks are satisfactory.

Can I use this skill creator without the claude CLI or pyyaml installed?

No, you need a callable 'claude' CLI or equivalent tooling and the pyyaml dependency installed to access eval orchestration, grading, aggregation, viewer generation, and packaging scripts.

How do I generate an HTML review viewer to inspect skill evaluation results?

You generate an HTML review viewer by running bundled viewer generation scripts after parallel trigger tests and baseline comparisons, allowing you to inspect outputs, collect feedback, and iterate on descriptions.

What's the best way to optimize SKILL.md descriptions for better trigger testing?

Optimize SKILL.md descriptions by automating assertion drafting, running with and without-skill baselines, inspecting aggregated metrics in the review viewer, and iteratively refining descriptions for trigger accuracy.

Are there limitations when running parallel trigger tests across skill workspaces?

Parallel trigger tests require access to the complete skill directory including SKILL.md, scripts, references, and assets, and depend on a callable 'claude' CLI or equivalent tooling to execute across workspaces.