skill-creator

Automate creation, evaluation, and refinement of Claude skills with Python tooling.

7|Updated Nov 30, 2019
One-click install
npx skills add https://github.com/dstanberry/dotfiles --skill skill-creator-dstanberry
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/dstanberry/dotfiles/tree/main/ai/claude/skills/skill-creator
Command: npx skills add https://github.com/dstanberry/dotfiles --skill skill-creator-dstanberry

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) components.

What problem does it solve?

This Skill helps teams create, refine, and evaluate Claude skills from scratch, ensuring iterative improvement and measurable performance.

Core Features & Use Cases

  • Create new skills, modify existing ones, and run evaluations to measure impact.
  • Iterate with evaluation loops (train/test) and automated benchmarking to improve triggering accuracy.
  • Manage skill artifacts (scripts, references, assets) for deterministic tasks and on-demand information.

Quick Start

Draft, test, and refine a skill from SKILL.md and run an evaluation loop to optimize triggering.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate the creation and evaluation of Claude skills?

You can automate Claude skill creation and evaluation by using a Python-driven workflow that drafts a SKILL.md file, validates YAML frontmatter, and runs evaluation loops to benchmark trigger performance. This handles end-to-end skill refinement automatically.

What is the best way to benchmark AI workflow triggering accuracy?

Benchmarking AI workflow triggering accuracy involves running automated evaluation loops with Python tooling that measure trigger rates, timings, and tool usage across various test prompts. This iterative train and test process ensures measurable performance improvements.

How do I validate YAML frontmatter when building prompt-engineering skills?

Validating YAML frontmatter for prompt-engineering skills is handled automatically by the skill-creation workflow's Python scripts. This ensures your metadata and skill artifacts are correctly structured before running automated evaluations.

Does this skill-creation workflow require any specific Python dependencies?

The skill-creation workflow requires the pyyaml Python dependency to function. You need this library installed to parse configurations, validate YAML frontmatter, and execute the benchmarking scripts effectively.

Can I modify existing AI skills and measure the impact of prompt changes?

Modifying existing AI skills and measuring prompt impact is supported through automated evaluation loops. You adjust the skill behavior and run benchmarks to measure trigger rates and timings, ensuring iterative improvement across iterations.