skill-creator

Create, test, and optimize AI skills with structured evaluation workflows.

Updated Feb 12, 2026
One-click install
npx skills add https://github.com/mynameistito/opencode-config --skill skill-creator-mynameistito
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/mynameistito/opencode-config/tree/main/skills/skill-creator
Command: npx skills add https://github.com/mynameistito/opencode-config --skill skill-creator-mynameistito

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires PyYAML, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

Building effective AI skills requires more than just writing instructions — it demands systematic testing, iteration, and optimization to ensure reliable triggering and consistent performance. Without structured evaluation, skills often undertrigger or produce inconsistent results.

Core Features & Use Cases

  • Skill Creation: Guide users through capturing intent, writing SKILL.md files, and organizing bundled resources like scripts and references.
  • Evaluation & Benchmarking: Run quantitative tests with baseline comparisons, grade outputs against assertions, and analyze performance metrics like pass rate, timing, and token usage.
  • Description Optimization: Iteratively improve skill descriptions for better triggering accuracy using train/test splits and automated optimization loops.

Quick Start

Use the skill-creator skill to design a new skill for summarizing meeting transcripts, write test cases for it, and run a benchmark to compare its performance against the baseline.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test and benchmark Claude Code skills against a baseline?

Benchmark Claude Code skills by running quantitative evaluation loops that grade outputs against assertions and measure pass rate, timing, and token usage against baseline performance. The skill-creator automates this with aggregation scripts that generate HTML reports.

What is skill description optimization and when do I need it?

Skill description optimization iteratively improves SKILL.md triggering accuracy using train/test splits and automated optimization loops. You need it when skills undertrigger or produce inconsistent results during evaluation.

How do I create a new Claude Code skill with bundled scripts and references?

Create a Claude Code skill by capturing intent, writing a SKILL.md file, and organizing bundled resources like scripts and references. The skill-creator guides this workflow to ensure reliable triggering and consistent performance.

Do I need Python to run skill evaluation and benchmarking workflows?

Yes, you need Python to run skill evaluation workflows, execute aggregation scripts, and generate HTML benchmarking reports. The skill-creator requires Python for running evaluation loops and quantitative performance analysis.

Why does my AI skill undertrigger or produce inconsistent results?

AI skills undertrigger or produce inconsistent results without structured evaluation and description optimization. The skill-creator addresses this through quantitative benchmarking, baseline comparisons, and iterative instruction improvements based on automated feedback.