skill-creator

Create, test, benchmark, and package reusable AI skills from detected work patterns.

Updated Jul 15, 2026
One-click install
npx skills add https://github.com/Kurorz2004/alphaz-coral --skill skill-creator-kurorz2004
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/Kurorz2004/alphaz-coral/tree/main/vrp/evidence/full/full-s1/.coral/public/skills/skill-creator
Command: npx skills add https://github.com/Kurorz2004/alphaz-coral --skill skill-creator-kurorz2004

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? It automates the end-to-end lifecycle of authoring new skills: detecting reusable patterns in your own work, drafting SKILL.md files, generating test cases, running with-skill vs baseline benchmarks, iterating on failures, optimizing trigger descriptions, and packaging the result. ## Core Features & Use Cases - Pattern Detection and Deduplication: Scans git diffs, attempt history, tool usage, and cross-episode notes to find recurring patterns, then checks existing skills to avoid overlap. - Automated Benchmarking: Generates eval cases with assertions, spawns parallel with-skill and baseline runs, grades outputs via grader/comparator/analyzer agents, and aggregates pass rates, timing, and token deltas. - Description Optimization and Packaging: Runs a trigger-accuracy optimization loop over should-trigger/should-not-trigger queries and packages the validated skill into a distributable .skill file. - Use Case: After noticing you repeatedly write the same data-cleaning helper across tasks, use this Skill to capture it as a tested, benchmarked, packaged skill without manual eval design. ## Quick Start Analyze my recent work for a repeated pattern and turn it into a tested, packaged skill. ## Reference Files The agents/ directory contains grader, comparator, and analyzer subagent instructions; references/schemas.md defines the JSON formats for evals, grading, and benchmarks.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new AI skill automatically?

Run the skill-creator workflow: it scans your git history, attempt logs, and notes for repeated patterns, drafts a SKILL.md, generates test cases, benchmarks with-skill versus baseline runs, and packages the result. No manual eval design is required.

How do I test whether a skill actually improves performance?

The skill generates 3-5 eval cases with verifiable assertions, then spawns paired subagent runs with and without the skill. A grader agent checks assertions, and results are aggregated into benchmark.json showing pass-rate deltas, time, and token usage.

What makes a good skill description for triggering?

Descriptions should state what the skill does plus specific contexts when it applies, using slightly assertive phrasing to avoid under-triggering. The skill optimizes descriptions against 20 trigger eval queries (10 should-trigger, 10 near-miss negatives) with a train/test split.

When should I stop iterating on a skill?

Stop when pass rate reaches 0.80 with a delta over 0.15 above baseline, when pass rate hits 1.0, after 3 iterations, when improvement drops below 0.05, or on regression (revert to the best version).

Does skill-creator require external Python dependencies?

The bundled eval viewer (eval-viewer/generate_review.py) uses only the Python standard library, including http.server for the review UI. Benchmark aggregation and packaging run as module scripts within the skill workspace.