skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

1|Updated May 13, 2026
One-click install
npx skills add https://github.com/SyedArmanAli2003/AgroNaV --skill skill-creator-syedarmanali2003
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/SyedArmanAli2003/AgroNaV/tree/main/.agents/skills/skill-creator
Command: npx skills add https://github.com/SyedArmanAli2003/AgroNaV --skill skill-creator-syedarmanali2003

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Building a reliable skill requires more than writing instructions — you need test cases, baseline comparisons, quantitative benchmarks, and description tuning to ensure the skill triggers correctly and performs well. This Skill guides the full lifecycle from draft to validated, optimized skill. ## Core Features & Use Cases - Skill Drafting & Iteration: Interview-driven workflow to capture intent, write SKILL.md files following progressive disclosure patterns, and refine based on feedback. - Benchmarked Evaluation: Runs test prompts with and without the skill in parallel, grades assertions, aggregates pass rates, timing, and token usage into benchmark reports with an interactive HTML review viewer. - Description Optimization: Generates trigger/no-trigger eval queries and runs an automated optimization loop to improve skill triggering accuracy with train/test splits. - Use Case: You want to build a skill that formats weekly sales reports. This Skill helps you draft it, creates realistic test prompts, runs comparison benchmarks, shows results in a browser viewer, and tunes the description until triggering is reliable. ## Quick Start Help me create a new skill that converts meeting transcripts into structured action-item lists, then test and improve it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?

Start by defining what the skill should do and when it should trigger, then write a SKILL.md with YAML frontmatter containing a name and description. This Skill walks you through intent capture, drafting, test case creation, and iterative improvement.

How do I test whether my skill actually improves results?

Run each test prompt twice in parallel — once with the skill and once without as a baseline — then grade outputs against assertions. The aggregate_benchmark.py script produces pass rates, timing, and token statistics with deltas between configurations.

How do I improve a skill description for better triggering?

Generate 20 realistic eval queries mixing should-trigger and should-not-trigger cases, then run the automated optimization loop. It tests description variants against train and held-out queries and selects the best performer by test score.

What is the difference between with-skill and baseline benchmark runs?

With-skill runs execute the test prompt with the skill loaded, while baseline runs use no skill for new skills or the previous version for improvements. Comparing them isolates the skill's actual contribution to output quality.

Does skill evaluation work on Claude.ai without subagents?

Yes, but with limitations. Without subagents you run test cases sequentially yourself, skip baseline comparisons and quantitative benchmarking, and present results inline for qualitative feedback instead of using the browser viewer.

When should a skill not include quantitative test assertions?

Skip assertions for skills with subjective outputs like writing style or design quality, where human judgment matters more than programmatic checks. Assertions work best for objectively verifiable outputs like file transforms or data extraction.