skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

Updated Sep 1, 2026
One-click install
npx skills add https://github.com/sshekhar-04/SIH_PS_26151 --skill skill-creator-sshekhar-04
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/sshekhar-04/SIH_PS_26151/tree/main/.agents/Skills/skill-creator
Command: npx skills add https://github.com/sshekhar-04/SIH_PS_26151 --skill skill-creator-sshekhar-04

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing a skill that triggers reliably and produces good outputs is hard to get right on the first try. This Skill guides the full lifecycle of skill development: drafting SKILL.md files, running test prompts with and without the skill, grading results against assertions, and optimizing the description for accurate triggering. ## Core Features & Use Cases - Skill Authoring Workflow: Interview-driven drafting of SKILL.md files following progressive disclosure, with guidance on scripts, references, and assets organization. - Evaluation & Benchmarking: Runs test cases in parallel with-skill and baseline configurations, grades assertions, and aggregates pass rates, timing, and token usage into benchmark reports. - Description Optimization: Generates trigger/no-trigger eval queries, reviews them in an HTML interface, and runs an automated loop that rewrites the description to maximize triggering accuracy on held-out test queries. - Use Case: You want to build a skill that converts meeting notes into Jira tickets. This Skill helps you draft it, creates realistic test prompts, runs comparative evaluations, shows results in a browser-based review viewer, and iterates until the outputs satisfy you. ## Quick Start Help me create a new skill that converts my weekly meeting notes into structured Jira tickets, then test it with a few realistic examples.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?

Start by defining what the skill should do and when it should trigger, then draft a SKILL.md with name and description frontmatter. This Skill walks you through intent capture, drafting, writing test prompts, and iterating based on evaluation results.

How do I test whether my skill actually improves outputs?

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both against assertions, then aggregate pass rates, timing, and token usage into a benchmark comparing the configurations.

How do I improve a skill description for better triggering?

Generate 20 realistic should-trigger and should-not-trigger queries, review them in the HTML eval editor, then run the optimization loop. It rewrites the description iteratively and selects the best version by held-out test score.

Does skill evaluation work on Claude.ai without subagents?

Yes, but with adaptations. Run test cases sequentially yourself instead of spawning subagents, skip baseline comparisons and quantitative benchmarking, and collect feedback inline in the conversation rather than through the browser viewer.

What makes a good skill test assertion?

Good assertions are objectively verifiable conditions with descriptive names, such as checking output file formats or required fields. Subjective qualities like writing style should be evaluated through human review rather than forced into assertions.