skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

2|1|Updated Jun 9, 2026
One-click install
npx skills add https://github.com/zester4/zilmate --skill skill-creator-zester4
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/zester4/zilmate/tree/main/.agents/skills/skill-creator
Command: npx skills add https://github.com/zester4/zilmate --skill skill-creator-zester4

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing a skill that triggers reliably and produces good outputs is hard to do by intuition alone. This Skill guides you through drafting a SKILL.md, running structured test cases with baselines, grading results quantitatively, and iterating on the skill until it performs well. ## Core Features & Use Cases - Guided Skill Authoring: Interviews you about intent, trigger contexts, and output formats, then writes a well-structured SKILL.md following progressive disclosure and writing-style best practices. - Evaluation & Benchmarking: Runs test prompts with and without the skill in parallel, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark reports with an interactive HTML review viewer. - Description Optimization: Generates realistic trigger/no-trigger eval queries and runs an automated optimization loop to improve the skill description's triggering accuracy, selecting the best version by held-out test score. - Use Case: You want a skill that formats weekly sales spreadsheets. This Skill helps you draft it, creates three realistic test prompts, runs them with and without the skill, shows you a side-by-side review page, and rewrites the skill based on your feedback until the outputs are consistently correct. ## Quick Start Help me create a new skill that converts meeting notes into structured action items, then test and improve it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?

Start by defining what the skill should do, when it should trigger, and its output format. Then write a SKILL.md with YAML frontmatter containing a name and description, followed by markdown instructions, and optionally add scripts, references, or assets directories.

How do I test whether my skill actually improves outputs?

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both outputs against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark to compare configurations.

How can I improve a skill description so it triggers more reliably?

Create 20 realistic eval queries mixing should-trigger and should-not-trigger cases, then run the automated optimization loop. It evaluates candidate descriptions on a train split and selects the best by held-out test score to avoid overfitting.

What makes a good skill description for triggering?

A good description states both what the skill does and specific contexts when to use it, since the description is the primary triggering mechanism. Slightly assertive phrasing helps because models tend to undertrigger skills.

Does skill evaluation work without subagents, like on Claude.ai?

Yes, but with adaptations: run test cases sequentially yourself instead of in parallel, skip baseline runs and quantitative benchmarking, and present outputs inline for qualitative feedback instead of using the browser-based review viewer.

When should a skill bundle a script instead of instructions?

Bundle a script when test runs show subagents repeatedly writing the same helper code across cases, or when a task is deterministic and repetitive. Scripts save every future invocation from reinventing the same logic.