skill-creator

Create, evaluate, and iteratively improve Agent Skills and SKILL.md files.

1|Updated Jan 27, 2025
One-click install
npx skills add https://github.com/KasimKaizer/nix-darwin-config --skill skill-creator-kasimkaizer
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/KasimKaizer/nix-darwin-config/tree/main/modules/home/agents/skills/skill-creator
Command: npx skills add https://github.com/KasimKaizer/nix-darwin-config --skill skill-creator-kasimkaizer

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and assets (resource) components.

What problem does it solve? Writing an effective Agent Skill is hard to get right on the first try: descriptions undertrigger, instructions overfit to examples, and there is no built-in way to measure whether a skill actually improves agent output. This Skill provides a structured draft-test-review-iterate workflow with quantitative benchmarks and description optimization. ## Core Features & Use Cases - Skill authoring workflow: Capture intent, interview the user, and write a well-structured SKILL.md following progressive disclosure and anatomy best practices. - Evaluation harness: Run test prompts with and without the skill via subagents, grade assertions, aggregate benchmark statistics (pass rate, time, tokens), and review results in an HTML viewer. - Description optimization: Generate trigger/no-trigger eval queries, review them in an HTML template, and run an automated loop that rewrites the frontmatter description to improve triggering accuracy. - Use Case: You want a skill that formats weekly sales spreadsheets. This Skill helps you draft it, run three realistic test prompts against a baseline, review outputs side by side, refine the instructions, and optimize the description so it triggers reliably. ## Quick Start Ask the agent to create a new skill for your workflow and iterate on it with test cases until the outputs look right.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Agent Skill with a SKILL.md file?▼

Define the skill's intent, trigger contexts, and output format, then write a SKILL.md with YAML frontmatter containing name and description followed by markdown instructions. Keep the body under 500 lines and use scripts/, references/, and assets/ directories for bundled resources.

How do I test whether my skill actually improves agent output?▼

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both against objective assertions, aggregate pass rates, time, and token usage into a benchmark, then review outputs side by side in the HTML viewer.

How do I optimize a skill description for better triggering?▼

Generate about 20 realistic should-trigger and should-not-trigger queries, review them with the user, then run the optimization loop. It evaluates description variants on a train/test split using Cursor Agent and returns the best-scoring description.

Does skill evaluation work in a headless environment without subagents?▼

Yes, but with adaptations. Run test cases sequentially yourself as a sanity check, skip baseline runs and quantitative benchmarking, and present results inline for user feedback instead of using the browser viewer.

What are the limitations of the description optimization scores?▼

The Cursor evaluator is a classification proxy that responds with invoke or skip based on the skill name and description. Scores measure metadata relevance, not proof of runtime skill discovery, so treat them as directional rather than definitive.