skill-creator

Create, evaluate, and iteratively improve agent skills with benchmark-driven workflows.

Updated Apr 7, 2026
One-click install
npx skills add https://github.com/mimiry-com/mimiry-skills --skill skill-creator-mimiry-com
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/mimiry-com/mimiry-skills/tree/main/.agents/skills/skill-creator
Command: npx skills add https://github.com/mimiry-com/mimiry-skills --skill skill-creator-mimiry-com

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Building effective agent skills requires more than writing instructions — you need test cases, quantitative benchmarks, and structured iteration to know whether a skill actually improves results. This Skill guides the full lifecycle of creating, testing, evaluating, and refining skills so changes are grounded in evidence rather than guesswork. ## Core Features & Use Cases - Skill Authoring: Interview-driven drafting of SKILL.md files with proper frontmatter, progressive disclosure structure, and writing-style guidance. - Evaluation & Benchmarking: Run with-skill and baseline test cases in parallel, grade outputs against assertions, and aggregate pass rates, timing, and token usage into benchmark reports. - Description Optimization: Generate trigger/no-trigger eval queries and run an automated optimization loop to improve skill triggering accuracy with train/test splits. - Use Case: You want to build a skill that formats weekly sales reports. This Skill helps you draft it, create realistic test prompts, compare outputs with and without the skill, review results in an HTML viewer, and iterate until the outputs are consistently correct. ## Quick Start Help me create a new skill that converts meeting transcripts into structured action-item lists, then test and improve it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new agent skill from scratch?

Start by defining what the skill should do and when it should trigger, then draft a SKILL.md with name and description frontmatter plus markdown instructions. This Skill walks you through intent capture, drafting, test case creation, and iterative refinement.

How do I test whether my skill actually improves results?

Run each test prompt twice in parallel — once with the skill and once without — then grade outputs against objective assertions. The aggregate_benchmark.py script produces pass rates, timing, and token statistics comparing both configurations.

How do I improve a skill's description for better triggering?

Generate 20 realistic should-trigger and should-not-trigger queries, review them with the user, then run the run_loop.py optimization script. It tests description variants against train and held-out queries and returns the best-performing description.

What makes a good skill description for triggering?

A good description states both what the skill does and specific contexts when to use it, since the description is the primary triggering mechanism. Slightly assertive phrasing helps because models tend to undertrigger skills.

Can I use skill-creator on Claude.ai without subagents?

Yes, but with adaptations: run test cases sequentially yourself instead of spawning subagents, skip baseline runs and quantitative benchmarking, and collect feedback inline in the conversation rather than through the browser viewer.

What are the limitations of skill evaluation benchmarks?

Assertions that always pass in both configurations do not differentiate skill value, and high-variance evals may indicate flaky tests rather than real skill issues. The analyzer agent surfaces these patterns so aggregate metrics are not misread.