skill-creator-normal

Create, evaluate, and iteratively improve single-agent skills with benchmarked test runs.

7.1k|1.1k|Updated Mar 5, 2026
One-click install
npx skills add https://github.com/openJiuwen-ai/jiuwenswarm --skill skill-creator-normal
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator-normal
Source: https://github.com/openJiuwen-ai/jiuwenswarm/tree/main/jiuwenswarm/resources/agent/workspace/skills/skill-creator-normal
Command: npx skills add https://github.com/openJiuwen-ai/jiuwenswarm --skill skill-creator-normal

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and assets (resource) components.

What problem does it solve?

Writing an effective agent skill is hard to get right on the first try: descriptions undertrigger, instructions overfit to a few examples, and there is no systematic way to know whether a change actually improved the skill. This Skill provides a structured create-test-iterate workflow with quantitative benchmarks and human review loops.

Core Features & Use Cases

  • Guided Skill Authoring: Captures intent through interview questions, searches community skills for proven structural patterns, and plans directory structure (scripts/, references/, assets/, agents/) before writing SKILL.md.
  • Evaluation Harness: Runs with-skill and baseline subagent runs in parallel, drafts assertions, captures timing and token data, and aggregates results into benchmark.json with pass-rate, time, and token statistics.
  • Review & Iteration Loop: Launches an HTML eval viewer for qualitative feedback, supports blind A/B comparison between skill versions, and optimizes the skill description for triggering accuracy using train/test query sets.
  • Use Case: A user wants a skill that generates changelogs from git history. This Skill interviews them, drafts the skill, runs test prompts with and without the skill, shows benchmark results in a browser viewer, and iterates until the user is satisfied.

Quick Start

Help me create a new skill that generates changelog entries from my git commit history, then test and refine it.

Frequently Asked Questions about skill-creator-normal

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new agent skill from scratch?

Start by defining what the skill should do, when it should trigger, and its expected output format. The skill then guides you through drafting SKILL.md, planning the directory structure, writing test prompts, and running evaluations to verify it works.

How do I test whether my skill actually improves results?

Run each test prompt twice in parallel: once with the skill and once without it as a baseline. The aggregate_benchmark.py script then computes pass rates, execution time, and token usage with mean and standard deviation for both configurations.

How can I improve a skill description so it triggers correctly?

Generate about 20 realistic trigger eval queries split into should-trigger and should-not-trigger sets, then run the description optimization loop. It tests description variants against train and held-out test queries and applies the best-performing version.

What directories should a non-trivial skill contain?

Beyond SKILL.md, use scripts/ for deterministic repetitive tasks, references/ for domain knowledge too large to inline, assets/ for output templates, and agents/ for subagent prompt files. SKILL.md should point to each bundled file with guidance on when to read it.

Why does npx skills find return empty results on Windows?

On Windows, running npx skills find directly can silently produce empty output due to an npx compatibility issue. Wrap the command in powershell -Command to get correct results before concluding no community skills exist.

When should I use blind comparison instead of the normal review loop?

Use blind comparison when you need a rigorous judgment of whether a new skill version is actually better than the old one. An independent agent compares both outputs without knowing which skill produced them, then an analyzer explains why the winner won.