creating-skills

Create, evaluate, benchmark, and iteratively improve agent skills.

Updated Mar 18, 2026
One-click install
npx skills add https://github.com/pgoell/pgoell-claude-tools --skill creating-skills-pgoell
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: creating-skills
Source: https://github.com/pgoell/pgoell-claude-tools/tree/main/plugins/agent-system-management/skills/creating-skills
Command: npx skills add https://github.com/pgoell/pgoell-claude-tools --skill creating-skills-pgoell

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing an effective agent skill is hard to get right on the first try: descriptions fail to trigger, instructions get ignored under pressure, and there is no systematic way to know whether a change actually improved the skill. This Skill provides a full lifecycle workflow for drafting skills, running with-skill versus baseline evaluations, grading outputs against assertions, and iterating based on quantitative benchmarks and user feedback. ## Core Features & Use Cases - Guided skill authoring: Captures intent through interview questions, then writes SKILL.md files following best practices for names, descriptions, progressive disclosure, and writing style. - Evaluation harness: Spawns parallel with-skill and baseline runs, drafts verifiable assertions, captures timing and token data, and aggregates results into benchmark.json with pass rates and variance analysis. - Review viewer: Launches a browser-based viewer (via eval-viewer/generate_review.py) showing qualitative outputs and quantitative benchmarks, collecting user feedback into feedback.json for the next iteration. - Description optimization and bulletproofing: Improves triggering accuracy and pressure-tests discipline-enforcing skills using rationalization tables and red-flag patterns. - Use Case: You want a skill that formats release notes. The Skill helps you draft it, creates three realistic test prompts, runs them with and without the skill, shows you a side-by-side comparison in the browser, and rewrites the skill based on your feedback until the benchmark shows consistent improvement. ## Quick Start Help me create a new skill that converts meeting transcripts into structured action-item lists, then test and refine it.

Frequently Asked Questions about creating-skills

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new agent skill from scratch?

Start by capturing intent: what the skill should do, when it should trigger, and its expected output format. Then write a SKILL.md draft with a name and description in YAML frontmatter, create 2-3 realistic test prompts, and run them with and without the skill to evaluate results.

How do I test whether my skill actually improves agent output?

Run each test prompt twice in parallel: once with the skill loaded and once as a baseline without it. Grade both outputs against objective assertions, then aggregate results with the benchmark script to compare pass rates, timing, and token usage.

What makes a good skill description for triggering?

A good description front-loads the skill's leading word, lists each genuinely distinct trigger branch once, and stays third person without summarizing the workflow. Keep it short since every word sits in context each turn, and put the key use case in the first sentence.

When should I use a skill versus CLAUDE.md instructions?

Use a skill for procedures: multi-step workflows, checklists, and instructions the user keeps re-explaining. Put plain facts and preferences in CLAUDE.md instead, since CLAUDE.md content loads every turn while a skill body loads only when triggered.

Why does my skill get ignored by the agent under pressure?

Discipline-enforcing skills fail when agents rationalize skipping rules under time or authority pressure. Run baseline pressure scenarios first, capture the agent's exact rationalizations, then counter them with explicit negations, rationalization tables, and red-flag lists.

Can I benchmark a skill without the browser review viewer?

Yes, in headless environments pass the --static flag to generate_review.py to write a standalone HTML file instead of starting a server. Feedback downloads as feedback.json, which you copy into the workspace for the next iteration.