skill-creator

Automate creation, testing, and iterative improvement of Claude-compatible SKILL.md packages.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/Norfolk-Group/H-Analytics --skill skill-creator-norfolk-group
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/Norfolk-Group/H-Analytics/tree/main/.agents/skills/skill-creator
Command: npx skills add https://github.com/Norfolk-Group/H-Analytics --skill skill-creator-norfolk-group

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

Skill-creator removes the friction of designing, validating, and iterating Claude-compatible skills by providing a repeatable, end-to-end workflow for drafting SKILL.md files, running trigger and functional evaluations, grading outputs, and packaging distributable skill bundles. It centralizes scaffolding, test-case generation, evaluation tooling, and a review UI so teams don't rely on ad-hoc prompts or manual benchmarking.

Core Features & Use Cases

  • Draft & Scaffold: Create well-formed SKILL.md frontmatter and guidance for when a skill should trigger.
  • Eval & Benchmark: Generate eval sets, run parallel trigger tests, grade outputs, aggregate pass rates, timing, and token metrics.
  • Iterate & Improve: Automate description optimization, propose revisions, and run iterative train/test loops to avoid overfitting.
  • Packaging & Review: Package skills into .skill archives, generate static review pages, and provide grader/comparator/analyzer agents for rigorous blind comparisons.
  • Use Case: A developer or product manager drafts a new skill, seeds 2–3 test prompts, runs a 3-iteration optimization loop, reviews results in the eval viewer, and packages the final skill for distribution.

Quick Start

Tell the skill-creator to draft a new SKILL.md for your desired workflow, add two realistic test prompts to evals/evals.json, run the eval loop to generate a benchmark, and produce a packaged .skill.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create and test Claude-compatible AI skills programmatically?

Automate Claude-compatible skill creation by drafting SKILL.md frontmatter, generating trigger evaluations, running parallel benchmark tests, grading outputs, and packaging the validated bundle into a distributable .skill archive.

What is the best way to benchmark and evaluate AI prompt performance locally?

Benchmark prompt performance by generating eval sets, running parallel trigger tests, grading outputs, and aggregating pass rates alongside timing and token metrics to quantify iterative improvements.

Does the skill-creator workflow require Python or the Claude CLI to run evaluations?

Yes, the skill-creator workflow relies on Python scripts and the claude CLI to automate trigger-eval generation, benchmarking, grading schemas, and packaging for local scripting hooks.

How do I optimize SKILL.md descriptions and avoid overfitting during prompt engineering?

Optimize SKILL.md descriptions by automating revision proposals and running iterative train/test loops, using grader and comparator agents for rigorous blind comparisons to avoid overfitting.

Can I generate a review UI for AI skill testing without manual benchmarking?

Yes, you can generate static review pages and an eval viewer automatically after running your test loops, eliminating the need for ad-hoc prompts or manual benchmarking during skill validation.