skill-creator

Create, test, and optimize AI skills by drafting SKILL.md and iterating on evaluations.

Updated Mar 20, 2026
One-click install
npx skills add https://github.com/dljsjr/sandpiper-ai --skill skill-creator-dljsjr
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/dljsjr/sandpiper-ai/tree/main/skills/third-party/skill-creator
Command: npx skills add https://github.com/dljsjr/sandpiper-ai --skill skill-creator-dljsjr

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml.

What problem does it solve?

The Skill Creator provides a structured, repeatable workflow to turn ideas into fully defined AI skills. It guides you through drafting SKILL.md, designing evaluation prompts, running iterative tests, and refining both the skill body and its triggering description, enabling scalable, quality-controlled skill development.

Core Features & Use Cases

  • End-to-end skill creation workflow: capture intent, draft SKILL.md content, and assemble evaluation sets.
  • Evaluation and iteration loop: run trigger tests, analyze results, and refine both the skill body and frontmatter based on feedback.
  • Automation tooling: leverage existing scripts (generate_report.py, run_eval.py, improve_description.py, aggregate_benchmark.py) to scale skill development and benchmarking.
  • Reference and extension management: organize optional references, assets, and scripts to support multi-domain skills.

Quick Start

Begin by writing a concise SKILL.md and run the evaluation loop to draft, test, and improve the skill description.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create and test AI skills systematically?

To create and test AI skills systematically, draft a concise SKILL.md, prepare evaluation prompts, and iterate on the skill body and triggering description based on benchmark results. This structured workflow ensures quality-controlled skill development.

What is the best workflow for optimizing AI skill descriptions?

The best workflow for optimizing AI skill descriptions involves drafting the skill content, running trigger tests with evaluation prompts, and refining the frontmatter based on feedback and benchmark aggregation to improve triggering accuracy.

Do I need pyyaml to automate skill evaluation and iteration?

Yes, you need pyyaml to automate skill evaluation and iteration. This dependency supports the Python scripts used for generating reports, running evaluations, and aggregating benchmarks to scale skill development.

Can I use automation scripts to scale AI skill benchmarking?

Yes, you can use automation scripts like generate_report.py, run_eval.py, improve_description.py, and aggregate_benchmark.py to scale AI skill benchmarking, analyze evaluation results, and refine both the skill body and frontmatter.

How does an evaluation and iteration loop work for AI skills?

An evaluation and iteration loop for AI skills works by running trigger tests, analyzing the results against prepared eval prompts, and refining the SKILL.md content and description based on feedback until the skill meets quality benchmarks.

What should I prepare before drafting an AI skill?

Before drafting an AI skill, you should prepare a clear intent for the skill, optional references, assets, and any supporting scripts to organize multi-domain functionality, ensuring a structured and repeatable creation workflow.