skill-creator

Create and iteratively improve AI agent skills through structured evaluation and benchmarking.

11|Updated May 6, 2026
One-click install
npx skills add https://github.com/open-neko/openneko --skill skill-creator-open-neko
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/open-neko/openneko/tree/main/packages/llm/assets/builtin-skills/skill-creator
Command: npx skills add https://github.com/open-neko/openneko --skill skill-creator-open-neko

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Building AI skills that reliably trigger and perform well requires more than good instructions — it needs systematic testing, measurement, and iterative refinement. Without structured evaluation, skills undertrigger, behave inconsistently, or fail on edge cases, leaving developers unsure whether their changes actually help.

Core Features & Use Cases

  • Structured Skill Creation: Capture user intent, draft SKILL.md files with proper frontmatter and progressive disclosure, and organize resources into scripts, references, and assets.
  • Quantitative Evaluation: Run parallel test cases with and without the skill, grade outputs against assertions, and aggregate benchmark statistics to measure real impact.
  • Description Optimization: Automatically optimize triggering descriptions using train/test splits to improve when the skill activates, addressing common undertriggering issues.
  • Use Case: You want to build a skill that automates invoice data extraction. Use this skill to draft the initial SKILL.md, create test prompts with sample invoices, run benchmarks comparing with/without the skill, and iteratively improve the description and instructions until it reliably extracts line items and totals.

Quick Start

Use the skill-creator skill to build a new skill for extracting data from invoices by describing what you want it to do, then test it with sample prompts and refine based on the benchmark results.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test and benchmark AI agent skills to measure real impact?

AI skills undertrigger or behave inconsistently because they lack systematic testing, measurement, and iterative refinement. Without structured evaluation and assertion-based grading, developers are left unsure whether their prompt engineering changes actually resolve edge case failures.

How to create an AI agent skill from a draft to a tested SKILL.md file?

Creating an AI agent skill involves capturing user intent, drafting a SKILL.md file with proper frontmatter, organizing resources into scripts and references, and generating test cases. You then iteratively improve the instructions through quantitative grading.

What is the best way to optimize skill descriptions for triggering accuracy?

The best way to optimize skill descriptions for triggering accuracy is using train/test splits. This description optimization process automatically refines when the skill activates, directly addressing common undertriggering issues in agent workflows.

Do I need pyyaml to generate test cases and run skill benchmarks?

Yes, pyyaml is required. This testing and benchmarking process requires pyyaml to parse SKILL.md frontmatter and configuration files during test harness execution, assertion-based grading, and statistical aggregation to validate skill performance against baselines.

Why does my AI skill undertrigger or fail on edge cases during evaluation?

AI skills undertrigger or behave inconsistently because they lack systematic testing, measurement, and iterative refinement. Without structured evaluation and assertion-based grading, developers are left unsure whether their prompt engineering changes actually resolve edge case failures.