skill-creator

Automates creation, evaluation, and iteration of AI skills with run_eval.py and run_loop.py scripts.

316|42|Updated Apr 5, 2026
One-click install
npx skills add https://github.com/xwtro0tk1t-cloud/harness --skill skill-creator-xwtro0tk1t-cloud
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/xwtro0tk1t-cloud/harness/tree/main/bundled-skills/skill-creator
Command: npx skills add https://github.com/xwtro0tk1t-cloud/harness --skill skill-creator-xwtro0tk1t-cloud

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pypdf, pdfplumber, pdf2image, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill provides a structured methodology to create, improve, evaluate, and benchmark AI skills. It guides users through drafting skills, running trigger-evaluation loops, performing iterations, and delivering measurable improvements.

Core Features & Use Cases

  • End-to-end skill development workflow: draft → test prompts → run evals → iterate to convergence.
  • Built-in evaluation, benchmarking, and results visualization to compare iterations.
  • Auto-improvement of the skill description via history-aware optimization and holdout testing.
  • Packaging and distribution support to create a distributable .skill artifact and reuse in multiple projects.

Quick Start

Kick off the loop by drafting a skill, launching the evaluation loop, and iterating until you achieve a stable, high-performing description.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate the workflow for creating and evaluating AI skills?

You can automate AI skill creation by running an evaluation loop that drafts skills, tests prompts, benchmarks iterations, and auto-improves descriptions using history-aware optimization until achieving stable performance.

What is trigger-evaluation loop iteration for prompt engineering?

Trigger-evaluation loop iteration is a testing mechanism that repeatedly runs prompts against holdout test sets, benchmarks the results, and refines the skill description to produce consistent, traceable upgrades with measurable improvements.

Can I benchmark AI skill performance across multiple prompts and holdout test sets?

Yes, you can benchmark AI skill performance across multiple prompts and holdout test sets by using built-in evaluation scripts that compare iterations and visualize results to deliver measurable, traceable skill improvements.

Does AI skill development require integration with specific evaluation scripts?

Yes, AI skill development requires integration with evaluation scripts like run_eval.py and run_loop.py to perform frontmatter validation, script packaging, and optional live reporting for consistent, traceable skill upgrades.

What's the best way to package a distributable AI skill artifact for reuse?

The best way to package a distributable AI skill artifact is to use the built-in packaging and distribution support, which compiles the validated scripts and assets into a reusable .skill artifact for deployment across multiple projects.

Why does my AI skill description not converge during iteration testing?

Your AI skill description may not converge during iteration testing if the history-aware optimization lacks sufficient holdout test sets or if the trigger-evaluation loop fails to apply consistent benchmarking across multiple prompts.