Automate creation, testing, and refinement of Claude skills with SKILL.md and evals.
npx skills add https://github.com/yibozhong/skills --skill skill-creator-yibozhong
Please help me install this Agent Skill. Skill: skill-creator Source: https://github.com/yibozhong/skills/tree/main/skill-creator Command: npx skills add https://github.com/yibozhong/skills --skill skill-creator-yibozhong
The Skill unit helps teams systematically create, test, and improve Claude skills by providing a repeatable workflow for drafting SKILL.md, running trigger evaluations, benchmarking results, and iterating based on feedback.
Draft the SKILL.md, prepare a small eval set, and run the evaluation loop to start iterating on a skill.
High-intent search queries and answers about installing and using this skill.
Automating Claude skill refinement involves running trigger-evaluation loops across train/test splits, collecting metrics, and iterating the skill description. This workflow specifies when to trigger and how to improve triggering accuracy using scripts and benchmark results.
Structuring a SKILL.md file requires drafting frontmatter and operational instructions to document the skill. This process organizes the prompt engineering logic and specifies when the skill should trigger within the Claude environment.
An evaluation loop works by running automated trigger tests across train/test splits and recording results in a structured format. It then analyzes benchmarks to iterate the skill description and scripts, generating a final optimized skill with improved triggering accuracy.
Yes, pyyaml is required to run skill evaluations and benchmarks. This dependency supports the scripts that manage the SKILL.md file, run automated evals, and collect metrics for the iteration workflow.
Yes, you can generate an optimized skill description from benchmark results. The workflow analyzes the collected metrics from the evaluation loops and iterates the skill description to improve triggering accuracy and overall effectiveness.
jubalmCreate reusable Claude Skills with YAML metadata and Markdown instructions.
Junghyun99Create and evaluate Claude skills with SKILL.md and Python tooling.
wrayreAutomate the end-to-end lifecycle of skill creation, testing, and benchmarking.
yasuwrldhyperCreate and refine AI skills with SKILL.md metadata and benchmark testing.
