Create and tune Claude skills through iterative evaluation and benchmarking.
npx skills add https://github.com/noartem/kawa --skill skill-creator-noartem
Please help me install this Agent Skill. Skill: skill-creator Source: https://github.com/noartem/kawa/tree/main/ui/.ai/skills/skill-creator Command: npx skills add https://github.com/noartem/kawa --skill skill-creator-noartem
The Skill Creator helps teams design and improve Claude skills by guiding end-to-end workflow: drafting SKILL.md, validating it, running iterative evals, benchmarking, and description optimization.
Define the skill's goal, create SKILL.md content, add any resources under scripts/, references/, and assets/, then run the evaluation loop to iterate until triggering becomes reliable.
High-intent search queries and answers about installing and using this skill.
To create and tune Claude skills, define the skill's goal, draft the SKILL.md file with frontmatter, and run an iterative eval loop using scripts to test, collect results, and benchmark until triggering becomes reliable.
Improve Claude skill triggering accuracy by applying description optimization techniques to refine the frontmatter, then validate the changes by running benchmark tests to compare pass rates across variants.
Benchmark Claude skill performance by aggregating timing and pass rates from the evaluation loop, then analyze the structured evals.json output and viewer artifacts to compare skill variants and identify improvements.
Yes, pyyaml is required as a dependency to automate Claude skill workflow evaluation, as it processes the YAML frontmatter structure used within the SKILL.md files for skill configuration and description optimization.
The evaluation loop works by executing tests against drafted SKILL.md content, collecting pass rate results, and allowing you to iterate using scripts and evaluative prompts to continuously improve skill triggering and performance.
A SKILL.md file should include the skill name, description, compatibility details, and references to ensure proper validation, alongside any supporting resources organized under scripts, references, and assets directories.
FujishigeTemmaCreate, modify, and evaluate AI skills with SKILL.md files and test cases.
AnveioMeasure first-pass verification rates for automated code verification pipelines.
vuanhtu1993Create, validate, and package Claude Skills into .skill files.
LucasMatuszewskiDesign, draft, and iteratively improve Claude skills with SKILL.md frontmatter.
