skill-eval-runner

Simulate trigger decisions to evaluate skill descriptions with pass/fail results.

4|Updated Jan 29, 2026
One-click install
npx skills add https://github.com/danmestas/wardrobe --skill skill-eval-runner
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-eval-runner
Source: https://github.com/danmestas/wardrobe/tree/main/skills/skill-eval-runner
Command: npx skills add https://github.com/danmestas/wardrobe --skill skill-eval-runner

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This tool automates binary pass/fail evaluations of skill descriptions by simulating trigger decisions, enabling quick verification of whether a skill would be invoked by a given prompt without external LLM judgments.

Core Features & Use Cases

  • Binary evals: run strict pass/fail checks for skill triggers based on the frontmatter description.
  • Auto-retest on edits: re-evaluate triggers whenever a skills/*/SKILL.md changes to ensure up-to-date behavior.
  • Local reasoning: uses built-in heuristics to judge description-trigger alignment and report clear pass/fail outcomes.

Quick Start

Invoke /eval skill <name> to run the binary trigger tests for that skill.

Frequently Asked Questions about skill-eval-runner

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate binary pass/fail evaluations for AI skill trigger routing?

You can automate binary skill evaluations by simulating trigger decisions against skill descriptions, running strict pass/fail checks to verify whether a prompt invokes a skill without external LLM judgments.

How do I verify prompt routing triggers after editing a SKILL.md file?

To verify prompt routing after edits, the evaluation runner automatically re-evaluates triggers whenever a skills/*/SKILL.md file changes, ensuring your trigger alignment remains accurate and up-to-date.

Can I run AI prompt regression checks without making external API calls?

Yes, you can run prompt regression checks locally without external API calls by using built-in heuristics that read skill frontmatter and eval specs to judge description-trigger alignment and report pass/fail outcomes.

What is the best way to test if a prompt will trigger a specific skill locally?

The best way to test prompt triggering locally is to simulate trigger decisions against the skill frontmatter description, producing per-prompt results and a final pass/fail outcome based on alignment heuristics.

Do I need external dependencies or components to run skill validation checks?

No external dependencies or components are required to run skill validation checks; the runner uses local reasoning and built-in heuristics to read frontmatter directly and evaluate trigger alignment.