ds-eval

Official

QA test for skill trigger accuracy.

AuthorDataslayer-AI
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Internal development tool that tests whether skill descriptions trigger correctly for different user inputs. Reads test cases from a YAML file and evaluates each one by matching the input against all skill descriptions. Use when the user says "run triggering eval", "test skill descriptions", "check triggering accuracy", "eval skills", or after editing a skill description to verify it still triggers correctly.

Core Features & Use Cases

  • Frontmatter-driven evaluation: load each skill's name and description from their SKILL.md frontmatter and compare to inputs.
  • Trigger analysis: determine best match, ambiguous, or no match.
  • Regression testing helper: re-run after editing skill descriptions to ensure triggering remains correct.

Quick Start

Run ds-eval with a sample input to verify which skill would trigger.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: ds-eval
Download link: https://github.com/Dataslayer-AI/Marketing-skills/archive/main.zip#ds-eval

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.