eval-dataset
OfficialGenerate robust evaluation test cases for skills.
Authoropendatahub-io
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Automates the generation of end-to-end evaluation test cases for skills, ensuring coverage against a defined eval.yaml/spec and judge criteria.
Core Features & Use Cases
- Generate diverse, judge-driven test cases aligned to dataset schemas and evaluation config.
- Create context artifacts like inputs.yaml, annotations.yaml, answers.yaml, and companion files as needed.
- Validate case structure and provide guidance for expanding or refining evaluation coverage.
Quick Start
Run /eval-dataset to generate a complete set of evaluation test cases for a target skill.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: eval-dataset Download link: https://github.com/opendatahub-io/agent-eval-harness/archive/main.zip#eval-dataset Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.