eval-harness-ops
CommunityRun rigorous AI agent evaluations.
AuthorXiaoPuOuO
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Organizations shipping AI agents need a formal, reproducible evaluation process that gates changes with measurable quality criteria. This Skill provides a structured plan to design datasets, rubrics, thresholds, regression checks, and reporting to ensure safe deployments.
Core Features & Use Cases
- Dataset curation: Build representative evaluation datasets with segmentation by user role and risk tier.
- Rubric design: Create scoring schemes that multiple reviewers can apply consistently.
- Thresholds & gates: Define pass/fail criteria and regression gates to prevent silent degradation.
- Reporting: Generate actionable results and a final go/no-go recommendation for release decisions.
Quick Start
Design and run an evaluation plan that measures policy compliance, dataset quality, and go/no-go criteria.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: eval-harness-ops Download link: https://github.com/XiaoPuOuO/VFactory/archive/main.zip#eval-harness-ops Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.