eval-review
OfficialHuman-in-the-loop eval improvements.
Data & Analytics#evaluation#transcripts#mlflow#skill-improvement#human-feedback#case-analysis#review-results
Authoropendatahub-io
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Facilitates thorough, human-in-the-loop review of evaluation results by surfacing judge outcomes, qualitative feedback, and actionable improvement opportunities for evaluation SKILLs.
Core Features & Use Cases
- Analyze per-case judge scores and outputs to identify where automated checks align with or miss human expectations.
- Collect and synthesize user feedback and transcripts to detect recurring issues across runs, guiding SKILL.md improvements.
- Propose targeted SKILL.md changes and evaluation workflow adjustments to drive faster, iterative improvements.
Quick Start
Review a run by providing --run-id and follow the prompts to collect human feedback and generate improvement recommendations.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: eval-review Download link: https://github.com/opendatahub-io/agent-eval-harness/archive/main.zip#eval-review Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.