Evaluate agent performance using multi-dimensional rubrics and weighted scores.
npx skills add https://github.com/yeeehaooo/agent-kit --skill evaluation-yeeehaooo
Please help me install this Agent Skill. Skill: evaluation Source: https://github.com/yeeehaooo/agent-kit/tree/main/.agent-skills/skills/evaluation Command: npx skills add https://github.com/yeeehaooo/agent-kit --skill evaluation-yeeehaooo
This skill provides a structured framework to evaluate agent performance, enabling objective, reproducible quality assessments across iterations and deployments.
Install or run the evaluation framework and load a prepared test set to begin scoring agent outputs against defined rubrics.
High-intent search queries and answers about installing and using this skill.
Agent performance evaluation uses a deterministic rubric-driven evaluator and test-set management to score outputs against multi-dimensional rubrics. It assesses factual accuracy, completeness, citation quality, source credibility, and tool efficiency to compute weighted scores from per-dimension results.
Multi-dimensional rubric evaluation assesses agent outputs across factual accuracy, completeness, citation quality, source credibility, and tool efficiency. It combines automated checks with human review to provide objective, reproducible quality assessments across iterations and deployments.
Yes, production monitoring is supported through built-in monitoring hooks within the evaluation pipeline. These hooks track agent quality over time by combining automated checks with test set management to monitor performance across dashboards.
Validate context engineering strategies by running the evaluation framework against a prepared test set. This benchmarks agent configurations by computing weighted scores from per-dimension results using the deterministic rubric-driven evaluator.
Yes, the evaluation framework enforces quality gates in continuous deployment by combining automated checks with human review. It uses test set management and production monitoring to ensure objective, reproducible quality assessments before deployment.
Rubric-driven evaluation relies on predefined dimensions like factual accuracy and tool efficiency, meaning unanticipated agent behaviors outside the rubric scope may go unscored. It requires prepared test sets and combines automated checks with human review to mitigate gaps.
Shakudo-ioEvaluate agent outputs against multi-dimensional rubrics with weighted scoring.
DevMHOneMonitor provider health, circuit-breaker states, and latency metrics in real time.
hussain9491Evaluate agent performance using structured rubrics and test sets.
shanelindsayEvaluate scholarly work with criteria-based scoring across eight dimensions.
