harness-evaluator-rubric

Builds a task-specific evaluator rubric from the active contract before the Judge phase.

Updated Jul 29, 2026
One-click install
npx skills add https://github.com/MaiconGambini/opencode-harness-guide --skill harness-evaluator-rubric-maicongambini
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: harness-evaluator-rubric
Source: https://github.com/MaiconGambini/opencode-harness-guide/tree/main/skills/harness-evaluator-rubric
Command: npx skills add https://github.com/MaiconGambini/opencode-harness-guide --skill harness-evaluator-rubric-maicongambini

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? It prevents self-judged, evidence-free verdicts in agent workflows by producing a structured scoring rubric grounded in the active contract and measured gate reports before any accept or revise decision. ## Core Features & Use Cases - Contract-driven rubric: Loads the sprint contract, feature spec acceptance criteria, or approved PREVC plan to derive judgement rows specific to the task. - Measured vs judgement rows: Copies measured metrics verbatim from agent-os/quality-thresholds.json and scores them from the newest gate report, avoiding drifting duplicate thresholds. - Scoring discipline: Applies a 1-5 scale with accept, block, and revise rules, including unavailable scoring for missing tools and a Revise cap for any red measured row. - Use Case: After Execute and Validate complete in a PREVC sprint, run this skill to produce a rubric with evidence that is handed to the Judge phase instead of self-approving the work. ## Quick Start Build the evaluator rubric for the current sprint using the contract in docs/harness/sprint-contract.md and the newest gate report under docs/harness/quality.

Frequently Asked Questions about harness-evaluator-rubric

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build an evaluator rubric before judging agent work?

Run this skill after Execute and Validate complete. It loads the sprint contract, feature spec acceptance criteria, or approved PREVC plan, then produces a rubric table with measured and judgement rows scored 1-5 with evidence, which is sent to the Judge phase.

What is the difference between measured and judgement rubric rows?

Measured rows are copied verbatim from agent-os/quality-thresholds.json and scored from the newest gate report, never by reading code. Judgement rows are task-specific criteria built from the contract, such as scope discipline and handoff readiness.

When should the evaluator rubric run in a PREVC workflow?

It runs after Execute and Validate and before any verdict is claimed. The rubric and its evidence are handed to the Judge phase; the skill explicitly forbids self-approval of the work it evaluates.

What happens when a measured metric tool is unavailable?

The row is scored as unavailable, not as a pass or fail. It is excluded from the average and listed as a gap, preventing a gate that measures almost nothing from reading as green.

Can a candidate be accepted if one measured row is red?

No. Any red measured row caps the candidate at Revise regardless of the average score. Acceptance requires an average of at least 4.0 with no 1-scores and no red measured rows.