Evaluate patch.diff and handoff.json against task scope, generating verdict.json.
npx skills add https://github.com/OilProducts/agent-skills --skill judge-evaluate
Please help me install this Agent Skill. Skill: judge-evaluate Source: https://github.com/OilProducts/agent-skills/tree/main/judge-evaluate Command: npx skills add https://github.com/OilProducts/agent-skills --skill judge-evaluate
This Skill automates the evaluation of proposed code changes and their accompanying artifacts, ensuring they meet task scope and verification checks, and producing a machine-readable verdict.
patch.diff and handoff.json against predefined checks.verdict.json with clear pass, reject, or needs-human statuses.pytest, ruff check) for objective assessment.Use the judge-evaluate skill to evaluate the submitted patch and handoff artifacts for task 'TASK-0042'.
High-intent search queries and answers about installing and using this skill.
Automated code review evaluates patch.diff and handoff.json against predefined verification checks, producing a machine-readable verdict.json. It validates handoff integrity and runs deterministic evaluation commands like pytest or ruff check to accept, reject, or escalate code changes objectively.
A machine-readable verdict for patch evaluation is a structured verdict.json file that outputs clear pass, reject, or needs-human statuses. It synthesizes evidence from deterministic evaluation commands and handoff artifact validation without modifying source files.
Deterministic evaluation commands run on a proposed implementation patch by executing specified checks like pytest and ruff check within the evaluation workflow. The skill validates handoff integrity first, then runs these commands to synthesize an objective verdict.json.
Automated patch evaluation supports a separate judging role by accepting patch.diff and handoff.json from a doer, validating task scope and verification checks, and outputting a verdict.json. The judge can accept, reject, or escalate without editing source files directly.
Automated code change evaluation does not edit source files and relies on deterministic evaluation commands. It produces needs-human statuses when checks fail or handoff integrity is compromised, meaning it cannot resolve ambiguous patches autonomously and requires human intervention for escalated cases.
OilProductsImplement scoped software tasks and generate patch.diff and handoff.json artifacts.
MonumentalSystemsStandardize CI/CD pipeline design for build, test, and deployment workflows.
MartinNevlahaExecute project test suites and linters across Python, Node.js, and Go/Rust codebases.
duongtdnReview GitHub issues and verify implementations against acceptance criteria.