benchmark-coder

What problem does it solve?

Translates approved benchmark handoffs into executable benchmark_script.py and helper modules, preserving planner contracts and enabling robust validation, simulation, and evidence collection.

Core Features & Use Cases

• Translates the approved planner handoff into benchmark_script.py and helper modules that implement the contracted benchmark.
• Validates and simulates revisions before handoff, ensuring compliance with geometry and inventory constraints.
• Generates review-ready evidence and documentation (e.g., plan_refusal, renders, and scene data) for reviewers.

Quick Start

Run the benchmark coder on the approved handoff to generate benchmark_script.py and supporting artifacts, then validate and simulate the revision before handoff.