What problem does it solve?
It solves the problem of getting external research code working end to end so you can reproduce a specific paper result reliably, rather than getting stuck on setup issues or undocumented commands.
Core Features & Use Cases
- Hermetic environment setup: installs the code in a container or isolated environment pinned to the correct commit/tag and compatible dependency stack.
- Deterministic, result-first execution: maps each claimed figure/table/number to an exact command, config, and output location.
- Honest reproduction with a log: generates a
repro.md reproduction log and tracks minimal, recorded edits needed to run (without logic tampering).
Quick Start
Ask an agent to reproduce the paper’s Figure 3 by installing the provided GitHub repo or paper artifact in an isolated environment, running the smallest smoke test, executing the exact result command(s), and writing a repro.md with reproduced-versus-claimed numbers and any minimal diffs.