What problem does it solve?
Experiments produce numbers; this gate judges what those numbers mean by providing an objective assessment of whether the results support the intended claims and routing to the next action (pivot, supplement, or confirm).
Core Features & Use Cases
- Collect results from available sources (W&B, EXPERIMENT_LOG.md, EXPERIMENT_TRACKER.md, log files, and project notes) and assemble the key information: what experiments were run, the methods, datasets, configurations, main metrics, baselines, and verdicts.
- Perform a secondary Codex judgment to evaluate whether the results support the intended claim, including fields like claim_supported, what_results_support, what_results_dont_support, missing_evidence, and suggested_next_experiments.
- Parse and normalize the Codex response and route decisions accordingly, recording the verdict and reasoning in findings.md and project notes.
Quick Start
Provide the collected results and intended claim, then trigger the result-to-claim workflow to obtain a verdict and routing guidance.