What problem does it solve?
Experiments generate numbers and claims, but teams need a clear verdict on what the results actually support. This Skill provides a structured gate that evaluates results against intended claims and directs next steps (pivot, supplement, or confirm) using Codex judgments.
Core Features & Use Cases
- Collect Results: Gather metrics and evidence from available sources such as wandb histories, EXPERIMENT_LOG.md, EXPERIMENT_TRACKER.md, training logs, and docs/research_contract.md to capture the full experimental context.
- Codex Judgment: Send the assembled information to Codex for an objective evaluation and produce a verdict with guidance on next actions.
- Parse and Normalize: Extract structured fields (e.g., claim_supported, what_results_support, what_results_dont_support, missing_evidence, suggested_claim_revision, next_experiments_needed, confidence) for consistent routing.
- Route Based on Verdict: Apply the verdict to determine post-processing steps: no -> postmortem and pivot; partial -> refine claims and run supplementary experiments; yes -> mark claim as supported and proceed to paper drafting.
Quick Start
After experiments finish, run the result-to-claim workflow to obtain Codex judgment and auto-route the results.