What problem does it solve?
EmpiricalWiki users often have a hypothesis or idea but still need a rigorous, end-to-end experimental plan that turns claims into an ordered set of baseline, validation, ablation, and robustness experiments.
Core Features & Use Cases
- Claim scoping (Target / Decomposition / Threats): Converts an idea into a structured set of claims to verify, isolate, and potentially refute.
- Four-phase experiment blocks: Creates baseline (reproduce), validation (prove target), ablation (isolate factors), and robustness (stress threats) blocks with explicit success criteria.
- Wiki + graph writeback: Produces experiment pages under wiki/experiments and adds tested_by edges linking claims to experiments, plus rebuilds graph context artifacts.
- Optional Review LLM: With --review, runs a reviewer pass to catch missing baselines, unfair comparisons, weak statistical rigor, and propose concrete fixes.
Quick Start
Run exp-design on a wiki idea slug to generate a full staged experiment plan and write the resulting experiment pages and claim edges into the wiki.