experiment-audit

To audit experiment statistics for rigor, you run a deterministic statistical audit against an experiment directory or paper to verify statistical sufficiency, assess baseline strength, and check ablation isolation, generating a structured audit record.

Ablation isolation checking is a statistical audit process that verifies whether experimental results genuinely isolate the contribution of individual components, preventing overclaiming by validating ablation study boundaries against provided metrics.

Yes, you can detect overclaiming and identify missing baselines by applying the statistical audit and baseline strength assessment to papers under review, which maps directly to standard review vectors and generates a structured audit report.

You run the audit by targeting an experiment directory that contains results.json, trials.csv, or metrics.json files, which triggers the scripts/audit_stats.py module to compute thresholds and generate a structured audit record.

No external dependencies or specific frameworks are required to function, as the audit relies solely on internal scripts to perform the deterministic statistical audit, baseline strength assessment, and ablation isolation checks against your provided files.