What problem does it solve?
Automates the creation of a complete, reproducible 13-section experiment report for flame_moonshot training runs by collecting logs, configs, metrics, artifacts, git metadata, and visualizations so researchers can verify results and diagnose failures efficiently.
Core Features & Use Cases
- Collects training logs, CSV metrics, model and run configuration files, SLURM or run scripts, artifacts notes, and available PNG visualizations.
- Enforces metric provenance by recording file paths, line numbers and step indices and includes formal mathematical definitions for reported metrics, plus a reproducibility checklist and failure analysis.
- Use cases include post-run forensic analysis, preparation of reproducibility bundles for publication, and rapid triage of training anomalies.
Quick Start
Use gen-report-detailed to generate a timestamped detailed markdown report for a given experiment by providing the experiment name and root directory when prompted.