experiment-analysis

Elo trajectory analysis retrieves and interprets Elo progression metrics from WandB across training checkpoints. Run the provided script with your run name to fetch Elo data, then extract initial, peak, and final values to diagnose learning dynamics and identify performance plateaus or regressions in your experiment.

Extract training metrics, Elo scores, throughput data, and error logs from WandB and Axiom to diagnose GRPO pipeline issues. The Skill pulls these metrics to surface learning dynamics, adapter performance, baseline comparisons, and actionable insights for experiment tracking across multiple runs.

Yes, the Skill identifies checkpoints and baseline runs, then generates formatted comparison tables showing Elo metrics across adapters. This lets you diagnose relative performance, training stability, and experiment outcomes side-by-side to isolate which configurations drive learning gains.

Diagnose GRPO training runs by fetching WandB metrics and Axiom logs to extract agent trajectories, compute Elo progressions, and identify errors or throughput bottlenecks. The Skill generates summaries and highlighted reports that surface pipeline issues and anomalies affecting experiment performance.

You need WandB integration configured for your GRPO runs and access to Axiom logs. The Skill requires run metadata, Elo metric availability, and properly tagged experiments to fetch and compute diagnostics; ensure your training pipeline logs to both platforms.

The Skill integrates with WandB for metrics extraction and Axiom for log analysis. It outputs formatted tables and summaries for dashboards and experiment trackers, making results compatible with downstream reporting and visualization tools in your analytics workflow.