fr-analysis

What problem does it solve?

Analyze PyTorch NCCL flight-recorder (FR) dumps to identify the collective operation hang and isolate the responsible ranks using CollectiveAnalyzer.

Core Features & Use Cases

• Loads and parses FR dump files into structured Collective records (op type, ranks, process group, timing, state).
• Groups data by process group and sequence across ranks to detect mismatches and divergence.
• Identifies the wavefront boundary where collectives diverge and returns missing ranks as root-cause suspects.
• Optionally runs an LLM pass over findings for a narrative summary (--llm-analyze).
• CLI/API usage with scripts/fr_attribution.py to produce actionable attributions.

Quick Start

Run the attribution script on your FR dump directory to generate the root-cause report.