nemo-mbridge-perf-moe-dispatcher-selection

What problem does it solve?

Helps engineers select the optimal MoE token dispatcher (alltoall, DeepEP, or HybridEP) for Megatron Bridge workloads, reducing trial-and-error and aligning with hardware and EP configurations.

Core Features & Use Cases

• Hardware-aware dispatcher guidance: Recommends the best dispatcher per hardware (H100, GB200, GB300 NVL72) and EP degree.
• Back-end and tuning guidance: Documents the required flex backend settings (deepep, hybridep) and default SM tuning knobs, with notes on environment limitations.
• Use cases: Useful when bringing up MoE models, tracing regressions, or selecting configurations for Qwen3/DSV3 families.

Quick Start

Run the MoE dispatcher selector for your hardware and EP size to obtain the recommended dispatcher and default tuning knobs.