nemo-mbridge-perf-parallelism-strategies

What problem does it solve?

This skill helps engineers select and size parallelism strategies for Megatron Bridge, enabling efficient training across diverse model sizes and hardware topologies.

Core Features & Use Cases

• Decision guidance: choose appropriate data and tensor parallelism (DP, TP) and pipeline/sequence controls (PP, SP, CP) for target models.
• MoE support: provide guidance for expert_parallel and EP/ETP configurations on mixture-of-experts models.
• Use Case Example: when configuring training for a 236B MoE model across 16 GPUs, the skill helps derive a robust parallelism recipe that respects topology constraints.

Quick Start

Try asking for a recommended parallelism setup given a model size, hardware topology, and target training scale.