perf-expert-parallel-overlap
OfficialOptimize MoE communication for faster training throughput.
Software Engineering#deep learning#performance tuning#gpu#training optimization#moe#communication overlap#megatront
AuthorNVIDIA-NeMo
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill enhances the efficiency of MoE models by overlapping expert-parallel communication with computation, reducing step time.
Core Features & Use Cases
- Communication Overlap: Validates and enables expert-parallel communication overlap during training.
- Performance Tuning: Assists in tracing throughput regressions and tuning EP overlap configurations.
- Use Case: Optimizing a large-scale MoE training run on GPU clusters to decrease latency and improve overall throughput with minimal code changes.
Quick Start
Use the performance skill to enable expert-parallel communication overlap during training by configuring overlap_moe_expert_parallel_comm and running the setup script.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: perf-expert-parallel-overlap Download link: https://github.com/NVIDIA-NeMo/Megatron-Bridge/archive/main.zip#perf-expert-parallel-overlap Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.