perf-moe-comm-overlap
OfficialOptimize MoE communication for higher throughput.
AuthorNVIDIA-NeMo
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill addresses the need to improve the efficiency of expert-parallel communication in MoE models, reducing communication bottlenecks.
Core Features & Use Cases
- Communication Overlap Tuning: Provides configurations and guidance for overlapping token dispatch and combine communication with computation in MoE training.
- Flex Dispatcher Activation: Supports flexible dispatcher backends for advanced expert routing strategies.
- Use Case: A researcher tuning large-scale MoE models can use this Skill to experiment with overlap configurations, aiming to improve training throughput and scalability.
Quick Start
Use the perf-moe-comm-overlap skill to optimize expert-parallel communication by enabling overlap configurations and validating improvements in training performance.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: perf-moe-comm-overlap Download link: https://github.com/NVIDIA-NeMo/Megatron-Bridge/archive/main.zip#perf-moe-comm-overlap Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.