perf-moe-comm-overlap

Official

Optimize MoE communication for higher throughput.

AuthorNVIDIA-NeMo
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill addresses the need to improve the efficiency of expert-parallel communication in MoE models, reducing communication bottlenecks.

Core Features & Use Cases

  • Communication Overlap Tuning: Provides configurations and guidance for overlapping token dispatch and combine communication with computation in MoE training.
  • Flex Dispatcher Activation: Supports flexible dispatcher backends for advanced expert routing strategies.
  • Use Case: A researcher tuning large-scale MoE models can use this Skill to experiment with overlap configurations, aiming to improve training throughput and scalability.

Quick Start

Use the perf-moe-comm-overlap skill to optimize expert-parallel communication by enabling overlap configurations and validating improvements in training performance.

Dependency Matrix

Required Modules

None required

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: perf-moe-comm-overlap
Download link: https://github.com/NVIDIA-NeMo/Megatron-Bridge/archive/main.zip#perf-moe-comm-overlap

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.