nemo-mbridge-multi-node-slurm
CommunityScale single-node scripts to multi-node Slurm jobs.
Authorsayalinvidia
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Convert single-node Megatron Bridge scripts into scalable multi-node Slurm sbatch workflows with Enroot container support, enabling reliable distributed execution and easier debugging of cross-node failures.
Core Features & Use Cases
- Provides two main launch patterns: srun-native (preferred) and uv run torch.distributed (legacy), with guidance on when to use each.
- Automates the two-phase launch workflow that populates a shared cache before full multi-node execution.
- Derives distributed variables (RANK, WORLD_SIZE, LOCAL_RANK, MASTER_ADDR, MASTER_PORT) from SLURM environment, minimizing manual configuration.
- Enforces shared filesystem and container mounts for repo, data, logs, HF_HOME, UV_CACHE_DIR, and NEMO_HOME to ensure consistency across nodes.
- Includes template references and examples for sbatch headers, TRAIN_CMD composition, and logging conventions to simplify deployment.
- Quick-start path and debugging best practices for common multi-node failures, NCCL timeouts, and OOM scenarios.
Quick Start
Submit a multi-node Slurm job using the Bridge templates and follow the two-phase srun pattern.
Dependency Matrix
Required Modules
None requiredComponents
references
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: nemo-mbridge-multi-node-slurm Download link: https://github.com/sayalinvidia/sayali-skills-test/archive/main.zip#nemo-mbridge-multi-node-slurm Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.