Skills
.Work. You
Rest

nemo-mbridge-resiliency

Community

Fortify Megatron Bridge with resilience features.

Software Engineering#checkpointing#preemption#fault-tolerance#resiliency#megatron-bridge#straggler-detection#in-process-restart
Authorsayalinvidia
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Megatron Bridge resilience features address training hangs, faults, and straggler issues by enabling fault tolerance, straggler detection, and restart mechanisms across distributed GPU training workflows.

Core Features & Use Cases

  • Fault tolerance for Slurm and NeMo-Run integration with nvidia-resiliency-ext
  • NVRx straggler detection and configurable restart options
  • In-process restart (experimental) for in-process resilience
  • Preemption support with safe checkpointing and graceful shutdown
  • Experimental re-run state machine with NaN/spiky loss attribution
  • Async and local checkpointing for faster recovery and reduced downtime

Quick Start

Configure the resiliency features according to the Megatron Bridge documentation and validate via tests and examples.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: nemo-mbridge-resiliency
Download link: https://github.com/sayalinvidia/sayali-skills-test/archive/main.zip#nemo-mbridge-resiliency

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.