mlm-bridge-training
OfficialCompare Megatron-LM MLM and Bridge training.
Software Engineering#recipes#distributed-training#megatron-lm#mlm#bridge-training#correlation-testing
AuthorNVIDIA
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Enables running and comparing Megatron-LM MLM pretraining and Megatron Bridge training with mock or real data, supporting reproducible experiments across multi-GPU setups.
Core Features & Use Cases
- Correlation testing between MLM and Bridge training runs to verify consistency.
- Recipe-driven experimentation with multiple configurations and translation support for Bridge.
- Multi-GPU / distributed training guidance for scalable benchmarks and real-world workloads.
Quick Start
Run the provided recipes to execute MLM pretraining and Bridge training side-by-side on your hardware.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: mlm-bridge-training Download link: https://github.com/NVIDIA/skills/archive/main.zip#mlm-bridge-training Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.