Skills
.Work. You
Rest

megatron-checkpoint-layout

Official

Diagnose and align Megatron checkpoint layouts.

Software Engineering#layout#checkpoint#megatron#pp#tp#ep#mp_rank
AuthorEvolvingLMMs-Lab
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Diagnose and convert Megatron checkpoint shard layouts across TP, PP, and EP dimensions to ensure correct loading and performance across distributed training setups.

Core Features & Use Cases

  • Layout discovery: Identify whether a checkpoint is 1D, 2D, or 3D based on the presence of EP and the sizes of TP/PP/EP.
  • Naming validation: Enforce recommended patterns mp_rank_{tp}, mp_rank_{tp}{pp}, mp_rank{tp}{pp}{ep}.
  • Migration guidance: Provide actionable steps to convert a layout when upgrading from non-EP to EP-enabled configurations or adjusting PP/EP sizes.

Quick Start

Run the layout validator on a Megatron checkpoint root to determine its dimensionality and the expected shard directory names.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: megatron-checkpoint-layout
Download link: https://github.com/EvolvingLMMs-Lab/LLaVA-OneVision-2/archive/main.zip#megatron-checkpoint-layout

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.