megatron-memory-estimator
CommunityEstimate Megatron memory for MoE and dense models
Software Engineering#HuggingFace#MoE#parallelism#memory-estimation#Megatron-LM#GPU-memory#Megatron-core
Authoryzlnew
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Predicts GPU memory usage for Megatron-based models (dense and MoE) to prevent memory errors and optimize resource planning.
Core Features & Use Cases
- Estimate memory from HuggingFace configs or local model specs.
- Compare parallelism strategies (TP, PP, EP, CP) and choose the best fit.
- Determine if a model fits on available GPUs and get actionable memory headroom guidance.
- Provide a detailed memory breakdown and per-PP/per-GPU estimates to aid deployment decisions.
Quick Start
Run the estimator against a HuggingFace model path with TP/PP/EP settings to quickly assess GPU memory for Megatron models.
Dependency Matrix
Required Modules
mbridgetransformers
Components
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: megatron-memory-estimator Download link: https://github.com/yzlnew/infra-skills/archive/main.zip#megatron-memory-estimator Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.