memory-profile

Official

Analyze TPU pretraining HBM occupancy and memory allocation.

Authorprimatrix
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill provides deep insights into the HBM (High Bandwidth Memory) occupancy and memory allocation during TPU pretraining, helping to optimize resource usage and identify bottlenecks.

Core Features & Use Cases

  • HBM Occupancy Analysis: Locate the static HBM peak and identify the HLO instructions and buffers that contribute to it.
  • Memory Allocation Tracking: Track the lifetime and size of buffers in the runtime memory, including those allocated and deallocated during the trace.
  • Use Case: Imagine you are pretraining a model on a TPU and encountering high HBM usage. Use this Skill to identify the specific HLO instructions and buffers contributing to the peak usage, allowing you to optimize your model architecture or code.

Quick Start

Analyze the HBM occupancy for the profile directory 'tpu_profile'.

Dependency Matrix

Required Modules

hlo_pb2xplane_pb2pypdf

Components

scriptsreferencesassets

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: memory-profile
Download link: https://github.com/primatrix/skills/archive/main.zip#memory-profile

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.