veomni-profile

Profile deep learning training runs by parsing Chrome traces and memory snapshots.

2.1k|247|Updated Mar 28, 2025
One-click install
npx skills add https://github.com/ByteDance-Seed/VeOmni --skill veomni-profile
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: veomni-profile
Source: https://github.com/ByteDance-Seed/VeOmni/tree/main/.agents/skills/veomni-profile
Command: npx skills add https://github.com/ByteDance-Seed/VeOmni --skill veomni-profile

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill facilitates comprehensive profiling and performance optimization of deep learning training processes, enabling users to identify bottlenecks and improve efficiency.

Core Features & Use Cases

  • Profile analysis: Parse Chrome traces and memory snapshots to evaluate kernel execution, memory usage, and communication overhead.
  • Performance optimization: Provide insights into bottlenecks such as slow kernels, inefficient communication, and memory issues to guide improvements during model training.
  • Use Case: During training, generate profiling data, analyze the results, and optimize script configurations to maximize throughput and resource utilization, applicable to large-scale model training workflows.

Quick Start

Configure the profiling parameters in your training setup, run the training process with profiling enabled, then analyze the output Chrome traces and memory snapshots using the provided scripts to identify and address performance issues.

Frequently Asked Questions about veomni-profile

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze Chrome traces to find deep learning training bottlenecks?

To analyze Chrome traces for deep learning training bottlenecks, configure profiling in your training setup and run the process to generate trace data. You can then parse these traces to evaluate kernel execution, memory usage, and communication overhead to pinpoint performance issues.

What is memory snapshot parsing in performance profiling?

Memory snapshot parsing in performance profiling is the process of evaluating memory usage during deep learning training. It helps identify memory issues and bottlenecks, guiding improvements to maximize throughput and optimize resource utilization in large-scale model training workflows.

Does profiling large-scale model training require specific script configurations?

Yes, profiling large-scale model training requires specific script configurations to enable profiling parameters. You must configure your training setup, run the process with profiling enabled, and then analyze the output Chrome traces and memory snapshots to identify and address performance issues.

How do I optimize deep learning training throughput using trace analysis?

To optimize deep learning training throughput using trace analysis, parse the generated Chrome traces to identify slow kernels and inefficient communication. Addressing these specific bottlenecks guides script configuration improvements to maximize throughput and resource utilization.

What should I look for in Chrome trace analysis for deep learning performance optimization?

In Chrome trace analysis for deep learning performance optimization, you should look for slow kernels, inefficient communication overhead, and memory issues. Identifying these bottlenecks helps guide improvements to maximize throughput and resource utilization during model training.