veomni-debug

Debug distributed training errors with structured investigation protocols.

2.1k|247|Updated Mar 28, 2025
One-click install
npx skills add https://github.com/ByteDance-Seed/VeOmni --skill veomni-debug
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: veomni-debug
Source: https://github.com/ByteDance-Seed/VeOmni/tree/main/.agents/skills/veomni-debug
Command: npx skills add https://github.com/ByteDance-Seed/VeOmni --skill veomni-debug

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill provides comprehensive guidance and structured protocols to identify, analyze, and fix complex bugs, errors, and unexpected behaviors in large-scale distributed model training environments.

Core Features & Use Cases

  • Debugging Protocols: Offers step-by-step procedures for root cause investigation, hypothesis testing, and fix verification tailored to machine learning training issues.
  • Structured Approach: Guides users through investigating common pitfalls such as sharding mismatches, gradient issues, and checkpoint errors.
  • Use Case: Data scientists or engineers troubleshooting OOM errors in FSDP2-based training environments can follow the protocols to isolate and resolve issues efficiently.

Quick Start

Read the troubleshooting guide to systematically diagnose a training hang or crash caused by distribution misconfiguration.

Frequently Asked Questions about veomni-debug

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I debug distributed training crashes in PyTorch?

Debug distributed training hangs by following structured investigation protocols to isolate distribution misconfigurations. It guides you through root cause analysis and hypothesis testing to systematically resolve stalls in complex training environments.

How do I troubleshoot OOM errors in FSDP2-based training environments?

Troubleshoot FSDP2 OOM errors by applying structured debugging protocols to isolate memory issues. The approach guides you through investigating sharding mismatches and verifying fixes to efficiently resolve out-of-memory crashes in large-scale model training.

What is the best way to investigate sharding mismatches during model training?

The best way to investigate sharding mismatches is using a structured approach that guides you through root cause investigation and fix verification. This ensures accurate diagnosis of sharding errors in distributed training scenarios.

Does this debugging approach work for MoE and sequence parallelism errors?

Yes, this debugging approach works for MoE and sequence parallelism errors by providing structured protocols applicable to large-scale model training scenarios. It ensures accurate diagnosis and resolution of issues across these specific distributed environments.

When do I need a structured protocol for error analysis in distributed training?

You need a structured protocol for error analysis when troubleshooting complex bugs, errors, or unexpected behaviors in large-scale distributed model training. It provides the necessary steps to systematically investigate, diagnose, and resolve intricate training failures.