testing

Standardize Megatron-LM test workflows with CI-compatible recipe YAMLs and distributed runners.

Updated May 23, 2026
One-click install
npx skills add https://github.com/yo-steven/skills-exploration-20260522 --skill testing-yo-steven
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: testing
Source: https://github.com/yo-steven/skills-exploration-20260522/tree/main/skills/Megatron-Core/testing
Command: npx skills add https://github.com/yo-steven/skills-exploration-20260522 --skill testing-yo-steven

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you reproduce, organize, and extend a reliable Megatron-LM test workflow so unit and functional tests run consistently across local development and CI.

Core Features & Use Cases

  • Test layout and execution model: Understand how unit tests use distributed pytest and how functional tests run end-to-end via CI shell scripts and artifacts.
  • Recipe YAML workflow: Define workloads with structured recipe YAMLs, expanded products combinations, and runtime placeholders for assets and artifacts.
  • Golden values and failure reproduction: Download/update golden outputs and match CI behavior locally to diagnose regressions or mismatches.
  • Stability controls: Use marker filters and CI-parity guidance to manage flaky and environment-specific test behavior.

Quick Start

Use the testing Skill to add a new unit test and then reproduce its exact CI execution locally with the distributed runner and the same test layout.

Frequently Asked Questions about testing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I write recipe YAMLs for Megatron-LM functional test buckets?

Recipe YAMLs for Megatron-LM functional test buckets are defined using structured workload definitions, expanded products combinations, and runtime placeholders for assets and artifacts to ensure deterministic parsing and execution.

How do I reproduce Megatron-LM CI test failures locally?

You can reproduce Megatron-LM CI test failures locally by matching CI behavior using torch.distributed.run and CI scripts, alongside downloading and updating golden outputs to diagnose regressions or mismatches.

What is the best way to manage flaky Megatron-LM distributed tests?

The best way to manage flaky Megatron-LM distributed tests is applying stability controls like marker filters, CI-parity guidance, and environment-specific scopes to handle flaky and disabled test behavior reliably.

How does pytest work with distributed testing in Megatron-LM unit tests?

Pytest works with distributed testing in Megatron-LM unit tests by running via distributed pytest layouts, while functional tests run end-to-end using CI shell scripts and artifacts for consistent execution.

Can I use cartesian workload expansion for Megatron-LM H100 and GB200 tests?

Yes, you can use cartesian workload expansion for H100 and GB200 tests by defining structured recipe YAMLs that expand products combinations and apply runtime placeholders for distributed artifacts and logging.

Why do my Megatron-LM golden values mismatch when running tests locally?

Golden values mismatch locally because of missing golden-value download workflows or environment drift; you must download and update golden outputs and match CI behavior exactly to diagnose regressions accurately.