Skills
.Work. You
Rest

validate-correctness

Official

Detect training regressions by comparing runs.

Software Engineering#workflow#training#validate#correctness#regression-testing#moe#log-compare
Authormlc-ai
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Validates that code changes do not break training correctness by comparing per-step loss curves between a base branch and the current feature branch. Use when user asks to "validate correctness", "check if changes break training", "compare loss curves", "run a regression test", or "verify my changes are correct". The user specifies which model to validate and at which parallelism mesh (PP/EP/CP) — do not infer this from git diff.

Core Features & Use Cases

  • Runs a paired-base/feature training validation to surface regressions in cross-entropy and load-balance metrics.
  • Diffs per-step metrics and reports pass/fail with a defined tolerance; supports adjustable context and sequence length.
  • Use Case: QA for model changes before merging feature branches and validating MOE mesh configurations.

Quick Start

Run the validation with your target model and mesh to detect regressions.

Dependency Matrix

Required Modules

None required

Components

scripts

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: validate-correctness
Download link: https://github.com/mlc-ai/pith-train/archive/main.zip#validate-correctness

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.