add-new-model

What problem does it solve?

Enables seamless addition of a new MoE language model to PithTrain, covering model implementation, framework wiring, and optional checkpoint conversion to run full training and inference cycles.

Core Features & Use Cases

• End-to-end model integration: create the model class, wire it into the training framework, and configure MoE routing and experts.
• Checkpoint conversion support: add an HF2dcp/dcp2hf converter when necessary to align layouts or quantify weights for quantized checkpoints.
• Validation workflow: execute the standard phase ladder from HF reference inventory to distributed training and inference checks.

Quick Start

Add a new MoE model to PithTrain by creating the model skeleton, wiring it into the training framework, optionally adding a checkpoint converter, and validating with the standard phase ladder.