ml-verify

Verify machine learning code and hyperparameters against official documentation.

192|18|Updated Mar 3, 2026
One-click install
npx skills add https://github.com/Leeroo-AI/superml --skill ml-verify
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ml-verify
Source: https://github.com/Leeroo-AI/superml/tree/main/skills/ml-verify
Command: npx skills add https://github.com/Leeroo-AI/superml --skill ml-verify

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill prevents costly mistakes by verifying ML code, configurations, and mathematical formulas against official documentation and best practices before expensive training jobs or deployments.

Core Features & Use Cases

  • Pre-run Verification: Catches configuration errors, incorrect API usage, and mathematical inaccuracies.
  • Documentation Grounding: Leverages a knowledge base (KB) or web scraping to cite official framework documentation for checks.
  • Dry Run Checklist: Guides users through essential pre-training checks like model loading, data batching, and initial loss/gradient sanity checks.
  • Use Case: Before starting a multi-day fine-tuning job, use this skill to ensure your LoRA configuration, learning rate, and data loading pipeline are correctly set up according to Hugging Face PEFT and Transformers documentation.

Quick Start

Use the ml-verify skill to check my QLoRA config for training Llama-3 8B.

Frequently Asked Questions about ml-verify

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify machine learning code and hyperparameter configurations before running a training job?

You can verify machine learning code by checking configurations, API usage, and mathematical formulas against official documentation and established heuristics before initiating expensive training jobs. This pre-run verification catches configuration errors and incorrect API usage.

What is the best way to debug common machine learning errors like OOM and NaN during model training?

Debugging common ML errors like OOM and NaN involves validating training plans and checking mathematical formulas against known-good examples. This process identifies configuration issues and mathematical inaccuracies that cause out-of-memory or not-a-number errors.

Can I validate my Hugging Face training setup and DeepSpeed configurations before starting a fine-tuning job?

Yes, you can validate Hugging Face and DeepSpeed configurations by verifying training plans against official framework documentation. This ensures your model loading, data batching, and learning rate setups are correctly configured before multi-day fine-tuning jobs.

How do I check my QLoRA config for training Llama-3 against official framework documentation?

To check a QLoRA config, verify the learning rate, data loading pipeline, and LoRA parameters against Hugging Face PEFT and Transformers documentation. This documentation grounding ensures your setup follows established best practices.

Does pre-training verification require web fetching of API documentation?

Pre-training verification requires grounding via knowledge base tools or web fetching of API documentation. This ensures that code checks and configuration validations cite official framework documentation and known-good examples accurately.

What should a dry run checklist include for machine learning pre-training checks?

A dry run checklist for ML pre-training checks should guide you through model loading, data batching, and initial loss or gradient sanity checks. This ensures mathematical formulas and hyperparameter configurations are validated before execution.