ml-validate

Validates ML project structure, Hydra configs, and runtime instantiation paths before training runs.

Updated Feb 6, 2026
One-click install
npx skills add https://github.com/nishide-dev/claude-code-ml-research --skill ml-validate
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ml-validate
Source: https://github.com/nishide-dev/claude-code-ml-research/tree/main/skills/ml-validate
Command: npx skills add https://github.com/nishide-dev/claude-code-ml-research --skill ml-validate

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

ML projects often fail at runtime due to broken Hydra configuration, invalid imports for target classes, missing project structure, or basic code-quality/dependency problems that only surface after you start training.

Core Features & Use Cases

  • Project structure validation: Confirms required directories and key files like src/train.py and configs/config.yaml exist.
  • Configuration validation: Checks YAML syntax and verifies Hydra config composition and required top-level fields (model, data, trainer).
  • Training readiness checks: Runs ruff for code quality, imports required/optional dependencies, checks CUDA availability, and exercises model and DataModule instantiation plus a fast dev run.
  • Use case: Before running expensive experiments, validate that your Hydra target paths import correctly and that the model/data/trainer components can be instantiated and execute a minimal train loop.

Quick Start

Run the full validator by executing the validation script in your project: python scripts/validate_project.py

Frequently Asked Questions about ml-validate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate Hydra configuration and PyTorch Lightning setup before training?

To validate Hydra configuration and PyTorch Lightning setup, run an automated script that checks YAML syntax, verifies config composition, and tests _target_ component instantiation to catch ML project readiness issues early.

Why does my ML training run fail immediately after starting?

ML training runs often fail due to broken Hydra configuration, invalid _target_ imports, missing project structure, or code quality issues. Running a pre-training validation script identifies these dependency and configuration failures before you execute experiments.

How do I check GPU availability and dependencies for a PyTorch Lightning project?

Check GPU availability and dependencies for a PyTorch Lightning project by running automated training readiness checks that verify CUDA availability, import required and optional dependencies, and execute a fast dev training run.

What is the best way to verify ML project structure and required files?

The best way to verify ML project structure is running a validation script that confirms required directories and key files like src/train.py and configs/config.yaml exist before you start your training experiments.

Can I test model and DataModule instantiation without running a full experiment?

Yes, you can test model and DataModule instantiation without a full experiment by running a fast dev training loop that exercises Hydra _target_ paths and verifies your trainer components execute correctly.