training-check

Monitor WandB training metrics periodically and alert on anomalies.

Updated Apr 29, 2026
One-click install
npx skills add https://github.com/jkfee/Auto-Research --skill training-check-jkfee
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: training-check
Source: https://github.com/jkfee/Auto-Research/tree/main/skills/training-check
Command: npx skills add https://github.com/jkfee/Auto-Research --skill training-check-jkfee

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill automates monitoring of WandB metrics during ML training to detect issues early and prevent wasted GPU hours.

Core Features & Use Cases

  • Periodic WandB metric retrieval and health evaluation during training.
  • Automated escalation guidance via Codex for ambiguous signals.
  • CronCreate-based scheduling and reset rules to adapt check frequency.
  • Integration with Watchdog for process health.

Quick Start

Configure WandB path and schedule a recurring check that alerts when training metrics diverge.

Frequently Asked Questions about training-check

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I monitor WandB training metrics to detect anomalies automatically?

This skill automates WandB metric monitoring during active ML training to detect issues early. It periodically retrieves metrics, tracks loss and eval data, and alerts you when anomalies appear to prevent wasted GPU hours.

Can I schedule periodic health checks for machine learning training runs?

Yes, you can schedule periodic health checks using CronCreate-based scheduling with configurable reset rules. This adapts the check frequency for your machine learning training runs automatically.

How does Codex evaluate ambiguous signals during WandB metric monitoring?

Codex evaluates ambiguous signals during WandB metric monitoring by providing automated escalation guidance. It applies judgment to unclear metric data retrieved during active training to determine if anomalies exist.

Does this skill integrate with Watchdog for process health monitoring?

Yes, this skill integrates with Watchdog for process health monitoring. It combines WandB training metric evaluation with Watchdog to track the overall health of your machine learning training process.

What is the best way to prevent wasted GPU hours when training loss diverges?

The best way to prevent wasted GPU hours when training loss diverges is to automate WandB metric monitoring. This skill detects diverging training loss early and alerts you to stop the run.

Do I need WandB API access to automate training health checks?

Yes, you need WandB API access to automate training health checks. The skill implements periodic checks using the WandB API to retrieve training metrics and evaluate model health during active runs.