huggingface-trackio

Track ML training metrics and fire diagnostic alerts via CLI.

1|Updated Jul 12, 2026
One-click install
npx skills add https://github.com/Tyler-R-Kendrick/slm-training --skill huggingface-trackio-tyler-r-kendrick
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: huggingface-trackio
Source: https://github.com/Tyler-R-Kendrick/slm-training/tree/main/.agents/skills/huggingface-trackio
Command: npx skills add https://github.com/Tyler-R-Kendrick/slm-training --skill huggingface-trackio-tyler-r-kendrick

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires trackio, and includes references (resource) components.

What problem does it solve?

This skill solves the challenge of monitoring long-running machine learning experiments, providing a unified interface for logging metrics, firing diagnostic alerts, and retrieving training data for autonomous iteration.

Core Features & Use Cases

  • Experiment Tracking: Log training metrics like loss and accuracy with a wandb-compatible API, supporting local SQLite storage or remote synchronization to Hugging Face Spaces.
  • Diagnostic Alerting: Fire structured alerts (INFO, WARN, ERROR) directly from training code to flag issues like loss divergence, vanishing gradients, or training stalls.
  • Autonomous Iteration: Enable LLM agents to poll for alerts and metrics via CLI, allowing them to make data-driven decisions to stop, adjust, or relaunch experiments.

Quick Start

Use the huggingface-trackio skill to initialize a new project named experiment-alpha and log the current training loss value.

Frequently Asked Questions about huggingface-trackio

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I track ML experiment metrics and monitor training runs in real time?

To track ML experiment metrics in real time, log training values like loss and accuracy using a wandb-compatible API. The system stores data locally in SQLite or synchronizes it to Hugging Face Spaces, enabling real-time monitoring through local dashboards.

Can I set up diagnostic alerts for machine learning experiments to detect training stalls or loss divergence?

Yes, you can fire structured diagnostic alerts directly from your training code to flag issues like loss divergence, vanishing gradients, or training stalls. Alerts use severity levels including INFO, WARN, and ERROR to signal specific experiment problems.

How do I automate hyperparameter tuning and failure recovery for ML training runs?

Automate hyperparameter tuning by enabling LLM agents to poll for metrics and alerts via CLI. Agents retrieve diagnostic data to make data-driven decisions, allowing them to autonomously stop, adjust, or relaunch experiments for failure recovery.

Does trackio support Hugging Face Spaces for remote experiment tracking?

Yes, trackio supports remote experiment tracking by synchronizing training metrics to Hugging Face Spaces. This allows you to access and monitor your machine learning runs remotely, serving as an alternative to strictly local SQLite storage.

What is the best way to enable autonomous iteration for long-running ML experiments?

The best way to enable autonomous iteration is combining diagnostic alerting with CLI metric retrieval. This allows automated agents to monitor long-running training runs, detect anomalies, and trigger autonomous experiment management without manual intervention.