training-metrics-analyzer

Analyze TensorBoard logs to detect overfitting and mark optimal checkpoints.

1|3|Updated May 22, 2025
One-click install
npx skills add https://github.com/minuum/vla --skill training-metrics-analyzer
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: training-metrics-analyzer
Source: https://github.com/minuum/vla/tree/main/.agent/skills/training-metrics-analyzer
Command: npx skills add https://github.com/minuum/vla --skill training-metrics-analyzer

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires tensorboard, matplotlib, seaborn, and includes scripts (resource) components.

What problem does it solve?

This skill simplifies monitoring ML training by converting TensorBoard logs into visual plots that reveal overfitting and guide checkpoint selection.

Core Features & Use Cases

  • Visualizes train and validation losses over training steps to identify training trends.
  • Detects overfitting onset by marking best checkpoint and subsequent divergence.
  • Generates output reports and plots saved under docs/plots and docs/reports for documentation and audit.

Quick Start

Run the training-metrics-analyzer to plot loss curves from the latest runs and save the results to docs/plots.

Frequently Asked Questions about training-metrics-analyzer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect overfitting from TensorBoard logs during ML training?

To detect overfitting from TensorBoard logs, you visualize train_loss and val_loss curves to identify where validation loss stops decreasing and diverges from training loss. This skill marks the best checkpoint and subsequent overfitting onset automatically.

What is the best way to visualize train and validation loss curves to find optimal checkpoints?

The best way to visualize loss curves for optimal checkpoints is plotting train_loss and val_loss with a log-scaled Y-axis. This highlights divergence points, allowing you to select the checkpoint at minimum validation loss before overfitting begins.

Can I compare validation metrics across multiple TensorBoard runs?

Yes, you can compare validation metrics across multiple TensorBoard runs. This skill analyzes logs organized under runs/version_X across experiments, enabling cross-task comparison of training trends and validation losses to evaluate model performance.

How do I generate visual plots and reports from TensorBoard log files?

To generate visual plots and reports from TensorBoard logs, you run the analyzer script which extracts metrics and renders visualizations using matplotlib and seaborn. Output plots and audit reports are saved automatically under docs/plots and docs/reports.

Does this training metrics analyzer work with VLA model training workflows?

Yes, this training metrics analyzer works with VLA model training workflows. It is specifically applied to VLA workflows where TensorBoard logs are organized under runs/version_X, extracting relevant metrics to guide checkpoint selection and reporting.