summarize-run

Retrieve W&B or local metrics and generate markdown comparison reports.

3.9k|398|Updated Oct 24, 2024
One-click install
npx skills add https://github.com/hao-ai-lab/FastVideo --skill summarize-run
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: summarize-run
Source: https://github.com/hao-ai-lab/FastVideo/tree/main/.agents/skills/summarize-run
Command: npx skills add https://github.com/hao-ai-lab/FastVideo --skill summarize-run

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill simplifies the process of retrieving and summarizing key metrics from W&B run data, enabling faster analysis of machine learning experiments.

Core Features & Use Cases

  • Data Extraction: Retrieves metrics such as train loss, step time, gradient norm, and validation results from W&B APIs or local JSON summaries.
  • Comparison & Reporting: Generates detailed markdown reports comparing current results against reference run data for monitoring progress.
  • Use Case: Researchers and engineers can quickly generate structured experiment summaries after training to document performance and identify issues, either online via W&B or offline from stored JSON files.

Quick Start

Summarize the latest training metrics from the output directory 'outputs/wan_finetune' using a reference summary file to generate a report.

Frequently Asked Questions about summarize-run

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract W&B run metrics for a machine learning experiment summary?

To extract W&B run metrics for a machine learning experiment summary, this Skill retrieves data like train loss, step time, and validation results directly from W&B APIs or local JSON summaries to evaluate training progress.

Can I generate a training report from local JSON summaries instead of W&B?

Yes, you can generate a training report from local JSON summaries. This Skill works offline by retrieving metrics from stored JSON files and producing structured markdown reports to document performance without requiring online W&B access.

How do I compare current training metrics against a reference run?

You can compare current training metrics against a reference run by using a reference summary file. This Skill generates detailed markdown reports comparing your latest results against the reference data to monitor progress and identify issues.

What metrics are included in a W&B experiment summary report?

A W&B experiment summary report includes metrics such as train loss, step time, gradient norm, and validation results. These are retrieved from your training data and structured to help evaluate machine learning training progress.

Does this tool work with offline W&B training outputs?

Yes, this tool works with offline W&B training outputs. It can summarize the latest training metrics from an output directory using local JSON summary files, allowing you to evaluate experiment progress without an active W&B connection.