reseed-ssim-references

Back up, regenerate, review, and upload SSIM reference videos for specific models.

3.9k|398|Updated Oct 24, 2024
One-click install
npx skills add https://github.com/hao-ai-lab/FastVideo --skill reseed-ssim-references
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: reseed-ssim-references
Source: https://github.com/hao-ai-lab/FastVideo/tree/main/.agents/skills/reseed-ssim-references
Command: npx skills add https://github.com/hao-ai-lab/FastVideo --skill reseed-ssim-references

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires hf, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill enables accurate updating of SSIM reference videos for specific models when code changes cause drift in performance metrics, ensuring reliable quality benchmarks.

Core Features & Use Cases

  • Reference Video Management: Safely backs up existing reference videos, regenerates new ones on Modal, and allows side-by-side quality comparison.
  • Targeted Re-seeding: Focuses on a single (test_file, model_id) pairing to update references after model or code modifications.
  • Use Case: When a model's code or hyperparameters are changed, re-seed the SSIM references to reflect the new output quality, supporting robust regression testing.

Quick Start

Initiate re-seeding for your specific test and model by confirming the intent, backing up current references, regenerating on Modal, reviewing quality, and then uploading the new videos with verification.

Frequently Asked Questions about reseed-ssim-references

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I update SSIM reference videos after changing model code or hyperparameters?

Re-seeding SSIM references involves backing up current videos, regenerating new outputs on Modal, reviewing quality side-by-side, and uploading verified replacements to ensure accurate video quality similarity benchmarks during regression testing.

When do I need to re-seed video quality references for regression testing?

You need to re-seed video quality references when model code or hyperparameter modifications cause performance drift, rendering existing reference videos invalid for accurate similarity benchmarking and regression tracking.

Can I update reference videos for a specific test file and model ID on HF datasets?

Yes, targeted re-seeding focuses on a specific test file and model ID pairing to safely replace outdated reference videos on HF datasets with newly generated outputs for precise model validation.

What is the process for backing up and regenerating video SSIM references?

The re-seeding process safely backs up existing reference videos, regenerates new ones on Modal, performs side-by-side quality comparison for user review, and executes scoped uploads of revised reference videos.

Does this re-seeding workflow require the hf dependency to upload references?

Yes, the workflow requires the hf dependency to perform scoped uploads of revised reference videos to HF datasets, ensuring updated similarity benchmarks are correctly stored for model validation.