What problem does it solve?
This Skill streamlines the process of generating, verifying, and uploading SSIM reference artefacts for new video similarity tests, ensuring consistent and accurate benchmarking.
Core Features & Use Cases
- Artefact Generation: Runs SSIM tests on Modal's GPU to produce pixel (
.mp4) or latent (.pt) reference files for new video similarity tests.
- Verification & Quality Check: Pauses for user verification of visual quality or numerical sanity, preventing erroneous references from being uploaded.
- Uploading & Seeding: Safely uploads verified references to Hugging Face HF datasets, with safeguards against overwriting existing data, enabling reproducible and robust test baseline establishment.
- Use Case: When adding a new SSIM test in
fastvideo/tests/ssim/, you run this Skill to generate correct reference artefacts and seed them into the shared dataset for consistent test validation.
Quick Start
Prompt the user for the test file path, execute the modal run to generate artefacts, inspect the output files for quality, and then upload them to Hugging Face dataset.