nvidia-mm-t2v

Benchmarks Open-Sora v2 text-to-video inference performance on a single NVIDIA GPU.

7|1|Updated Apr 17, 2026
One-click install
npx skills add https://github.com/DeepLink-org/DeepEval-Skills --skill nvidia-mm-t2v-deeplink-org
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: nvidia-mm-t2v
Source: https://github.com/DeepLink-org/DeepEval-Skills/tree/main/skills/NVIDIA/mm/nvidia-mm-t2v
Command: npx skills add https://github.com/DeepLink-org/DeepEval-Skills --skill nvidia-mm-t2v-deeplink-org

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires torch, colossalai, mmengine, flash-attn, ftfy, liger-kernel, and includes scripts (resource) components.

What problem does it solve? Measuring text-to-video generation performance on NVIDIA GPUs requires manual container setup, script orchestration, and log parsing. This Skill automates the full Open-Sora v2 inference evaluation workflow, from Docker launch to structured frames_per_second metrics. ## Core Features & Use Cases - Automated Container Orchestration: Launches the prebuilt Docker image with correct GPU capabilities, volume mounts for code, weights, and logs. - Configurable Inference Runs: Supports 256px and 768px resolutions, custom prompts, and offload toggling via environment variables, fixed to single-GPU execution. - Structured Metric Extraction: Parses inference logs for seconds-per-iteration, output video paths, and peak CUDA memory, then writes aggregated results to eval_result.json. - Use Case: Ask the agent to evaluate Open-Sora v2 text-to-video inference at 768px on an NVIDIA GPU, and receive a frames_per_second score with memory usage and the generated video path. ## Quick Start Ask the agent to run an Open-Sora v2 text-to-video inference benchmark on NVIDIA at 256px and report the frames per second.

Frequently Asked Questions about nvidia-mm-t2v

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I benchmark Open-Sora v2 text-to-video inference on NVIDIA GPUs?

Run the t2v.sh script inside the provided Docker container with mounted code and weight directories. It executes torchrun inference and writes frames_per_second metrics to eval_result.json in the logs directory.

How to measure frames per second for video generation models?

Frames per second is computed as frame_count divided by seconds_per_iter parsed from the inference log's s/it value. For the default 129-frame run, the script extracts the timing automatically and stores it in eval_result.json.

Does Open-Sora v2 inference support multiple GPUs in this evaluation?

No, this evaluation is fixed to a single GPU with MM_T2V_NGPU=1 and torchrun --nproc_per_node 1. Multi-GPU configurations are not supported by the current script.

Why does 768px Open-Sora inference run out of memory or time out?

768px inference takes roughly 1174 seconds per iteration and consumes significant VRAM. Keep offload enabled with MM_T2V_OFFLOAD=True and ensure the agent's command timeout exceeds the actual inference duration.

What Docker settings are required for NVIDIA GPU inference benchmarks?

The container must set NVIDIA_DRIVER_CAPABILITIES=compute,utility so PyTorch CUDA runtime works, not just nvidia-smi. Use --gpus all with --ipc host and --shm-size=16g for proper execution.