nvidia-mm-t2i

Benchmarks Stable Diffusion text-to-image inference on NVIDIA GPUs using TensorRT.

7|1|Updated Apr 17, 2026
One-click install
npx skills add https://github.com/DeepLink-org/DeepEval-Skills --skill nvidia-mm-t2i-deeplink-org
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: nvidia-mm-t2i
Source: https://github.com/DeepLink-org/DeepEval-Skills/tree/main/skills/NVIDIA/mm/nvidia-mm-t2i
Command: npx skills add https://github.com/DeepLink-org/DeepEval-Skills --skill nvidia-mm-t2i-deeplink-org

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Evaluating Stable Diffusion text-to-image inference performance on NVIDIA GPUs requires coordinating Docker containers, TensorRT engine builds, model weights, and log parsing, which is error-prone when done manually. This Skill guides an executor through the full evaluation workflow so throughput and latency metrics are collected consistently. ## Core Features & Use Cases - Containerized Evaluation Workflow: Launches a prebuilt Docker image with TensorRT, diffusers, and transformers, mounting model, code, log, and temp directories. - Multi-Model Support: Benchmarks stable-diffusion-v1-5 and stable-diffusion-2-1 with configurable batch size (1-2) and resolutions (512/768/960) in FP16. - Metric Collection: Extracts Throughput, Pipeline Latency, per-module latency (CLIP, UNet, VAE-Dec), GPU memory usage, and model loading time from inference logs. - Use Case: A performance engineer needs to compare Stable Diffusion 1.5 throughput at 512x512 versus 768x768 on an NVIDIA GPU; the Skill drives container startup, runs demo_txt2img.py, and parses the logs into comparable metrics. ## Quick Start Ask the agent to run a Stable Diffusion text-to-image TensorRT inference benchmark on NVIDIA GPU and collect throughput and latency metrics.

Frequently Asked Questions about nvidia-mm-t2i

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I benchmark Stable Diffusion inference on NVIDIA GPU with TensorRT?

Launch the provided Docker container with GPU access and mounted model directories, then run demo_txt2img.py from the TensorRT Diffusion demo with your chosen model version, batch size, and resolution. The script logs throughput and per-module latency for analysis.

What performance metrics does Stable Diffusion TensorRT inference produce?

The inference log reports Throughput in images per second, end-to-end Pipeline Latency, and per-module latency for CLIP, UNet (x50 steps), and VAE-Dec. It also reports GPU memory usage and model loading time including TensorRT engine build.

Which Stable Diffusion models and resolutions are supported?

The evaluation supports stable-diffusion-v1-5 and stable-diffusion-2-1. Batch size can be 1 or 2, and height/width can be 512, 768, or 960 as long as dimensions are multiples of 8, using FP16 precision.

Why does Stable Diffusion inference fail with CUDA out of memory?

Out-of-memory errors occur when GPU memory is occupied by other processes or insufficient for the model and batch size. Check usage with nvidia-smi, then set CUDA_VISIBLE_DEVICES to a free GPU before launching the Python script.

Can I change the denoising steps for faster Stable Diffusion benchmarking?

No, denoising-steps is fixed at 50 and must not be modified. Changing it makes results incomparable with the baseline metrics used by this evaluation workflow.