sglang-diffusion-benchmark-profile

Benchmark diffusion denoise latency and profile SGLang native backend bottlenecks.

Updated Jun 4, 2026
One-click install
npx skills add https://github.com/annealing-inversion/sglang-kimi-deferral --skill sglang-diffusion-benchmark-profile-annealing-inversion
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: sglang-diffusion-benchmark-profile
Source: https://github.com/annealing-inversion/sglang-kimi-deferral/tree/main/python/sglang/multimodal_gen/.claude/skills/sglang-diffusion-benchmark-profile
Command: npx skills add https://github.com/annealing-inversion/sglang-kimi-deferral --skill sglang-diffusion-benchmark-profile-annealing-inversion

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

Benchmarks and profiles for diffusion denoising latency, providing repeatable metrics, baseline comparisons, and hotspot identification to guide optimization.

Core Features & Use Cases

  • Structured benchmarking presets: checked-in denoise presets and standard perf dumps for repeatable tests.
  • Profiling workflow: torch.profiler traces and hotspot ranking to map bottlenecks to fast paths.
  • Workflow handoff: guidance to hand kernel-optimization work to specialized skills when needed.

Quick Start

Run the diffusion benchmark skill to start a native latency benchmark for a chosen diffusion model using sglang generate.

Frequently Asked Questions about sglang-diffusion-benchmark-profile

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I profile diffusion denoising latency to find bottlenecks?

To profile diffusion denoising latency, this Skill automates torch.profiler traces and hotspot ranking to identify bottlenecks in SGLang's native diffusion backend. It maps detected performance limitations to fast paths for targeted optimization.

What do I need to run a diffusion latency benchmark in SGLang?

To run a diffusion latency benchmark, you need the native SGLang diffusion backend, a writable repository, HF_TOKEN for gated models, and idle GPUs configured via diffusion_skill_env.py before executing the benchmark presets.

Can I use checked-in presets for repeatable GPU benchmarking of diffusion models?

Yes, you can use checked-in denoise presets and standard perf dumps to generate repeatable GPU benchmarking metrics for local diffusion workloads across supported models in SGLang.

What should I do after identifying a kernel bottleneck in a diffusion workload?

After identifying a kernel bottleneck, the Skill provides workflow handoff guidance to delegate the kernel-optimization work to specialized optimization skills to resolve the detected performance hotspots.