skills.rest
Nabilhassan12345
Nabilhassan12345COMMUNITY
Explore all skills by this author →
GitHub

sglang-diffusion-performance

Optimizes SGLang diffusion pipeline throughput by selecting fastest flags and configurations across GPUs and VRAM budgets.

Updated Apr 7, 2026
Search Tags:#performance#optimization#latency#benchmark#gpu#diffusion#sglang
One-click install
npx skills add https://github.com/Nabilhassan12345/voice-ai-workspace --skill sglang-diffusion-performance
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: sglang-diffusion-performance
Source: https://github.com/Nabilhassan12345/voice-ai-workspace/tree/main/sglang/python/sglang/multimodal_gen/.claude/skills/sglang-diffusion-performance
Command: npx skills add https://github.com/Nabilhassan12345/voice-ai-workspace --skill sglang-diffusion-performance

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Optimizes diffusion pipeline performance for SGLang by selecting the fastest flags and configurations.

Core Features & Use Cases

  • Guided optimization: Recommends lossless and lossy optimization options (e.g., Torch compile, offload strategies, attention backends) to improve throughput with minimal quality impact.
  • Benchmark-driven tuning: Provides strategies to compare configurations and identify bottlenecks for single-GPU and multi-GPU deployments.
  • Use case: When deploying SGLang diffusion models on Wan2.2 or Flux hardware, use this skill to reach the lowest latency within a given VRAM budget.

Quick Start

Configure a diffusion run to maximize throughput on Wan2.2 with 8 GPUs using torch.compile and offload settings while staying within VRAM limits.

Frequently Asked Questions about sglang-diffusion-performance

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize diffusion pipeline performance in SGLang?▼

Optimize diffusion pipeline performance in SGLang by selecting the fastest CLI flags and configurations, applying memory offloads, attention backends, and benchmarking strategies to maximize throughput.

What is the best way to reduce latency for SGLang diffusion models within a VRAM budget?▼

Reduce latency for SGLang diffusion models within a VRAM budget by applying lossless and lossy optimization options like Torch compile and offload strategies to reach peak speed without exceeding memory limits.

Can I configure multi-GPU deployments for SGLang diffusion pipelines?▼

Yes, you can configure multi-GPU deployments for SGLang diffusion pipelines by using specific CLI flags, memory offload strategies, and attention backends tailored for scaling across models and GPUs.

How do I benchmark SGLang diffusion configurations to identify bottlenecks?▼

Benchmark SGLang diffusion configurations by comparing different settings across single-GPU and multi-GPU scenarios to identify bottlenecks and achieve optimal throughput for your deployment.

Does SGLang diffusion performance tuning work with Wan2.2 or Flux hardware?▼

SGLang diffusion performance tuning works with Wan2.2 or Flux hardware, providing structured guidance on CLI flags and offload settings to maximize throughput while staying within VRAM limits.

Related Skills

Explore More Software Engineering Skills→
QingHuan-6QingHuan-6

sglang-diffusion-performance

Identify fastest SGLang Diffusion flags for a model, GPU, and VRAM budget.

Community
Advanced
jiunbaejiunbae
12

ml-benchmark

Automate ML model benchmarking across versions and languages with JSON and Markdown reports.

Community
Advanced
dyyounggdyyoungg

sglang-diffusion-performance

Benchmark SGLang diffusion pipelines to select optimal flags for GPUs and VRAM budgets.

Community
Advanced
flashinfer-aiflashinfer-ai
264

extract-kernel-definitions

Extract GPU kernel schemas from SGLang models into deduplicated Definition JSON files.

Official
Advanced