sglang-diffusion-ako4all-kernel

Optimize SGLang diffusion kernels with ncu profiling and denoise validation.

556|81|Updated May 19, 2026
One-click install
npx skills add https://github.com/FutureMLS-Lab/OSCAR --skill sglang-diffusion-ako4all-kernel-futuremls-lab
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: sglang-diffusion-ako4all-kernel
Source: https://github.com/FutureMLS-Lab/OSCAR/tree/main/sglang-research/python/sglang/multimodal_gen/.claude/skills/sglang-diffusion-ako4all-kernel
Command: npx skills add https://github.com/FutureMLS-Lab/OSCAR --skill sglang-diffusion-ako4all-kernel-futuremls-lab

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires git, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a disciplined workflow for improving slow SGLang diffusion kernels without relying on unvalidated microbench gains or risking regressions in real model inference.

Core Features & Use Cases

  • AKO4ALL Setup and Hygiene: Clone, synchronize, and verify a clean AKO4ALL repository before optimization work.
  • Kernel Optimization Loop: Build custom microbenchmarks, establish baselines, profile with ncu, iterate on one optimization idea at a time, and record results.
  • Production Validation: Port the best candidate back to SGLang, run targeted tests, compare denoise and end-to-end performance, and preserve correctness evidence for models such as Qwen, FLUX, Wan, Hunyuan, and MOVA.
  • Use Case: When an SGLang diffusion kernel is confirmed as a hotspot, use this Skill to benchmark it in AKO4ALL, diagnose register or occupancy limitations, optimize it, and verify that the improvement transfers to real denoising workloads.

Quick Start

Use this Skill to optimize the identified SGLang diffusion kernel through a clean AKO4ALL harness, ncu-guided iteration, SGLang integration, and model-level denoise validation.

Frequently Asked Questions about sglang-diffusion-ako4all-kernel

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize SGLang diffusion kernels without causing regressions in model inference?

To optimize SGLang diffusion kernels safely, use a disciplined workflow that builds custom microbenchmarks, profiles with ncu, and validates improvements against real denoising workloads before porting changes back to production.

What is the best way to profile Triton and CUDA JIT kernels for diffusion models?

The best way to profile Triton and CUDA JIT kernels is using ncu profiling within a clean AKO4ALL checkout to establish baselines, diagnose register or occupancy limitations, and iterate on one optimization idea at a time.

How do I validate that kernel optimizations transfer to real denoising workloads?

To validate kernel optimizations for real denoising workloads, port the best candidate back to SGLang, run targeted tests, compare denoise performance dumps, and execute end-to-end validation to preserve correctness evidence.

When should I optimize a diffusion kernel hotspot in SGLang?

You should optimize a diffusion kernel hotspot in SGLang only after profiling has established a genuine hotspot, ensuring that the optimization effort targets actual performance bottlenecks rather than unvalidated microbench gains.

Do I need a clean repository checkout to benchmark and optimize CUDA kernels?

Yes, you need a clean AKO4ALL repository checkout to benchmark and optimize CUDA kernels, because cloning, synchronizing, and verifying repository hygiene before optimization work prevents contamination of baseline performance metrics.

Does the kernel optimization workflow support correctness checking for models like Qwen and FLUX?

Yes, the kernel optimization workflow supports correctness checking for models like Qwen, FLUX, Wan, Hunyuan, and MOVA by requiring custom correctness-checked microbenchmarks and preserving correctness evidence during end-to-end validation.