sglang-deepseek-v32-optimization

Provide PR-backed optimization guidance for DeepSeek V3.2 SGLang models.

721|65|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill sglang-deepseek-v32-optimization
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: sglang-deepseek-v32-optimization
Source: https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS/tree/main/skills/model-optimization/sglang/sglang-deepseek-v32-optimization
Command: npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill sglang-deepseek-v32-optimization

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

PR-backed optimization playbook for DeepSeek V3.2 across SGLang model variants, enabling auditable, reproducible performance improvements.

Core Features & Use Cases

  • PR-dossier based optimization guidance for V3.2 family including Exp/Speciale/NVFP4/MXFP4
  • Guidance on defaults, backends, indexer, MTP, DSML parser, and tool-calling integration
  • Use case: triage regressions and plan optimizations with evidence-backed steps

Quick Start

Review the latest PR dossier to begin optimizing DeepSeek V3.2 in SGLang.

Frequently Asked Questions about sglang-deepseek-v32-optimization

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize DeepSeek V3.2 performance using SGLang?

DeepSeek V3.2 optimization in SGLang is guided by a PR-backed playbook covering defaults, backends, indexer, MTP, and DSML parser configuration. Reviewing the latest PR dossier provides evidence-backed steps to triage regressions and plan reproducible improvements.

What is the NSA indexer in DeepSeek V3.2 and when do I need to configure it?

The NSA indexer is a core component in DeepSeek V3.2 variants for managing attention mechanisms within SGLang. You need to configure it when optimizing model variants like Exp, Speciale, NVFP4, or MXFP4 to ensure proper chat-template validation and performance.

Does SGLang support DSML tool calling for DeepSeek V3.2 variants?

Yes, SGLang supports DSML tool calling integration for the DeepSeek V3.2 family. The optimization guidance includes configuring the DSML parser and validating chat templates to ensure tool-calling features function correctly across V3.2 variants.

How do I triage DeepSeek V3.2 performance regressions in SGLang?

Triage DeepSeek V3.2 regressions by reviewing the PR dossier and production-bar SKILL.md references. This governance approach provides auditable, evidence-backed steps to identify issues across backends, MTP, and indexer configurations.

Can I use this SGLang optimization playbook for both NVFP4 and MXFP4 DeepSeek variants?

Yes, the optimization playbook explicitly supports the full DeepSeek V3.2 family, including NVFP4 and MXFP4 variants. It provides targeted guidance on defaults, backends, and chat-template validation specific to these quantized model formats.

Why does my DeepSeek V3.2 chat template fail validation in SGLang?

Chat-template validation failures in DeepSeek V3.2 often stem from misconfigured defaults or DSML parser settings within SGLang. The PR-backed optimization playbook outlines the necessary governance steps to validate and correct template configurations.