sglang-deepseek-v3-r1-optimization

Map DeepSeek V3/R1 optimization symptoms to MLA, MoE, and quantization paths in SGLang.

721|65|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill sglang-deepseek-v3-r1-optimization
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: sglang-deepseek-v3-r1-optimization
Source: https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS/tree/main/skills/model-optimization/sglang/sglang-deepseek-v3-r1-optimization
Command: npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill sglang-deepseek-v3-r1-optimization

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

PR-backed and current-main optimization manual for DeepSeek V3 and DeepSeek R1 in SGLang. Use when Codex needs to recover, extend, or audit DeepSeek V3/R1 MLA, MoE, shared experts, FP8/FP4/W4AFP8/MXFP4/NVFP4 loading, MTP, DeepEP, DP attention, LoRA, backend selection, or validation lanes.

Core Features & Use Cases

  • Provides a comprehensive, production-ready playbook for MLA/MoE, quant loading, NextN/MTP, DeepEP, and backend selection in SGLang.
  • Establishes a rigorous evidence and validation workflow, with references to PR histories, runtime surfaces, and test lanes.

Quick Start

Audit the current DeepSeek V3/R1 optimization state to map symptoms to the correct layer before code changes.

Frequently Asked Questions about sglang-deepseek-v3-r1-optimization

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize DeepSeek V3 or R1 inference in SGLang?

Optimize DeepSeek V3 or R1 in SGLang by mapping performance symptoms to the correct MLA, MoE, or quantization path, then apply targeted code changes using the structured validation playbook for loader checks and backend selection.

What is the best way to configure FP8 or FP4 quantization loading for DeepSeek models?

Configuring FP8 or FP4 quantization loading for DeepSeek models involves selecting the correct loader configuration across W4AFP8, MXFP4, or NVFP4 paths to validate settings and diagnose regressions in current-main SGLang deployments.

How does Multi-Token Prediction (MTP) and NextN work in SGLang DeepSeek deployments?

Multi-Token Prediction (MTP) and NextN in SGLang DeepSeek deployments function as optimization paths that require specific backend selection and evidence collection to validate configurations and ensure inference speedups without regressions.

Why is my DeepSeek V3 R1 MoE or MLA inference regression happening?

DeepSeek V3 or R1 MoE and MLA inference regressions often stem from incorrect loader configurations or suboptimal backend selection, which you can diagnose by mapping symptoms to the optimization ladder and checking PR history.

Can I use DeepEP and DP attention with DeepSeek R1 in SGLang?

Yes, you can use DeepEP and DP attention with DeepSeek R1 in SGLang by following the production-ready playbook to establish a rigorous evidence and validation workflow across these specific runtime surfaces.

What are the limitations when applying MLA and shared experts optimization in SGLang?

Limitations when applying MLA and shared experts optimization in SGLang include potential configuration regressions, requiring strict evidence collection and runtime surface checks to validate targeted code changes across current-main deployments.