vllm-deepseek-v3-r1-optimization

Documents PR-backed optimizations for DeepSeek V3/R1 in vLLM.

721|65|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill vllm-deepseek-v3-r1-optimization
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vllm-deepseek-v3-r1-optimization
Source: https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS/tree/main/skills/model-optimization/vllm/vllm-deepseek-v3-r1-optimization
Command: npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill vllm-deepseek-v3-r1-optimization

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This skill provides a structured, PR-backed guide to optimize and verify DeepSeek V3 and R1 implementations within vLLM, enabling engineers to audit changes, extend support, and document best practices for MLA, MoE, packed-module loading, LoRA, MTP/Eagle, and ROCm/CUDA validation paths.

Core Features & Use Cases

  • PR-diff driven optimization guidance for DeepSeek V3/R1 changes across the vLLM runtime surfaces.
  • Maps to concrete model files and tooling, including vllm/model_executor/models/deepseek_v2.py, deepseek_eagle.py, and deepseek_mtp.py.
  • Use cases include validating new LoRA support, packed-module loading improvements, and end-to-end validation across BF16/FP8 and ROCm paths.

Quick Start

Review the PR diffs and canonical notes in references/pr-history.md to compose a production-ready optimization dossier for a given PR.

Frequently Asked Questions about vllm-deepseek-v3-r1-optimization

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize DeepSeek V3 and R1 implementations in vLLM?

To optimize DeepSeek V3 and R1 in vLLM, audit PR-backed changes across runtime surfaces like deepseek_v2.py, focusing on MLA, MoE, packed-module loading, and MTP/Eagle using diff-driven guidance.

What is the best way to validate LoRA support and packed-module loading for DeepSeek models?

Validating LoRA support and packed-module loading for DeepSeek involves mapping changes to vLLM model executor files and verifying end-to-end execution paths across BF16/FP8 and ROCm/CUDA using PR diff audits.

How does MLA and MoE optimization work for DeepSeek R1 within vLLM?

MLA and MoE optimization for DeepSeek R1 in vLLM works by systematically codifying PR-backed architecture changes, anchoring guidance to runtime surfaces, and validating quantized ROCm and CUDA paths.

Does vLLM support end-to-end validation for DeepSeek MTP and Eagle across BF16 and FP8?

vLLM supports end-to-end validation for DeepSeek MTP and Eagle by mapping PR diffs to deepseek_eagle.py and deepseek_mtp.py, enabling robust verification across BF16, FP8, and ROCm execution paths.

Can I use PR diff audits to extend vLLM support for DeepSeek V3 quantized ROCm paths?

You can use PR diff audits to extend vLLM support for DeepSeek V3 quantized ROCm paths by reviewing canonical optimization histories and codifying validation steps for model_executor components.

When do I need to review PR history for DeepSeek vLLM optimizations?

You need to review PR history for DeepSeek vLLM optimizations when composing a production-ready dossier for a given PR, ensuring diff-driven and verifiable guidance for MLA, MoE, and LoRA extensions.