vllm-deepseek-v3-r1-optimization

Community

Optimize DeepSeek V3/R1 workflows in vLLM.

AuthorBBuf
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This skill provides a structured, PR-backed guide to optimize and verify DeepSeek V3 and R1 implementations within vLLM, enabling engineers to audit changes, extend support, and document best practices for MLA, MoE, packed-module loading, LoRA, MTP/Eagle, and ROCm/CUDA validation paths.

Core Features & Use Cases

  • PR-diff driven optimization guidance for DeepSeek V3/R1 changes across the vLLM runtime surfaces.
  • Maps to concrete model files and tooling, including vllm/model_executor/models/deepseek_v2.py, deepseek_eagle.py, and deepseek_mtp.py.
  • Use cases include validating new LoRA support, packed-module loading improvements, and end-to-end validation across BF16/FP8 and ROCm paths.

Quick Start

Review the PR diffs and canonical notes in references/pr-history.md to compose a production-ready optimization dossier for a given PR.

Dependency Matrix

Required Modules

None required

Components

references

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: vllm-deepseek-v3-r1-optimization
Download link: https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS/archive/main.zip#vllm-deepseek-v3-r1-optimization

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.