vllm-deepseek-v3-r1-optimization

Documents PR-backed optimizations for DeepSeek V3/R1 in vLLM.

721|65|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill vllm-deepseek-v3-r1-optimization
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: vllm-deepseek-v3-r1-optimization
Source: https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS/tree/main/skills/model-optimization/vllm/vllm-deepseek-v3-r1-optimization
Command: npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill vllm-deepseek-v3-r1-optimization

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This skill provides a structured, PR-backed guide to optimize and verify DeepSeek V3 and R1 implementations within vLLM, enabling engineers to audit changes, extend support, and document best practices for MLA, MoE, packed-module loading, LoRA, MTP/Eagle, and ROCm/CUDA validation paths.

Core Features & Use Cases

  • PR-diff driven optimization guidance for DeepSeek V3/R1 changes across the vLLM runtime surfaces.
  • Maps to concrete model files and tooling, including vllm/model_executor/models/deepseek_v2.py, deepseek_eagle.py, and deepseek_mtp.py.
  • Use cases include validating new LoRA support, packed-module loading improvements, and end-to-end validation across BF16/FP8 and ROCm paths.

Quick Start

Review the PR diffs and canonical notes in references/pr-history.md to compose a production-ready optimization dossier for a given PR.

Frequently Asked Questions about vllm-deepseek-v3-r1-optimization

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize DeepSeek V3 and R1 implementations in vLLM?▼

To optimize DeepSeek V3 and R1 in vLLM, audit PR-backed changes across runtime surfaces like deepseek_v2.py, focusing on MLA, MoE, packed-module loading, and MTP/Eagle using diff-driven guidance.

What is the best way to validate LoRA support and packed-module loading for DeepSeek models?▼

Validating LoRA support and packed-module loading for DeepSeek involves mapping changes to vLLM model executor files and verifying end-to-end execution paths across BF16/FP8 and ROCm/CUDA using PR diff audits.

How does MLA and MoE optimization work for DeepSeek R1 within vLLM?▼

MLA and MoE optimization for DeepSeek R1 in vLLM works by systematically codifying PR-backed architecture changes, anchoring guidance to runtime surfaces, and validating quantized ROCm and CUDA paths.

Does vLLM support end-to-end validation for DeepSeek MTP and Eagle across BF16 and FP8?▼

vLLM supports end-to-end validation for DeepSeek MTP and Eagle by mapping PR diffs to deepseek_eagle.py and deepseek_mtp.py, enabling robust verification across BF16, FP8, and ROCm execution paths.

Can I use PR diff audits to extend vLLM support for DeepSeek V3 quantized ROCm paths?▼

You can use PR diff audits to extend vLLM support for DeepSeek V3 quantized ROCm paths by reviewing canonical optimization histories and codifying validation steps for model_executor components.

When do I need to review PR history for DeepSeek vLLM optimizations?▼

You need to review PR history for DeepSeek vLLM optimizations when composing a production-ready dossier for a given PR, ensuring diff-driven and verifiable guidance for MLA, MoE, and LoRA extensions.