vllm-llama4-optimization
CommunityPR-backed Llama4 optimization for vLLM
AuthorBBuf
Version1.0.0
Installs0
System Documentation
What problem does it solve?
PR-backed optimization manual for Llama4 in vLLM to support auditing, debugging, extending, and documenting Llama4's text and multimodal runtime, FP8/FP4 quantization, router behavior, long-context attention, and Eagle integration.
Core Features & Use Cases
- Optimization governance: PR-audited guidelines for changes to Llama4 runtime in vLLM.
- Quantization and routing: Guidance for FP8/FP4 quantization and router behavior tuning across multimodal scenarios.
- Eagle and multimodal support: Documentation for Eagle integration and multimodal workloads in vLLM.
- Use Case: A reviewer documents a PR to improve the Llama4 quantization path and updates docs and tests accordingly.
Quick Start
Review PR-backed Llama4 optimizations in vLLM and draft the implementation plan.
Dependency Matrix
Required Modules
None requiredComponents
references
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: vllm-llama4-optimization Download link: https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS/archive/main.zip#vllm-llama4-optimization Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.