Locate official vLLM documentation for configuring and debugging LLM inference.
npx skills add https://github.com/wenerme/ai --skill vllm-docs
Please help me install this Agent Skill. Skill: vllm-docs Source: https://github.com/wenerme/ai/tree/main/skills/vllm-docs Command: npx skills add https://github.com/wenerme/ai --skill vllm-docs
vLLM users need fast, accurate guidance for configuring high-performance LLM inference and resolving tricky serving issues across models, quantization methods, and distributed setups.
Use the vllm-docs skill to locate the exact documentation page for the feature you need and follow it to configure your deployment for OpenAI-compatible serving.
High-intent search queries and answers about installing and using this skill.
vLLM supports OpenAI-compatible serving by configuring specific serve arguments and CLI options. You can deploy it using Docker, Kubernetes, or reverse proxies by following the navigable documentation index for exact setup steps.
vLLM distributed deployment utilizes tensor, pipeline, expert, and context parallelism. You can configure these serving modes and troubleshoot distributed environments using the provided official documentation references and engine arguments.
vLLM supports AWQ, GPTQ, FP8, GGUF, and INT4/8 quantization methods. The documentation details how to apply these formats to optimize memory and maintain high-throughput LLM inference performance.
vLLM supports multimodal inputs and LoRA adapters for advanced inference. The documentation provides reference links detailing how to implement these features alongside structured outputs and speculative decoding.
Distributed vLLM serving failures often stem from misconfigured parallelism arguments. Use the dedicated troubleshooting documentation to verify engine arguments, environment variables, and distributed deployment patterns.
SriRamkunamsettyServe OpenAI-compatible LLM endpoints with vLLM using quantization and tensor parallelism.
guccangDeploy vLLM inference endpoints with OpenAI-compatible APIs and GPU optimization.
iulianditaConfigure and troubleshoot Linux DNS, reverse proxies, VPNs, and nftables firewalls.
LynxLabVNServe large language models with OpenAI-compatible APIs and quantization.
