skills.rest
juburr
juburrCOMMUNITY
Explore all skills by this author →
GitHub

vllm-deployment

Deploy and manage vLLM OpenAI-compatible servers across local, cloud, and air-gapped environments.

1|Updated Feb 19, 2026
Search Tags:#deployment#server#openai-compatible#vllm#air-gapped#gpu-memory
One-click install
npx skills add https://github.com/juburr/mad-skills --skill vllm-deployment-juburr
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: vllm-deployment
Source: https://github.com/juburr/mad-skills/tree/main/vllm-deployment
Command: npx skills add https://github.com/juburr/mad-skills --skill vllm-deployment-juburr

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Guides deploying, configuring, and troubleshooting vLLM OpenAI-compatible servers. Use when serving LLMs with vLLM, sizing models for GPU/VRAM constraints, writing vllm serve commands, diagnosing OOM or API errors, configuring air-gapped deployments, or calling vLLM-specific API extensions like structured outputs and reasoning outputs.

Core Features & Use Cases

  • Deployment planning and configuration guidance for vLLM servers.
  • Model sizing and tuning for 64-96GB VRAM setups and air-gapped environments.
  • Troubleshooting playbooks for OOMs, API errors, and offline docs.
  • API extension usage like structured_outputs and reasoning outputs with vLLM.

Quick Start

Check your environment, choose a model, and run a minimal vLLM serve command to verify deployment.

Frequently Asked Questions about vllm-deployment

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I deploy a vLLM server without running out of GPU memory?▼

To deploy a vLLM server without running out of GPU memory, size your model for specific VRAM constraints and configure memory controls. This Skill provides deployment planning for 64-96GB VRAM setups.

Can I run vLLM in an air-gapped environment?▼

Yes, vLLM supports air-gapped deployments. You can configure offline operation and use offline documentation to manage servers without external network access.

How do I fix vLLM OpenAI-compatible API errors?▼

Fix vLLM OpenAI-compatible API errors by following dedicated troubleshooting playbooks. These playbooks help diagnose OOMs, API failures, and offline documentation issues.

Does vLLM support structured outputs and reasoning outputs?▼

Yes, vLLM supports structured outputs and reasoning outputs via API extensions. You can call these vLLM-specific features while serving models through the OpenAI-compatible interface.

What is the minimal vllm serve command to start a deployment?▼

The minimal vllm serve command requires checking your environment and choosing a model. Running this command verifies your local or cloud deployment setup quickly.

What are the security considerations for vLLM production use?▼

Security considerations for vLLM production use involve managing deployment configurations and access controls. This ensures safe operation across local, cloud, and air-gapped environments.

Related Skills

Explore More Software Engineering Skills→
freedomw1987freedomw1987
2

comfyui

Deploy, configure, and execute ComfyUI generative media workflows locally or in the cloud.

Community
Advanced
alexdcdalexdcd
46

openrouter

Route requests across 400+ AI models with automatic failover via a unified API.

Community
Advanced
jayll1303jayll1303
17

model-quantization

Quantize large language models with GGUF, GPTQ, AWQ, and bitsandbytes.

Community
Advanced
erfanzarerfanzar
27

serving-llms-vllm

Serve LLMs with OpenAI-compatible endpoints using vLLM inference.

Community
Advanced