gem-llm-vllm-debug

What problem does it solve?

This Skill helps you quickly identify and resolve vLLM model-server startup and runtime failures, including dependency mismatches and GPU-related crashes, so your Claude Code workflow can resume without long downtime.

Core Features & Use Cases

• Compatibility & dependency matrix: Provides a validated version set (Python, vLLM, transformers, flashinfer, etc.) tailored to common failure patterns.
• Dual-model vLLM launch templates: Supports operational debugging for Qwen2.5-Coder-32B and Qwen3-Coder-30B-A3B with correct tensor-parallel settings and tool-calling parser configuration.
• Failure-mode playbook: Covers frequent issues like option incompatibilities, flashinfer version mismatches, DeepGEMM backend unavailability, transformers/mistral_common API breaks, model architecture recognition errors, port conflicts, and leftover GPU memory after crashes.

Quick Start

Run the installer hook for gem-llm-vllm-debug to use the validated debugging setup for your current environment.