Vram-GPU-OOM

Coordinate GPU VRAM usage across Ollama, Whisper, and ComfyUI with OOM retry and auto-unload.

Updated Dec 22, 2025
One-click install
npx skills add https://github.com/lawless-m/Gwen --skill vram-gpu-oom
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: Vram-GPU-OOM
Source: https://github.com/lawless-m/Gwen/tree/main/.claude/skills/Vram-GPU-OOM-memory-management
Command: npx skills add https://github.com/lawless-m/Gwen --skill vram-gpu-oom

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides GPU VRAM sharing and OOM retry patterns to coordinate memory across Ollama, Whisper, and ComfyUI, with auto-unload and signaling endpoints.

Core Features & Use Cases

  • Cross-service OOM retry with delays
  • Auto-unload on idle to free VRAM
  • Optional signaling endpoints to request unloads

Quick Start

Implement OOM retry logic and configure auto-unload; test with smaller models before scaling up.

Frequently Asked Questions about Vram-GPU-OOM

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I prevent out-of-memory errors when running multiple AI services on the same GPU?

Coordinate GPU VRAM usage across Ollama, Whisper, and ComfyUI by implementing OOM retry logic with configurable delays and automatic cache cleanup. The Skill enables cross-service signaling so services can request unloads when memory pressure rises, preventing crashes.

Can I automatically free GPU VRAM when services go idle?

Yes. The Skill provides auto-unload on idle to release VRAM without manual intervention. Configure idle thresholds and the system will unload models from memory, freeing capacity for other services while maintaining quick restart capability.

What's the best way to handle GPU out-of-memory retry across Ollama, Whisper, and ComfyUI?

Use cross-service OOM retry with delays and retry counts. When one service hits OOM, the Skill signals others to unload, waits a configurable interval, then retries the failed operation. This pattern prevents cascading failures across your AI service stack.

Do I need custom endpoints to coordinate GPU memory between services?

The Skill includes optional signaling endpoints to request unloads and report service status. Use these to integrate with your workflow, or rely on built-in auto-unload and retry without additional API calls if your use case permits.

What services does GPU VRAM coordination support?

Coordination is designed for Ollama, Whisper, and ComfyUI. The Skill applies OOM detection, retry logic, and auto-unload patterns to these three services, with signaling endpoints for cross-service communication.