gpu-optimizer

Optimize PyTorch and CUDA training on NVIDIA GPUs with 8–24GB VRAM.

310|45|Updated Feb 22, 2026
One-click install
npx skills add https://github.com/Mathews-Tom/praxis-skills --skill gpu-optimizer
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: gpu-optimizer
Source: https://github.com/Mathews-Tom/praxis-skills/tree/main/skills/gpu-optimizer
Command: npx skills add https://github.com/Mathews-Tom/praxis-skills --skill gpu-optimizer

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Provides evidence-based optimization patterns to reduce out-of-memory errors, improve training throughput, and migrate CPU-bound workflows to NVIDIA GPUs for consumer-class cards (8–24GB VRAM).

Core Features & Use Cases

  • XGBoost GPU acceleration: QuantileDMatrix, gpu_hist, and device-aware training for faster boosting on CUDA-enabled builds.
  • PyTorch mixed precision & compilation: BF16/FP16 selection, GradScaler fallbacks, fused optimizers, and torch.compile guidance to boost performance.
  • VRAM management & diagnostics: Gradient checkpointing, accumulation strategies, peak memory monitoring, and profiling to locate bottlenecks.
  • CuPy / cuDF migrations: Patterns for NumPy→CuPy and Pandas→cuDF transitions including zero-copy interop with PyTorch.
  • Practical trade-offs & anti-patterns: Clear guidance on when to apply each pattern and what to avoid to preserve GPU pipeline efficiency.

Quick Start

Optimize your model training on an NVIDIA GPU with 8–24GB VRAM by enabling BF16 or FP16, turning on gradient checkpointing, and running the diagnostics to validate memory and performance.

Frequently Asked Questions about gpu-optimizer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fix PyTorch CUDA out-of-memory errors on consumer GPUs?

Resolve PyTorch CUDA out-of-memory errors by enabling gradient checkpointing, activating BF16 or FP16 mixed precision, and implementing VRAM accumulation strategies to reduce peak memory usage on consumer NVIDIA cards.

What is the best way to accelerate XGBoost training with CUDA?

Accelerate XGBoost training with CUDA by utilizing QuantileDMatrix, configuring the gpu_hist tree method, and applying device-aware training parameters to execute faster boosting operations directly on CUDA-enabled builds.

How do I migrate Pandas and NumPy workflows to cuDF and CuPy?

Migrate Pandas and NumPy workflows to cuDF and CuPy using established transition patterns that support zero-copy memory interoperability with PyTorch tensors for seamless GPU data pipeline execution.

Does torch.compile work with mixed precision for PyTorch throughput optimization?

torch.compile works with mixed precision for PyTorch throughput optimization by combining BF16/FP16 selection, GradScaler fallbacks, and fused optimizers to maximize training performance and increase GPU pipeline efficiency.

When should I use gradient checkpointing versus mixed precision to prevent OOMs?

Choose between gradient checkpointing and mixed precision to prevent OOMs by diagnosing specific VRAM bottlenecks through peak memory monitoring and profiling, applying clear trade-offs and anti-patterns to preserve GPU pipeline efficiency.