gpu-host-tuning

What problem does it solve?

This Skill helps operators audit and tune Linux GPU inference hosts to surface configuration gaps and optimize throughput across CPU, memory, PCIe, NICs, and NVIDIA GPUs.

Core Features & Use Cases

• Read-only audit to surface misconfigurations and bottlenecks across CPU power states, kernel parameters, NUMA, PCIe, NICs, and GPUs.
• Bench to measure pinned-host ↔ GPU memcpy ceilings and establish ground-truth baselines for KV offload paths.
• Tune to apply a cheat-sheet of BIOS, kernel, driver, and NIC settings for production inference workloads.
• Supports phase-driven flow: audit -> bench -> tune; generates INDEX.md and drift reports; supports multiple chassis (Dell XE9680/ XE9780) and DGX-like setups.

Quick Start

Run ./scripts/collect.sh to generate a baseline snapshot, review the resulting INDEX.md, and begin applying tunings from the cheat-sheet.