vast-gpu

Estimate GPU requirements and rent cost-optimized vast.ai instances.

Updated May 20, 2026
One-click install
npx skills add https://github.com/lightrain-a/medtrace-aris --skill vast-gpu-lightrain-a
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vast-gpu
Source: https://github.com/lightrain-a/medtrace-aris/tree/main/.vendor/aris/skills/vast-gpu
Command: npx skills add https://github.com/lightrain-a/medtrace-aris --skill vast-gpu-lightrain-a

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill removes the complexity of selecting and provisioning the right GPU hardware by automatically estimating GPU needs from your experiment and renting an appropriate vast.ai instance.

Core Features & Use Cases

  • Task-driven GPU requirement estimation: Infers min VRAM, disk, CUDA/PyTorch compatibility, and whether 1 vs multi-GPU is needed from the experiment plan, scripts, and user description.
  • Value-optimized offer selection: Searches broadly across GPU tiers and presents 3 ranked options using estimated total cost (not just $/hr) and reliability guidance.
  • End-to-end GPU lifecycle management: Provisions the instance, waits for readiness, sets up dependencies and code sync, supports running the experiment, and destroys the instance to stop billing.

Quick Start

Run an experiment with gpu set to vast so the system provisions a cost-optimized vast.ai GPU instance and sets it up automatically.

Frequently Asked Questions about vast-gpu

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automatically estimate GPU requirements for ML training on vast.ai?

Automatically estimating GPU requirements involves analyzing experiment scripts to determine min VRAM, disk, and PyTorch compatibility. The system then searches vast.ai broadly across GPU tiers and presents 3 ranked options using estimated total cost and reliability.

Does vast.ai GPU rental support end-to-end instance lifecycle management?

Vast.ai GPU rental supports complete lifecycle management by provisioning instances, waiting for readiness, configuring dependencies, and destroying instances post-experiment. This ensures predictable costs and minimal operational overhead for on-demand training runs.

What do I need to set up before renting GPUs on vast.ai for fine-tuning models?

To rent GPUs on vast.ai, you must install the vastai CLI using Python 3.10 or higher and configure SSH key prerequisites. The system maintains a local vast-instances.json state file to track provisioned setups during fine-tuning.

Can I find cost-optimized vast.ai instances for multi-GPU training runs?

Finding cost-optimized vast.ai instances for multi-GPU training involves estimating total costs across GPU tiers rather than just hourly rates. The system presents three ranked options with reliability guidance, fitting scenarios like ablations and on-demand runs.

How does vast.ai instance provisioning handle SSH setup and code synchronization?

Instance provisioning on vast.ai manages SSH key prerequisites, waits for readiness, and executes dependency setup and code sync. This supports running experiments directly on the rented instance with predictable operational overhead.