vast-gpu

Rent and manage on-demand vast.ai GPU instances from task requirements.

Updated Apr 21, 2026
One-click install
npx skills add https://github.com/Shallow-W/llm-wiki --skill vast-gpu-shallow-w
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vast-gpu
Source: https://github.com/Shallow-W/llm-wiki/tree/main/.claude/skills/vast-gpu
Command: npx skills add https://github.com/Shallow-W/llm-wiki --skill vast-gpu-shallow-w

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill eliminates the time-consuming process of choosing GPU hardware by automatically estimating GPU needs, finding cost-optimized offers on vast.ai, and managing the full rent-to-destroy lifecycle.

Core Features & Use Cases

  • Task-driven GPU sizing: Estimates minimum VRAM, number of GPUs, disk, CUDA/PyTorch compatibility, and expected training hours from an experiment plan, existing scripts, or user description.
  • Cost-optimized offer selection: Searches broad GPU tiers and presents 3 ranked options using estimated total cost (not just $/hr), with reliability and speed considerations.
  • End-to-end instance lifecycle: Provisions a chosen offer, installs dependencies and syncs code to the instance, and destroys the instance to stop billing while downloading results first.
  • Stateful experiment integration: Maintains a vast-instances.json state file to support /run-experiment and /monitor-experiment workflows.

Quick Start

Trigger GPU renting by asking for an on-demand GPU for your task, for example: "Rent a cloud GPU to run my experiment, using vast ai."

Frequently Asked Questions about vast-gpu

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I rent a cloud GPU for ML training without knowing which GPU model to choose?

You can rent a cloud GPU by estimating VRAM, disk, and runtime needs from your experiment plan or scripts, allowing the system to find cost-optimized offers automatically. This eliminates manual GPU model selection by deriving hardware requirements directly from task descriptions.

What do I need to set up before provisioning vast.ai on-demand GPU instances?

You need vastai CLI authentication with Python ≥ 3.10 and pre-uploaded SSH keys to provision vast.ai on-demand GPU instances. These prerequisites enable automated instance provisioning, secure access, and lifecycle management.

How does cost optimization work when renting on-demand GPUs?

Cost optimization for on-demand GPUs works by searching broad GPU tiers and ranking options using estimated total cost, which includes runtime hours, rather than just hourly rates. This ensures economical choices by evaluating reliability and speed alongside price.

How do I manage the lifecycle of a rented GPU instance to stop billing?

To manage the lifecycle of a rented GPU instance and stop billing, you provision the instance, sync code, run the experiment, and then destroy the instance after downloading results. This controlled lifecycle halts billing immediately after task completion.

Can I use my existing scripts to estimate GPU VRAM and disk requirements?

Yes, you can use existing scripts, experiment plans, or user descriptions to estimate GPU VRAM, number of GPUs, disk space, and CUDA/PyTorch compatibility. The system derives hardware requirements directly from these inputs for automated sizing.