vast-gpu

Provisions, configures, and destroys vast.ai GPU instances for ML training workloads.

Updated Jul 9, 2026
One-click install
npx skills add https://github.com/Lingjie-wang/autoRL --skill vast-gpu-lingjie-wang
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vast-gpu
Source: https://github.com/Lingjie-wang/autoRL/tree/main/Auto-claude-code-research-in-sleep/skills/vast-gpu
Command: npx skills add https://github.com/Lingjie-wang/autoRL --skill vast-gpu-lingjie-wang

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires vastai.

What problem does it solve? Renting cloud GPUs for ML experiments requires manually estimating VRAM needs, comparing offers, configuring SSH access, and remembering to tear down instances to stop billing. This Skill automates the full vast.ai instance lifecycle so you describe the training task and get a cost-optimized GPU without picking hardware yourself. ## Core Features & Use Cases - Task-driven GPU selection: Analyzes experiment plans and scripts to estimate VRAM, GPU count, disk, and training hours, then presents three offers ranked by estimated total cost. - Full lifecycle management: Handles rent, environment setup (phased pip installs, code sync via rsync), result download, and instance destruction with cost reporting. - State tracking: Maintains vast-instances.json so other skills like /run-experiment and /monitor-experiment can connect to active instances. - Use Case: You need to fine-tune a 7B model for about 4 hours. The skill estimates ~16 GB VRAM, searches vast.ai offers, shows options like an RTX 4090 at ~$1.12 total, rents it, syncs your code, and destroys the instance when training finishes. ## Quick Start Ask the assistant to rent a GPU on vast.ai for your training task, for example: rent a vast.ai GPU to fine-tune my LLaMA-7B model for about four hours.

Frequently Asked Questions about vast-gpu

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I rent a GPU on vast.ai for model training?

Install the vastai CLI, set your API key, and upload your SSH public key at cloud.vast.ai/manage-keys. Then search offers with vastai search offers, create an instance with vastai create instance, and connect via the URL from vastai ssh-url.

How much VRAM do I need to fine-tune a 7B or 13B model?

A 7B model needs roughly 16 GB VRAM in fp16, a 13B model about 28 GB, and a 70B model around 140 GB requiring multiple GPUs. Add about 20 percent headroom for optimizer states and activations.

Why does vast.ai SSH fail with Permission denied publickey?

This happens when your SSH key was not uploaded to vast.ai before the instance was created, since keys are baked in at creation time. Destroy the instance, upload your key at cloud.vast.ai/manage-keys, and create a new instance.

Does the vastai CLI work with older Python versions?

No, the vastai CLI requires Python 3.10 or higher. If your system Python is older, create a virtual environment with conda, pyenv, or uv and install vastai there.

What happens to my data when I destroy a vast.ai instance?

Destruction is irreversible and all data on the instance is permanently deleted. Always download experiment results and logs via rsync or scp before running vastai destroy instance.