What problem does it solve?
Renting cloud GPUs for ML experiments requires manually estimating VRAM needs, comparing offers, and managing instance lifecycles, which is error-prone and can waste money on forgotten running instances.
Core Features & Use Cases
- Task-Driven GPU Selection: Analyzes experiment plans and training scripts to estimate VRAM, GPU count, disk, and runtime, then presents three cost-optimized vast.ai offers with estimated total cost.
- Full Lifecycle Management: Handles renting, SSH setup, code syncing via rsync, dependency installation, result download, and instance destruction with cost reporting.
- State Tracking: Maintains a vast-instances.json file so other experiment-running skills can discover and connect to active instances.
- Use Case: A researcher fine-tuning a 7B model describes the task, picks from three priced GPU options, runs the experiment remotely, and has the instance auto-destroyed after results are downloaded.
Quick Start
Ask the assistant to rent a GPU on vast.ai for your training task, for example by saying rent a GPU to fine-tune LLaMA-7B for about two hours.