run-experiment

Launch and manage ML experiments across local, remote, Vast.ai, and Modal environments.

Updated Apr 29, 2026
One-click install
npx skills add https://github.com/jkfee/Auto-Research --skill run-experiment-jkfee
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: run-experiment
Source: https://github.com/jkfee/Auto-Research/tree/main/skills/run-experiment
Command: npx skills add https://github.com/jkfee/Auto-Research --skill run-experiment-jkfee

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Deploy and manage end-to-end ML experiments across local GPUs, remote servers, Vast.ai, or Modal with automatic setup, monitoring, and teardown.

Core Features & Use Cases

  • End-to-end experiment lifecycle: environment detection, pre-flight checks, code synchronization, deployment, monitoring, and result collection.
  • Multi-backend support: Local, remote SSH servers, Vast.ai instances, and Modal serverless GPUs.
  • Cost-aware run and cleanup: auto-destroy for Vast.ai and modal billing awareness.

Quick Start

Ask the skill to deploy and run your ML experiment across your chosen compute backends.

Frequently Asked Questions about run-experiment

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run ML experiments across local and cloud GPUs automatically?

To run ML experiments across local and cloud GPUs, this skill automates environment detection, pre-flight checks, code synchronization, deployment, monitoring, and teardown across diverse compute backends.

Does this skill support deploying machine-learning models to Vast.ai and Modal?

Yes, this skill supports deploying machine-learning models to Vast.ai and Modal. It provides multi-backend support for local workstations, remote SSH servers, Vast.ai rentals, and serverless Modal environments.

What is the best way to manage ML experiment lifecycle and cleanup on remote servers?

The best way to manage ML experiment lifecycle and cleanup on remote servers is using an automation tool that handles pre-flight checks, code synchronization, deployment, and cost-aware teardown to ensure repeatable runs.

Can I use Weights and Biases integration when running machine-learning experiments on remote GPUs?

Yes, you can use Weights and Biases integration when running machine-learning experiments on remote GPUs. The skill implements optional W&B integration during the deployment and monitoring phases.

How do I synchronize code and run pre-flight checks before launching a GPU experiment?

To synchronize code and run pre-flight checks before launching a GPU experiment, the skill automatically detects the target environment, validates prerequisites, and syncs your codebase before deployment.

Are there cost-aware features for auto-destroying Vast.ai instances after an experiment finishes?

Yes, there are cost-aware features for auto-destroying Vast.ai instances after an experiment finishes. The skill includes post-run cleanup with cost-aware handling and auto-destroy for Vast.ai rentals.