aris-experiment-bridge

Implements, reviews, and deploys machine learning experiments from an experiment plan to GPU compute.

1.1k|116|Updated Feb 26, 2026
One-click install
npx skills add https://github.com/OpenLAIR/dr-claw --skill aris-experiment-bridge
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: aris-experiment-bridge
Source: https://github.com/OpenLAIR/dr-claw/tree/main/skills/aris-experiment-bridge
Command: npx skills add https://github.com/OpenLAIR/dr-claw --skill aris-experiment-bridge

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Turning a written experiment plan into running GPU experiments requires writing training and evaluation code, verifying correctness, and managing deployment, which is slow and error-prone when done manually.

Core Features & Use Cases

  • Plan-Driven Implementation: Parses EXPERIMENT_PLAN.md and FINAL_PROPOSAL.md to generate training, evaluation, and data-loading scripts with fixed seeds and JSON/CSV result output.
  • Cross-Model Code Review: Sends experiment code to GPT-5.4 via Codex MCP for correctness review before deployment, catching logic bugs and ground-truth evaluation errors.
  • Sanity-First Deployment with Auto-Debug: Runs the smallest sanity experiment first, auto-diagnoses failures (OOM, CUDA errors, NaN divergence) across up to 3 attempts, then deploys the full suite in parallel.
  • Use Case: After finishing idea discovery, point the skill at refine-logs/EXPERIMENT_PLAN.md and it implements the code, deploys experiments to local, remote, vast.ai, or Modal GPUs, and produces an initial results summary ready for the auto-review loop.

Quick Start

Run /aris-experiment-bridge with the path to your EXPERIMENT_PLAN.md to implement and deploy the planned experiments on your available GPUs.

Frequently Asked Questions about aris-experiment-bridge

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I implement experiments from an experiment plan automatically?

Provide an EXPERIMENT_PLAN.md file and run the bridge workflow. It parses milestones, writes training and evaluation scripts with fixed seeds, reviews the code, runs a sanity experiment first, then deploys the full suite and collects results into JSON/CSV.

What inputs does the experiment bridge workflow require?

It expects refine-logs/EXPERIMENT_PLAN.md as the primary input, optionally supplemented by EXPERIMENT_TRACKER.md, FINAL_PROPOSAL.md, IDEA_CANDIDATES.md, or IDEA_REPORT.md. If none exist, it asks the user what experiments to implement.

Can I deploy experiments on vast.ai or Modal GPUs?

Yes, the compute guard supports local GPUs, remote SSH servers, vast.ai instances, and Modal. Vast.ai instances should be destroyed after experiments finish to avoid charges, while Modal scales to zero automatically.

What happens if the sanity experiment fails?

The workflow auto-debugs up to 3 attempts, classifying failures like OOM, ImportError, CUDA errors, or NaN divergence and applying fixes. It can optionally call Codex rescue for a second opinion before stopping with a full failure report.

Why does the skill review experiment code before deployment?

Code review via GPT-5.4 catches logic bugs before wasting GPU hours, including incorrect loss functions, wrong data splits, and the critical error of evaluating against another model's output instead of dataset ground truth. It can be disabled by setting CODE_REVIEW to false.