experiment-bridge

Convert experiment plans into executable training code and deploy GPU runs.

Updated Apr 21, 2026
One-click install
npx skills add https://github.com/Shallow-W/llm-wiki --skill experiment-bridge-shallow-w
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: experiment-bridge
Source: https://github.com/Shallow-W/llm-wiki/tree/main/.claude/skills/experiment-bridge
Command: npx skills add https://github.com/Shallow-W/llm-wiki --skill experiment-bridge-shallow-w

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It converts an experiment roadmap into runnable code, safely reviews it, deploys it to GPU infrastructure, and produces initial measurable results so you can move into automated review loops.

Core Features & Use Cases

  • Plan-to-Implementation: Parses refine-logs/EXPERIMENT_PLAN.md (and method context from FINAL_PROPOSAL.md) to determine run order, metrics, datasets, and required hyperparameters.
  • Code-Review Guardrails: Optionally performs cross-model code review before deployment to reduce logic and evaluation-ground-truth mistakes.
  • Sanity-First Execution: Optionally runs a small sanity-stage experiment first, then auto-debug retries if it fails.
  • GPU Deployment & Result Collection: Deploys experiments in parallel (or via an orchestrated queue) and updates tracker logs with initial outcomes for downstream iteration.

Quick Start

Use the experiment-bridge skill to implement and deploy the experiments described in refine-logs/EXPERIMENT_PLAN.md.

Frequently Asked Questions about experiment-bridge

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate experiment planning from markdown to GPU deployment?

Automating experiment planning from markdown to GPU deployment requires parsing EXPERIMENT_PLAN.md to generate executable training code, optionally reviewing it, and queueing GPU runs. This Skill bridges that gap by converting milestones and hyperparameters into deployed runs with initial metrics.

Can I run a sanity check before the main training runs?

Yes, you can run a sanity check before main training runs. This Skill optionally executes a small sanity-stage experiment first and auto-debugs retries if it fails, ensuring baseline logic and evaluation ground-truth are validated before committing to full GPU deployment.

Does workflow automation support parallel GPU deployment for ablation studies?

Workflow automation supports parallel GPU deployment for ablation studies. Experiments defined in the plan are deployed in parallel or via an orchestrated queue, updating tracker logs with parseable JSON/CSV outputs for iterative review across multiple runs.

How do I collect evaluation metrics for research iteration automatically?

To collect evaluation metrics for research iteration automatically, the Skill deploys runs to GPU infrastructure and parses initial outcomes into JSON/CSV formats. It updates the experiment tracker with these metrics for downstream automated review loops.

Do I need FINAL_PROPOSAL.md to use the experiment bridge workflow?

You need FINAL_PROPOSAL.md to use the experiment bridge workflow. The Skill reads FINAL_PROPOSAL.md for method context and EXPERIMENT_PLAN.md to determine run order, datasets, and required hyperparameters before implementing and deploying training code.

What's the best way to prevent logic mistakes in automated training runs?

The best way to prevent logic mistakes in automated training runs is applying cross-model code review guardrails before deployment. This Skill optionally performs a code-review step to reduce evaluation-ground-truth and logic errors prior to executing GPU runs.