aris-experiment-plan

Generates claim-driven experiment roadmaps with ablation matrices, run orders, and compute budgets for research papers.

1.1k|116|Updated Feb 26, 2026
One-click install
npx skills add https://github.com/OpenLAIR/dr-claw --skill aris-experiment-plan
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: aris-experiment-plan
Source: https://github.com/OpenLAIR/dr-claw/tree/main/skills/aris-experiment-plan
Command: npx skills add https://github.com/OpenLAIR/dr-claw --skill aris-experiment-plan

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Turning a refined research proposal into a concrete, paper-defensible experiment plan is hard: researchers often over-plan benchmarks, miss decisive ablations, or fail to justify LLM/VLM/Diffusion/RL components. This Skill converts a proposal into a structured claim-to-evidence roadmap with prioritized run orders.

Core Features & Use Cases

  • Claim Mapping: Freezes primary and supporting paper claims, defines anti-claims to rule out, and links each claim to minimum convincing evidence.
  • Experiment Block Design: Specifies datasets, baselines, metrics, success criteria, and failure interpretations for main-result, novelty-isolation, simplicity, and frontier-necessity blocks.
  • Execution Planning: Produces a milestone-based run order (sanity, baseline, main method, decision, polish) with compute budgets, decision gates, and risk mitigations, written to EXPERIMENT_PLAN.md and EXPERIMENT_TRACKER.md.
  • Use Case: After refining a method with aris-research-refine, ask for a detailed experiment plan to get a must-run vs nice-to-have ablation matrix and the first three runs to launch.

Quick Start

Ask the AI to create a detailed experiment plan with ablations, baselines, and a run order for your refined research proposal.

Frequently Asked Questions about aris-experiment-plan

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I turn a research proposal into an experiment plan?

Provide your refined proposal or method idea and the Skill freezes the paper claims, designs experiment blocks with datasets, baselines, and metrics, then outputs a run order with milestones. Results are written to refine-logs/EXPERIMENT_PLAN.md and a tracker file.

What makes a good ablation matrix for a research paper?

A good ablation matrix isolates the dominant contribution, defends simplicity against bloated variants, and justifies any frontier component like an LLM or diffusion module against the strongest simpler alternative. This Skill limits plans to a few strong baseline families rather than long padded lists.

Does this experiment planning skill work with LLM, VLM, or diffusion methods?

Yes, it explicitly supports proposals with LLM, VLM, Diffusion, or RL-based contributions by including a frontier necessity check block. If the proposal is intentionally non-frontier, that block is skipped instead of forced.

When should I use experiment planning versus research refinement?

Use research refinement first to stabilize the method and claims, then use experiment planning once the next question is what exact experiments to run and in what order. A combined pipeline skill exists if you want both in one request.

What are the limitations of an automated experiment plan?

The plan reuses constraints from your proposal and does not invent budgets or fabricate results; it plans evidence rather than claiming it. You still need to execute the runs and interpret outcomes, ideally with a run-execution and review-loop skill.