/exp-design

Convert an idea into a non-linear experiment suite with benchmarks and ablation loops.

Updated May 23, 2026
One-click install
npx skills add https://github.com/duany049/multi-skill-orchestration --skill exp-design
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: /exp-design
Source: https://github.com/duany049/multi-skill-orchestration/tree/main/.claude/skills/exp-design
Command: npx skills add https://github.com/duany049/multi-skill-orchestration --skill exp-design

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you turn an idea into a complete, rigorous experiment suite that can validate mechanisms rather than just report outcomes.

Core Features & Use Cases

  • Non-linear experiment design: generates method candidates, selects benchmarks/metrics, and runs an ablation loop that can trigger simplification and re-planning.
  • Full experiment suite planning: covers ablation, sensitivity analysis, main validation, optional generalization, and deep analysis of intermediate quantities.
  • Reproducible wiki artifacts: produces structured experiment pages, a master design report, and updates graph edges and idea linking for downstream execution.

Quick Start

Run the /exp-design skill with an idea slug to generate a staged experiment suite and design documents ready for execution.

Frequently Asked Questions about /exp-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design rigorous ablation experiments to validate a research idea?

Plan sensitivity analysis by executing an iterative ablation loop that triggers simplification and re-planning, quantifying success criteria across hyperparameter sweeps and multi-seed main runs to measure how variations affect your research outcomes.

What is mechanism-first experiment planning and when do I need it?

Mechanism-first experiment planning is an approach that validates hypotheses through deep analysis of intermediate quantities, needed when you must select standard benchmarks and quantify success criteria across ablation and generalization runs.

How to plan a complete research experiment suite with multi-seed validation?

Plan a complete research experiment suite by generating method candidates, selecting benchmarks and metrics, and running an ablation loop that covers sensitivity analysis, main validation, optional generalization, and multi-seed main runs.

Do I need a structured wiki project to plan ablation studies?

Yes, experiment design requires reading and writing to a structured wiki project, generating per-block experiment pages, rebuilding context, adding tested_by graph edges, and logging a master design report for downstream execution.

What's the best way to structure reproducible experiment design artifacts?

Structure reproducible artifacts by generating per-block experiment pages within a wiki project, updating graph edges and idea linking, and producing a master design report that prepares the full experiment suite for downstream execution.

Can I trigger experiment re-planning during an ablation study?

Yes, the ablation loop can trigger simplification and iterative re-planning of your experiment suite, allowing you to adjust method candidates and benchmark specifications based on sensitivity analysis and intermediate quantity results.