exp-design

Generate claim-driven experimental plans with baseline, validation, ablation, and robustness blocks.

77|16|Updated May 9, 2026
One-click install
npx skills add https://github.com/Lambenthan/empiricalwiki --skill exp-design-lambenthan
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: exp-design
Source: https://github.com/Lambenthan/empiricalwiki/tree/main/.claude/skills/exp-design
Command: npx skills add https://github.com/Lambenthan/empiricalwiki --skill exp-design-lambenthan

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

EmpiricalWiki users often have a hypothesis or idea but still need a rigorous, end-to-end experimental plan that turns claims into an ordered set of baseline, validation, ablation, and robustness experiments.

Core Features & Use Cases

  • Claim scoping (Target / Decomposition / Threats): Converts an idea into a structured set of claims to verify, isolate, and potentially refute.
  • Four-phase experiment blocks: Creates baseline (reproduce), validation (prove target), ablation (isolate factors), and robustness (stress threats) blocks with explicit success criteria.
  • Wiki + graph writeback: Produces experiment pages under wiki/experiments and adds tested_by edges linking claims to experiments, plus rebuilds graph context artifacts.
  • Optional Review LLM: With --review, runs a reviewer pass to catch missing baselines, unfair comparisons, weak statistical rigor, and propose concrete fixes.

Quick Start

Run exp-design on a wiki idea slug to generate a full staged experiment plan and write the resulting experiment pages and claim edges into the wiki.

Frequently Asked Questions about exp-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert a research hypothesis into structured experiment blocks?

To convert a research hypothesis into structured experiment blocks, you map claims into baseline, validation, ablation, and robustness phases. This creates dependency-ordered execution steps with explicit success criteria and budgets.

What is claim-driven experiment design for robustness testing?

Claim-driven experiment design for robustness testing isolates and stresses potential threats to a hypothesis. It structures experiments to verify target claims, decompose variables, and refute invalid assumptions with reproducible steps.

How do I generate ablation studies from a wiki idea slug?

You can generate ablation studies from a wiki idea slug by running an automated experiment design pass. It reads the slug, scopes the target claims, and outputs isolation blocks that test individual factor contributions.

Can I catch missing baselines and weak statistical rigor before running experiments?

Yes, you can catch missing baselines and weak statistical rigor by running a reviewer pass. This review analyzes the experimental plan to identify unfair comparisons and propose concrete fixes before execution.

How do I add tested_by graph edges linking claims to experiments in a wiki?

To add tested_by graph edges linking claims to experiments, you write generated experiment pages under the wiki directory and rebuild graph context artifacts. This creates structural links connecting verified claims to their execution blocks.

What is the best way to organize baseline and validation experiments for reproducibility?

The best way to organize baseline and validation experiments for reproducibility is structuring them into ordered blocks with explicit success criteria. Baselines reproduce existing results while validation blocks prove the target hypothesis.