experiment-design

Design methodologically rigorous experiments with pre-specified analysis plans.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/astoreyai/ai_scientist --skill experiment-design
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: experiment-design
Source: https://github.com/astoreyai/ai_scientist/tree/main/skills/experiment-design
Command: npx skills add https://github.com/astoreyai/ai_scientist --skill experiment-design

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill guides planning and designing methodologically sound experiments with clear controls and pre-registration.

Core Features & Use Cases

  • Study Design Types: RCTs, quasi-experimental, factorial, crossover.
  • Core Elements: Hypotheses, randomization, blinding, outcomes, analysis plan.
  • NIH Rigor: Alignment with reproducibility standards.

Quick Start

Outline an RCT with predefined primary outcome and randomization method.

Frequently Asked Questions about experiment-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design a randomized controlled trial with proper controls?

Randomized controlled trials require specifying your primary outcome, justifying sample size through power analysis, defining your randomization method, implementing blinding where feasible, and pre-registering your analysis plan. This Skill guides you through each element to meet NIH rigor standards and ensure internal validity.

What should I include in a pre-registration for my research study?

Pre-registration documents your research question, hypotheses, study design choice (RCT, quasi-experimental, or observational), randomization and blinding procedures, primary and secondary outcomes, and your analysis plan before data collection. This Skill helps you structure these elements to reduce bias and improve reproducibility.

How do I choose between RCT, quasi-experimental, and observational study designs?

Study design choice depends on your research question, feasibility of randomization, and control requirements. RCTs provide strongest causal evidence; quasi-experimental designs apply when randomization isn't possible; observational designs suit exploratory research. This Skill walks you through design options and trade-offs to select the best fit.

What's required for a rigorous power analysis in experiment planning?

Power analysis specifies your effect size, significance level, desired statistical power, and sample size needed to detect your hypothesized effect. This Skill helps you justify these parameters and document them in your study protocol to meet reproducibility standards.

Can I use this for grant proposals that require methodological rigor?

Yes. This Skill is designed for grant development, institutional review, and NIH-aligned submissions. It ensures your proposed study includes justified design choices, randomization strategy, blinding procedures, clearly defined outcomes, and pre-specified analysis—all required by funding agencies.

What role does blinding play in controlling bias?

Blinding (participant, researcher, or analyst) prevents knowledge of group assignment from influencing outcomes or analysis, reducing detection and performance bias. This Skill guides you in specifying which blinding layers are feasible and appropriate for your study design.