experiment-design

Generate experiments/<exp_id>/config.yaml from formalization.md and benchmarks.md.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/ZhangHanbo/alpha_research --skill experiment-design-zhanghanbo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: experiment-design
Source: https://github.com/ZhangHanbo/alpha_research/tree/main/skills/experiment-design
Command: npx skills add https://github.com/ZhangHanbo/alpha_research --skill experiment-design-zhanghanbo

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This module automates the creation of a complete experimental-design configuration from project documentation (formalization.md, benchmarks.md, current challenges, and intended approaches), eliminating manual drafting and ensuring alignment with doctrinal guidelines.

Core Features & Use Cases

  • Generate a full experiments/<exp_id>/config.yaml from inputs including formalization.md, benchmarks.md, and current state
  • Pre-register hypotheses and failure modes, and enumerate required baselines and venue trial counts
  • Validate mode alignment with project stage (diagnose/approach/validate) and preserve design provenance

Quick Start

Place formalization.md, benchmarks.md, and source.md in your project, then run the skill to generate experiments/<exp_id>/config.yaml.

Frequently Asked Questions about experiment-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate an experiment config.yaml from project documentation?

This skill automates experiment config generation by reading formalization.md, benchmarks.md, and source.md, then outputting a runnable experiments/<exp_id>/config.yaml without manual drafting.

What is pre-registration in experiment design and does this skill support it?

Pre-registration in experiment design involves defining hypotheses and failure modes before running trials. This skill pre-registers hypotheses, failure modes, baselines, and venue trial counts directly into the generated config.yaml.

Can I use this to generate experiment configs for reproduction and diagnostic modes?

Yes, you can generate experiment configs for reproduction, diagnostic, and approach modes. The skill validates mode alignment with your project stage and preserves design provenance during config generation.

Does the experiment config generator launch the experiment automatically?

No, the experiment config generator does not launch the experiment. It only generates the config.yaml file and enforces design checks against doctrine guidelines and review_plan requirements during generation.

What project files do I need to prepare before generating an experiment design?

You need to place formalization.md, benchmarks.md, and source.md in your project directory. These files provide the formalization, benchmark definitions, and current state required to generate the config.yaml.

How are design checks enforced during experiment config generation?

Design checks are enforced during experiment config generation by validating the design against doctrine section 8 and review_plan section 1.6. This ensures the generated config.yaml aligns with doctrinal guidelines.