experiment-rigor

Design rigorous Limina research experiments with method-validity gates and decisive thresholds.

36|3|Updated Mar 8, 2026
One-click install
npx skills add https://github.com/theam/limina --skill experiment-rigor
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: experiment-rigor
Source: https://github.com/theam/limina/tree/main/skills/experiment-rigor
Command: npx skills add https://github.com/theam/limina --skill experiment-rigor

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

It prevents Limina’s research from producing ambiguous, non-decisive, or invalid conclusions by enforcing method validity, fair baselines, decisive thresholds, and careful interpretation of negative results.

Core Features & Use Cases

  • Decision-grade H/E/F design: Structures hypotheses, experiments, and findings around a specific adoption/rejection decision, with thresholds and guardrails.
  • Method-validity gating: Forces explicit checks that the experiment exposes the method’s real intended capability and that a negative result is not due to an invalid setup.
  • Comparative, controlled experiments: Requires named baselines, controlled variables, metrics (primary + guardrails), and a trial plan with stopping/budget rules.
  • Canonical evidence management: Keeps narrative in H/E/F while storing raw per-run metrics under kb/research/data/ for traceability across sessions.
  • Negative-result classification: Separates invalid tests, implementation failures, insufficient signal, trade-off failures, and true negatives before concluding REJECTED.

Quick Start

Use experiment-rigor to design or review a hypothesis or experiment by writing a one-sentence decision, specifying the method-valid setup, and setting confirm/reject/inconclusive rules with raw metrics stored under kb/research/data/.

Frequently Asked Questions about experiment-rigor

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design research experiments that produce decision-grade evidence?

To design research experiments with decision-grade evidence, structure hypotheses around a specific adoption or rejection decision, define method-valid setups, set confirm/reject/inconclusive thresholds, and store raw metrics under kb/research/data/ for traceability.

What is method-validity gating in hypothesis validation and why is it needed?

Method-validity gating in hypothesis validation forces explicit checks that an experiment exposes the method's real intended capability. It is needed to ensure a negative result reflects a true failure rather than an invalid experimental setup.

How do I set up controlled baseline comparisons for research evaluation metrics?

Controlled baseline comparisons for evaluation metrics require naming specific comparator baselines, controlling variables, defining primary metrics alongside guardrails, and establishing a trial plan with explicit stopping rules and budget constraints.

Why does my experiment validation produce inconclusive results and how should I classify them?

Experiment validation produces inconclusive results due to invalid tests, implementation failures, or insufficient signal. Classify these negative outcomes distinctly from true negatives and trade-off failures before concluding a hypothesis is rejected.

What is the best way to structure H to E to F workflows for research rigor?

The best way to structure H to E to F workflows for research rigor is keeping the narrative across hypotheses, experiments, and findings while enforcing explicit decision questions, method-validity gates, and structured metric storage to prevent ambiguous conclusions.

Can I use experiment-rigor to review an existing hypothesis and its stopping rules?

Yes, you can use experiment-rigor to review existing hypotheses by validating the decision question, checking baseline fairness, verifying method-validity gates, and confirming that stopping rules and confirm/reject criteria are decisive and properly defined.