experimentation

Design and run data-driven experiments with pre-registration and decision rules.

Updated May 11, 2026
One-click install
npx skills add https://github.com/resultakak/argos --skill experimentation-resultakak
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: experimentation
Source: https://github.com/resultakak/argos/tree/main/skills/experimentation
Command: npx skills add https://github.com/resultakak/argos --skill experimentation-resultakak

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Hypothesis-driven experimentation for product decisions; provides a structured workflow to design, run, and learn from experiments with guardrails and documentation.

Core Features & Use Cases

  • Hypothesis design, sample size and power calculations, and pre-registration before starting an experiment.
  • Ramp planning with explicit decision rules and failure handling (abort/kill) to reduce risk.
  • SRM checks, analysis plan, and a clean post-experiment cleanup to address tech debt and learnings.
  • Flag lifecycle guidance and documentation templates to ensure reproducibility across teams.

Quick Start

Create a new docs/experiments/2026-05-<your-id>.md with your hypothesis and pre-registration, and add a corresponding .flags/<your-id>.yaml manifest to begin a ramp experiment.

Frequently Asked Questions about experimentation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design and run A/B tests with proper pre-registration and guardrails?

To design and run A/B tests with pre-registration and guardrails, you create a hypothesis document, perform power calculations, and define explicit ramp planning and abort rules before launching the experiment.

What is SRM check in experimentation and when do I need it?

An SRM check in experimentation detects sample ratio mismatch by comparing observed allocation against expected proportions. You need it during analysis to validate that feature flag ramping did not skew your experiment data.

How do I calculate sample size and power for feature flag experiments?

Calculate sample size and power for feature flag experiments by defining your hypothesis and expected effect size upfront. This Skill enforces pre-registration of these calculations to ensure measurable, valid product decisions.

What is the best way to manage feature flag lifecycle and cleanup after an experiment?

The best way to manage feature flag lifecycle and cleanup is using a structured post-experiment process. This Skill provides documentation templates and cleanup workflows to address tech debt and record learnings.

Can I use this workflow for hypothesis-driven product decisions without external dependencies?

Yes, you can use this workflow for hypothesis-driven product decisions without external dependencies. It operates independently using markdown documentation and YAML manifests to enforce reproducibility and clear ownership.

Why do my experiment results lack reproducibility across teams?

Experiment results often lack reproducibility across teams due to missing pre-registration and documentation. This Skill enforces a repeatable workflow with explicit decision rules and flag manifests to ensure consistent learnings.