ab-test-setup

Plan and execute statistically valid A/B and growth experiments.

Updated Apr 11, 2026
One-click install
npx skills add https://github.com/Victaaaw/Ledga --skill ab-test-setup-victaaaw
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-setup
Source: https://github.com/Victaaaw/Ledga/tree/main/.agents/skills/ab-test-setup
Command: npx skills add https://github.com/Victaaaw/Ledga --skill ab-test-setup-victaaaw

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Plan and execute statistically valid A/B and growth experiments to help teams decide between alternative approaches and build a systematic experimentation program.

Core Features & Use Cases

  • Hypothesis-driven testing: Define clear observations, changes, and expected outcomes to test.
  • Test types: Supports A/B, A/B/n, multivariate tests (MVT), and split URL experiments to optimize products and marketing experiments.
  • Planning, tracking, and documentation: Includes sample size calculation, metric selection (primary, secondary, guardrails), variant design, traffic allocation, result analysis, and playbook-style learnings.

Quick Start

Define your test hypothesis, estimate the required sample size, and set up a two-variant test following the hypothesis framework.

Frequently Asked Questions about ab-test-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate sample size for an A/B test with a clear hypothesis?

To calculate sample size for an A/B test, you must first define a clear hypothesis, expected outcomes, and primary metrics. This approach enforces predefined sample size calculation alongside variant design to ensure statistically valid experiment results.

What is the difference between A/B/n and multivariate tests for product optimization?

A/B/n tests compare multiple independent variants against a control, while multivariate tests (MVT) evaluate combinations of changes across elements. Both test types require clear hypothesis definition, traffic allocation, and guardrail metrics to ensure robust growth experimentation.

Can I use this experimentation framework for UX and marketing split URL tests?

Yes, this experimentation framework supports UX and marketing split URL tests. It is applicable to product, marketing, and UX testing scenarios, allowing you to define variants, allocate traffic, and analyze results across different testing environments.

How do I set up primary, secondary, and guardrail metrics for growth experiments?

Setting up metrics for growth experiments requires defining primary metrics for main outcomes, secondary metrics for additional insights, and guardrail metrics to prevent harm. This structured metric selection ensures rigorous analysis and prevents misleading experiment results.

When should I apply stopping rules during A/B test analysis?

Stopping rules should be applied during A/B test analysis once the experiment reaches the predefined sample size and statistical significance. Enforcing these rules prevents early stopping bias and ensures rigorous, playbook-style documentation of learnings.