ab-test-setup

Plan, design, and implement A/B tests with hypothesis and metrics frameworks.

Updated Feb 27, 2026
One-click install
npx skills add https://github.com/luisgustavooliveira/skills --skill ab-test-setup-luisgustavooliveira
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-setup
Source: https://github.com/luisgustavooliveira/skills/tree/main/ab-test-setup
Command: npx skills add https://github.com/luisgustavooliveira/skills --skill ab-test-setup-luisgustavooliveira

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill unit assists with the planning, design, and implementation of A/B testing or growth experimentation programs, addressing the common challenges of hypothesis generation, test execution, and result analysis.

Core Features & Use Cases

  • Hypothesis Framework: Provides a structured approach to formulating test hypotheses and setting clear metrics for success.
  • Test Type Guide: Offers detailed explanations and sample scenarios for different types of A/B tests, including A/B, A/B/n, MVT, and Split URL.
  • Sample Size Calculator: Contains tables and a calculator to determine the necessary sample size based on baseline conversion rates and desired lift.
  • Metrics Selection Framework: Helps identify and define primary, secondary, and guardrail metrics for effective analysis.

Quick Start

Execute 'ab-test-setup' to begin the process of designing your A/B test, considering factors like hypothesis creation, test type selection, and metric setup.

Frequently Asked Questions about ab-test-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design an A/B test with proper statistical rigor?

Design A/B tests with statistical rigor by using a structured framework that guides hypothesis formulation, test type selection, and metric definition to ensure valid, reliable experimentation results.

What is the best way to calculate sample size for A/B testing?

Calculate A/B testing sample size by using a dedicated calculator and reference tables that determine required traffic volumes based on your baseline conversion rates and the minimum detectable lift desired.

How do I choose the right metrics for my experiment design?

Choose experiment metrics by applying a selection framework that identifies and defines primary success metrics, secondary performance indicators, and guardrail metrics to protect against unintended business impact.

When should I use multivariate testing instead of a standard A/B test?

Use multivariate testing instead of a standard A/B test when you need to evaluate multiple variables simultaneously, utilizing detailed test type guides and sample scenarios to determine the optimal experimentation approach.

How do I formulate a strong hypothesis for growth experimentation?

Formulate growth experimentation hypotheses by following a structured approach that sets clear success metrics and connects expected outcomes to specific variable changes, ensuring measurable and actionable test designs.