ab-test-setup

To calculate A/B test sample size, you need to define your hypothesis, expected effect size, and traffic allocation. This Skill provides a structured framework to compute the required sample sizes for rigorous growth experimentation.

The best way to frame a growth experiment hypothesis is within a structured framework that links the change to the expected outcome. This Skill guides you through selecting hypotheses and defining primary, secondary, and guardrail metrics.

You can run standard A/B tests, A/B/n tests, and multivariate tests (MVT). The Skill supports test type selection based on your specific conversion-focused page requirements and experimentation program needs.

To set up guardrail metrics for an A/B test, you identify key business indicators that should not degrade during experimentation. This Skill provides guidance on measuring primary, secondary, and guardrail metrics for rigorous analysis.

You need A/B testing on homepage, pricing, and signup pages when optimizing conversion-focused elements. This Skill applies a repeatable framework to plan, design, and implement statistically valid experiments for these specific page types.