ab-test-setup

To calculate sample size for an A/B test, you need power analysis and predetermined sample sizes based on your primary metric. This Skill provides reference materials and templates to estimate required sample sizes and plan experiment duration accurately.

A valid A/B testing hypothesis frames a single-variable change with clear success criteria. This Skill guides hypothesis formulation and experimental design to ensure your marketing or product experiments isolate variables and define measurable outcomes.

Interpreting A/B test results requires analyzing statistical significance against predetermined guardrails. This Skill helps you evaluate outcomes using structured guidance, interpret metrics correctly, and document findings using provided templates for stakeholder communication.

Yes, this A/B testing framework supports experiments across both web pages and mobile apps. It covers marketing and product experimentation comprehensively, applying the same statistical rigor to variant design, metric selection, and result interpretation regardless of platform.

Enforcing one-variable changes in experiment design prevents confounding results and ensures clear attribution. This Skill mandates this best practice alongside predetermined sample sizes and significance guardrails to maintain the statistical validity of your A/B tests.