ab-test-setup

To calculate sample size for an A/B test, you need to define your baseline conversion rate, minimum detectable effect, and statistical significance thresholds. This skill provides structured templates to determine the exact traffic allocation required for valid experimentation.

A/B/n tests compare multiple distinct variations against a control to identify a single winning approach, while multivariate tests evaluate interactions between multiple variables simultaneously. This skill guides you in selecting the appropriate test type based on your experimentation goals.

Structuring an A/B test hypothesis requires defining the expected change, the targeted metric, and the underlying rationale before execution. This skill enforces a hypothesis-driven workflow with planning templates to validate your growth ideas prior to testing.

Yes, you can interpret conversion rate results using this skill's structured analysis playbooks. It provides reference frameworks for evaluating statistical significance and documenting learnings from your A/B test outcomes to ensure data-driven decisions.

You should avoid multivariate tests when your traffic volume is insufficient to reach the required sample size across all variable combinations. This skill helps determine if a simpler A/B test is more appropriate for your current traffic allocation constraints.

The best way to document A/B testing experiments is using standardized planning and analysis templates that capture hypotheses, metrics, and outcomes. This skill includes comprehensive playbooks for recording experiment details and extracting actionable growth insights.