ab-testing

Calculate sample size for an A/B test by defining your primary metrics and estimating the required traffic to achieve statistical power and significance. This Skill designs test plans that estimate traffic requirements and test duration to avoid underpowered experiments.

Structure an experiment backlog for growth marketing by prioritizing ideas with ICE scoring and documenting results. This Skill helps build ongoing growth experimentation programs that turn winning tests into reusable growth patterns.

Design a multivariate test plan with statistical safeguards by defining clear hypotheses, variants, and traffic allocation. This Skill establishes a safe analysis process that accounts for multiple variants and sequential testing to avoid false positives.

Yes, you can evaluate conversion optimization experiments for a pricing page by defining success criteria and comparing CTA treatments. This Skill generates test plans that include implementation guidance and decision criteria for conversion experiments.

Use A/B/n testing instead of a standard A/B test when you need to compare multiple variants simultaneously rather than just two. This Skill designs A/B/n tests with appropriate statistical planning to account for the increased complexity of multiple variants.

Conversion experiments show false positives when they lack proper statistical safeguards like adequate power and sequential testing adjustments. This Skill establishes a safe analysis process to prevent premature conclusions and false positives in growth experimentation.