ab-test-setup

Plan statistically valid A/B tests with sample size calculations and templates.

31|8|Updated Mar 15, 2026
One-click install
npx skills add https://github.com/citedy/adclaw --skill ab-test-setup-citedy
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-setup
Source: https://github.com/citedy/adclaw/tree/main/src/adclaw/agents/skills/marketing-ab-test-setup
Command: npx skills add https://github.com/citedy/adclaw --skill ab-test-setup-citedy

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

A/B test planning and setup for marketing and product experiments, turning ambiguous ideas into measurable, action-driven tests with statistically valid results.

Core Features & Use Cases

  • Hypothesis-driven test design for landing pages, pricing pages, onboarding flows, and messaging changes.
  • Guidance on sample size, test types (A/B, A/B/n, MVT, split URL), traffic allocation, metrics, and guardrails.
  • Templates and references for planning, documentation, and analysis, including sample-size guides and result templates.

Quick Start

Plan and document a basic A/B test for a marketing page using the included templates and references.

Frequently Asked Questions about ab-test-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate sample size for an A/B test on a landing page?

To calculate sample size for A/B testing a landing page, you must define your baseline conversion rate, minimum detectable effect, significance level, and statistical power to ensure valid experiment results.

What is the best way to design a hypothesis-driven marketing experiment?

Designing a hypothesis-driven marketing experiment involves turning ambiguous ideas into measurable tests by defining traffic allocation, selecting appropriate metrics, and setting guardrails to measure impact accurately.

Can I use A/B testing for pricing pages and onboarding flows?

Yes, A/B testing is applicable to pricing pages and onboarding flows. You can design statistically valid experiments to measure the impact of messaging changes and UI updates on user behavior.

How do I choose between A/B, A/B/n, MVT, and split URL test types?

Choosing between A/B, A/B/n, MVT, and split URL testing depends on your experiment scope. A/B/n tests multiple variations, MVT evaluates multiple elements simultaneously, and split URL tests entirely different page designs.

Why does my marketing experiment lack statistical significance?

Your marketing experiment may lack statistical significance if the sample size is too small for the minimum detectable effect, or if traffic allocation and test duration fail to reach the required statistical power.