What problem does it solve?
A/B and paid-ad experiment planning often fails due to vague hypotheses, unclear metrics, and incorrect assumptions about sample size and test duration, leading to inconclusive results or wasted spend.
Core Features & Use Cases
- Hypothesis design framework: Convert the user’s idea into an IF/THEN hypothesis with an explicit expected metric movement and rationale.
- Statistical planning: Estimate required sample size per variant using confidence/power assumptions and an MDE-driven calculation.
- Duration estimation: Translate required sample size into an experiment timeline based on daily traffic and platform learning-phase guidance.
- Platform-specific setup guidance: Provide operational steps and best practices for Meta, Google, LinkedIn, and TikTok experiments.
Example use case: You want to test whether a new landing-page headline improves conversion rate, so you define the hypothesis, compute the sample size needed to detect a meaningful lift, estimate how long the test must run, and follow the correct experiment setup flow for your ad platform.
Quick Start
Use the ads-test skill to create an A/B test plan for your next Meta or Google experiment, including hypothesis, success metrics, sample size, and recommended duration.