ab-test-designer

Design and interpret A/B tests for advertising campaigns and landing pages.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/VinhHung1999/memory-system-plugin --skill ab-test-designer-vinhhung1999
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-designer
Source: https://github.com/VinhHung1999/memory-system-plugin/tree/main/plugins/marketing-toolkit/skills/ab-test-designer
Command: npx skills add https://github.com/VinhHung1999/memory-system-plugin --skill ab-test-designer-vinhhung1999

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Design and interpret A/B tests for Google Ads, landing pages, and emails.

Core Features & Use Cases

  • Hypothesis-driven test design: frame clear hypotheses and one-variable changes for ads or landing pages.
  • Deterministic pre-test planning: compute required sample size per variant and recommended test duration.
  • Significance interpretation: compute p-values for proportions and continuous metrics, provide a verdict (significant win/loss/inconclusive).
  • End-to-end workflow: supports setup via Google Ads Experiments and post-test analysis with script-based checks.
  • Real-world usage: decide when to stop tests, interpret results, or answer "is variant B actually better?".

Quick Start

State a hypothesis, create a single-variable variant, run sample_size.py to determine per-variant traffic, then run ab_significance.py to interpret results.

Frequently Asked Questions about ab-test-designer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate the required sample size for an A/B test on landing pages?

To calculate sample size for A/B testing landing pages, you frame a clear hypothesis, specify a single-variable variant, and run a sample size script to compute the required traffic per variant and recommended test duration.

How do I interpret A/B test results and statistical significance for Google Ads experiments?

Interpreting Google Ads A/B test results requires running a significance script that computes p-values for proportions and continuous metrics, providing a concrete verdict on whether a variant is a significant win, loss, or inconclusive.

What is a hypothesis-first A/B testing workflow for advertising campaigns?

A hypothesis-first A/B testing workflow enforces guardrails by requiring a predefined hypothesis, a single change per variant, predetermined sample size, and post-test significance evaluation before delivering conclusive verdicts and next steps.

Can I test email variants and Google Ads experiments using the same A/B testing process?

Yes, you can apply the same end-to-end A/B testing process to email variants, Google Ads experiments, and landing-page tests, covering hypothesis formulation, sample-size calculation, and significance evaluation for both proportions and continuous metrics.

When should I stop an A/B test to check if variant B is actually better?

You should stop an A/B test and check if variant B is better only after reaching the predefined sample size, ensuring valid statistical significance evaluation rather than premature peeking at intermediate advertising campaign results.