ab-test-plan

Generate structured A/B test plans for DTC funnels with statistical calculations.

13|5|Updated Mar 20, 2026
One-click install
npx skills add https://github.com/stefan-georgi/dtc-copywriting-skills --skill ab-test-plan-stefan-georgi
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-plan
Source: https://github.com/stefan-georgi/dtc-copywriting-skills/tree/main/skills/ab-test-plan
Command: npx skills add https://github.com/stefan-georgi/dtc-copywriting-skills --skill ab-test-plan-stefan-georgi

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It removes the guesswork and inconsistency in designing A/B experiments for direct‑response funnels by automatically generating a complete, data‑driven test plan that includes hypothesis, metrics, sample size, duration, and success criteria.

Core Features & Use Cases

  • Structured Test Blueprint: Generates hypothesis statements, control/variant definitions, and success metrics aligned with the RMBC methodology.
  • Statistical Rigor: Calculates sample size and test duration using baseline conversion rates, desired lift, confidence, and power.
  • Risk & Compliance: Adds risk assessments, telemetry prompts, and prerequisite checks to ensure safe execution.
  • Applicable Scenarios: Works for landing pages, order forms, upsells, emails, ads, and checkout experiences where a single variable needs testing.

Quick Start

Request an A/B test plan for a landing‑page headline change by providing the page type, current metric, hypothesis, traffic volume, and test element.

Frequently Asked Questions about ab-test-plan

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create an A/B test plan for my DTC funnel landing page?

To create an A/B test plan for a DTC funnel, provide the page type, current metric, hypothesis, traffic volume, and test element. The plan defines your hypothesis, metrics, sample size, duration, and success criteria using RMBC methodology.

How do I calculate sample size and test duration for conversion optimization?

Calculate sample size and test duration using baseline conversion rates, desired lift, confidence, and power. The A/B test plan applies statistical rigor to ensure your DTC funnel tests reach significance before analyzing results.

What elements can I test in direct-response funnels using a structured test blueprint?

You can test single variables across landing pages, order forms, upsells, emails, ads, and checkout steps. The structured blueprint generates control and variant definitions aligned with RMBC methodology for each direct-response element.

What inputs do I need to generate a data-driven A/B test plan?

You need page_type, current_metric, hypothesis, traffic_volume, and test_element. These inputs generate a complete A/B test plan with hypothesis statements, success metrics, sample size, duration, and risk assessments.

Does the A/B test plan include risk assessments and prerequisite checks for safe execution?

Yes, the A/B test plan includes risk assessments, telemetry prompts, and prerequisite checks. These additions ensure safe execution of your DTC funnel experiments by validating tracking and compliance before testing begins.

Why does my A/B test plan need a hypothesis statement and success criteria?

A hypothesis statement and success criteria remove guesswork from A/B experiments by defining what you are testing and how to measure it. The structured blueprint aligns these with RMBC methodology to ensure data-driven conversion optimization.