ab-test-setup

Plan and execute A/B and multivariate experiments with sample size guidance.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/Prestonigo/Claude-Skills --skill ab-test-setup-prestonigo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-setup
Source: https://github.com/Prestonigo/Claude-Skills/tree/main/marketingskills-main/skills/ab-test-setup
Command: npx skills add https://github.com/Prestonigo/Claude-Skills --skill ab-test-setup-prestonigo

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Design and run statistically valid experiments to compare two approaches and learn which performs better, enabling data-driven decisions.

Core Features & Use Cases

  • Hypothesis-driven test planning and execution
  • Support for A/B, A/B/n, MVT, and split URL tests with sample size and duration guidance
  • Comprehensive metrics framework, variant design templates, and results documentation to build a reusable experimentation playbook

Quick Start

Define your hypothesis, collect baseline data, select a test type, implement a controlled experiment, and track primary and secondary metrics.

Frequently Asked Questions about ab-test-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate sample size and duration for an A/B test?

To calculate sample size and duration for an A/B test, you need baseline data and your primary metric. This skill provides sample size guidance based on varying traffic levels and contexts to ensure your experiment reaches statistical rigor.

What is the best way to plan a multivariate experiment?

The best way to plan a multivariate experiment is through hypothesis-driven test planning. This skill provides structured variant design templates and comprehensive metrics frameworks to help you execute MVTs and document results effectively.

How do I write a strong hypothesis for growth experiments?

Writing a strong hypothesis for growth experiments requires defining the change, the expected outcome, and the baseline data. This skill provides structured hypothesis templates to ensure your growth experiments are designed with statistical rigor.

Can I use this for both client-side and server-side testing?

Yes, you can use this for both client-side and server-side implementations. The skill supports A/B, A/B/n, MVT, and split URL tests, providing variant design and measurement governance across different product marketing and website optimization contexts.

Why do I need a metrics framework for website optimization split URL tests?

You need a metrics framework for split URL tests to accurately track primary and secondary metrics against baseline data. This structured approach ensures your website optimization results are statistically valid and can be documented into a reusable experimentation playbook.