ab-test-setup

Plan and design A/B tests with sample size and metric selection.

83|26|Updated Feb 11, 2026
One-click install
npx skills add https://github.com/manojbajaj95/claude-gtm-plugin --skill ab-test-setup-manojbajaj95
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-setup
Source: https://github.com/manojbajaj95/claude-gtm-plugin/tree/main/plugins/growth/skills/ab-test-setup
Command: npx skills add https://github.com/manojbajaj95/claude-gtm-plugin --skill ab-test-setup-manojbajaj95

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill helps you plan, design, and implement A/B tests or experiments to optimize user experiences and drive measurable improvements.

Core Features & Use Cases

  • Hypothesis Formulation: Guides you to create strong, data-driven hypotheses using a clear framework.
  • Test Design: Assists in selecting appropriate test types, determining sample sizes, and choosing key metrics.
  • Variant Creation: Provides best practices for designing variants that test meaningful changes.
  • Use Case: You want to test a new headline on your landing page to see if it increases sign-ups. This Skill will help you define your hypothesis, calculate the necessary sample size, and choose the primary metric for success.

Quick Start

Help me plan an A/B test to improve my landing page's conversion rate.

Frequently Asked Questions about ab-test-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design an A/B test for conversion rate optimization?

To design an A/B test for conversion rate optimization, you need to formulate a structured hypothesis, calculate the required sample size based on your baseline conversion rate, and select primary, secondary, and guardrail metrics to measure success.

What is the best way to calculate sample size for split testing?

The best way to calculate sample size for split testing is by defining your baseline conversion rate and the minimum detectable effect you want to observe, which determines the traffic allocation needed for statistical significance.

How do I formulate a strong hypothesis for growth marketing experiments?

Formulating a strong hypothesis for growth marketing experiments requires using a structured framework to ensure your predicted outcome is data-driven, testable, and directly tied to meaningful variant design changes.

When should I choose client-side vs server-side A/B testing implementation?

Choosing between client-side and server-side A/B testing implementation depends on your variant design requirements and technical stack, with server-side offering deeper control over user experiences and client-side being faster to deploy.

What metrics should I track during an experimentation campaign?

During an experimentation campaign, you should track primary metrics to measure your main objective, secondary metrics to observe adjacent impacts, and guardrail metrics to ensure you do not harm other areas of the user experience.