ab-test-setup

Plan, design, and implement A/B tests with Python libraries.

1|Updated Mar 5, 2026
One-click install
npx skills add https://github.com/MCERQUA/jam-skills --skill ab-test-setup-mcerqua
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-setup
Source: https://github.com/MCERQUA/jam-skills/tree/main/marketing/ab-test-setup
Command: npx skills add https://github.com/MCERQUA/jam-skills --skill ab-test-setup-mcerqua

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pandas, numpy, scipy, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill helps to plan, design, and implement A/B tests, providing guidance on statistical rigor, hypothesis framing, and metrics selection.

Core Features & Use Cases

  • Hypothesis Framework: Offers a structured approach to formulating test hypotheses.
  • Test Types: Identifies A/B, A/B/n, MVT, and Split URL tests, along with their requirements.
  • Sample Size Calculator: Assists in determining the required sample size for a test.
  • Metrics Selection: Guides on choosing primary, secondary, and guardrail metrics.
  • Implementation: Provides guidelines for implementing tests using client-side or server-side methods.

Quick Start

Start an A/B test to compare two versions of a webpage element using the ab-test-setup skill.

Frequently Asked Questions about ab-test-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate the required sample size for an A/B test?

A/B test setup includes a sample size calculator that helps determine the required sample size for your test, ensuring your results reach statistical significance for reliable conversion optimization.

What is the best way to structure a hypothesis for conversion optimization?

For conversion optimization, you should use a structured hypothesis framework that defines the test hypothesis clearly, ensuring your A/B test design maintains statistical rigor and measures the right metrics.

How do I choose the right metrics for A/B, A/B/n, or MVT tests?

When designing A/B, A/B/n, MVT, or Split URL tests, select primary, secondary, and guardrail metrics to measure conversion optimization effectively while protecting against negative side effects.

Can I use Python and pandas for statistical analysis of A/B tests?

Yes, this A/B test setup uses Python libraries including pandas, numpy, and scipy to execute test scripts and perform the statistical analysis required for hypothesis testing.

What are the differences between client-side and server-side A/B test implementation?

A/B test implementation guidelines cover both client-side and server-side methods, helping you choose the right approach for your webpage elements based on your technical requirements and test types.