ab-test-setup

Design and document A/B testing plans for website experiments.

Updated Feb 7, 2026
One-click install
npx skills add https://github.com/mk-162/162-Demo-Handbook --skill ab-test-setup-mk-162
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-setup
Source: https://github.com/mk-162/162-Demo-Handbook/tree/main/OLD-%20docs/skills/ab-test-setup
Command: npx skills add https://github.com/mk-162/162-Demo-Handbook --skill ab-test-setup-mk-162

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps product, marketing, and analytics teams plan and document A/B testing experiments to scientifically improve website performance.

Core Features & Use Cases

  • Define metric, control, and variant for a test to ensure clear evaluation criteria.
  • Create a structured experiment plan including timing, sample size guidance, and success criteria.
  • Use cases include testing homepage variants, product detail pages, or checkout flow optimizations.

Quick Start

Draft an A/B test plan for a homepage hero image experiment.

Frequently Asked Questions about ab-test-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design an A/B test plan for website optimization?

To design an A/B test plan for website optimization, you define the page type, hypothesis, primary and secondary metrics, duration, and control and variant definitions. This produces a structured experiment plan with clear success criteria.

What metrics do I need to define for a conversion rate experiment?

For a conversion rate experiment, you must define primary and secondary metrics alongside control and variant definitions. These metrics establish clear evaluation criteria to scientifically measure website performance improvements.

Can I use this approach to test checkout flow optimizations?

Yes, you can use this approach to test checkout flow optimizations, homepage variants, and product detail pages. It applies to product, marketing, and analytics teams conducting website experiments across these key areas.

What is the best way to structure an A/B testing hypothesis for a homepage?

The best way to structure an A/B testing hypothesis for a homepage is to pair it with clearly defined page types, metrics, and variant definitions. Documenting these inputs together ensures a repeatable plan for your experiment.

How long should an A/B test run to get valid conversion rate results?

To get valid conversion rate results, an A/B test must run for a clearly defined duration with appropriate sample size guidance. Specifying timing and sample parameters in your experiment plan ensures scientifically reliable performance measurements.