ab-test-setup

Design and execute A/B tests with hypothesis, sample sizing, and results interpretation.

Updated Feb 23, 2026
One-click install
npx skills add https://github.com/cristian473/ps-landing-2 --skill ab-test-setup-cristian473
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-setup
Source: https://github.com/cristian473/ps-landing-2/tree/main/.agents/skills/ab-test-setup
Command: npx skills add https://github.com/cristian473/ps-landing-2 --skill ab-test-setup-cristian473

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

A/B test planning and execution guidance helps teams design statistically sound experiments to validate product changes.

Core Features & Use Cases

  • Hypothesis framework: structure observations into testable predictions with clear success criteria.
  • Test types & sizing: guidance on A/B, A/B/n, MVT, sample size calculations, and duration considerations.
  • Metrics & governance: define primary/secondary/guardrail metrics and guardrails to protect results.
  • Documentation templates: templates and checklists for planning, running, and reporting experiments.
  • Real-world workflows: strategies for designing tests in web/product contexts and how to interpret results.

Quick Start

Draft a hypothesis for a real page, determine the primary metric and baseline, and configure a two-variant test to start.

Frequently Asked Questions about ab-test-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate sample size for an A/B test?

A/B test sample size calculation requires defining your baseline conversion rate, minimum detectable effect, and statistical significance thresholds. This Skill provides sample sizing templates that factor in test duration considerations to ensure robust experiment design.

What is the best way to structure a hypothesis for product experimentation?

Hypothesis formulation for product experimentation involves structuring observations into testable predictions with clear success criteria. This Skill provides a hypothesis framework that translates qualitative insights into structured, measurable predictions ready for A/B test validation.

Can I run multivariate tests using this A/B testing framework?

Yes, this A/B testing framework supports standard test types including A/B, A/B/n, and MVT (multivariate testing). It provides specific guidance on variant creation and test execution across web and product experiences for each supported experiment type.

How do I define guardrail metrics to protect my experiment results?

Guardrail metrics protect experiment results by monitoring critical business indicators for unexpected degradation during A/B test execution. This Skill helps you define primary, secondary, and guardrail metrics alongside governance checklists to maintain test integrity.

Does this Skill provide templates for documenting and reporting experiments?

Yes, this Skill provides documentation templates and best-practice checklists for planning, running, and reporting A/B tests. These templates cover the entire experiment workflow, ensuring consistent documentation across web and product experience tests.