ab-testing

Guide A/B and MVT experiment planning with hypothesis, sample size, and metrics.

Updated Jun 8, 2026
One-click install
npx skills add https://github.com/DevMatt6/marknet --skill ab-testing-devmatt6
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-testing
Source: https://github.com/DevMatt6/marknet/tree/main/.agents/skills/ab-testing
Command: npx skills add https://github.com/DevMatt6/marknet --skill ab-testing-devmatt6

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill aids in the design, planning, and implementation of A/B tests and growth experimentation programs, helping users make data-driven decisions and improve their testing processes.

Core Features & Use Cases

  • Test Design Guidance: Provides frameworks and templates for structuring tests.
  • Hypothesis Framework: Offers a structured way to formulate and document hypotheses.
  • Sample Size Calculation: Assists in determining the required sample size for valid results.
  • Metrics Selection: Helps in defining primary, secondary, and guardrail metrics.
  • Use Case: For a business looking to test a new call-to-action on a webpage to increase conversion rates.

Quick Start

Use the ab-testing skill to get advice on setting up an A/B test for a new feature.

Frequently Asked Questions about ab-testing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate the right sample size for an A/B test?

To calculate A/B test sample size, you must define your primary metric, expected effect size, and significance level. This Skill assists by structuring those inputs to determine the required sample size for valid statistical results.

What is the best way to structure hypotheses for growth experimentation?

Structuring hypotheses for growth experimentation requires documenting the expected impact and rationale before execution. This Skill provides a structured hypothesis framework to formulate and document your testing predictions systematically.

How do I select primary, secondary, and guardrail metrics for an A/B test?

Selecting metrics for an A/B test involves defining primary targets, secondary indicators, and guardrails to prevent negative side effects. This Skill helps define these distinct metric categories to drive data-informed decision making.

Can I run A/B/n tests and multivariate tests (MVT) using this framework?

Yes, this framework supports both A/B/n tests and multivariate tests (MVT). It guides the planning and execution of these statistical experiments, allowing you to test multiple variants simultaneously for data-informed decisions.

When do I need a structured framework for A/B test design?

A structured A/B test design framework is needed when you want to ensure statistical validity and drive data-informed decision making. This Skill provides templates for structuring tests to properly interpret results and improve your testing process.