skills.rest
igeligel
igeligelCOMMUNITY
Explore all skills by this author →
Website𝕏@kevinpeters_GitHub

ab-testing

Design A/B tests with hypothesis development, sample size calculation, and metrics definition.

44|86|Updated Nov 23, 2023
Search Tags:#a/b testing#ab testing#growth experimentation#experimentation program#hypothesis development
One-click install
npx skills add https://github.com/igeligel/workplacify --skill ab-testing-igeligel
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ab-testing
Source: https://github.com/igeligel/workplacify/tree/main/.agents/skills/ab-testing
Command: npx skills add https://github.com/igeligel/workplacify --skill ab-testing-igeligel

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides expert guidance for planning, designing, and implementing A/B tests and growth experimentation programs, helping users make data-driven decisions and optimize their products.

Core Features & Use Cases

  • A/B Test Setup: Guides users through setting up A/B tests, including hypothesis development, sample size calculation, and metrics selection.
  • Hypothesis Framework: Offers a structured approach to creating strong hypotheses for A/B tests.
  • Test Types: Explains different types of A/B tests (A/B, A/B/n, MVT, Split URL) and their respective traffic requirements.
  • Growth Experimentation Program: Provides a framework for running experiments as an ongoing growth engine, including hypothesis generation, prioritization, and analysis.
  • Documentation: Offers templates for documenting tests, results, and learnings.

Quick Start

Use the ab-testing skill to design an A/B test for your website by providing the hypothesis, target audience, and desired outcome.

Frequently Asked Questions about ab-testing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate sample size and define metrics for A/B testing?▼

To calculate sample size and define metrics for A/B testing, this skill guides you through selecting appropriate test metrics and performing sample size calculation based on your target audience and desired outcome.

What is the best way to structure a hypothesis for growth experimentation?▼

Structuring a hypothesis for growth experimentation requires a strong framework, which this skill provides to help you formulate clear hypotheses for A/B tests and prioritize them within an ongoing growth engine.

When do I need to use different types of A/B tests like MVT or Split URL?▼

You need different types of A/B tests like MVT or Split URL depending on your specific traffic requirements, and this skill explains each test type to help you select the right one for your experiments.

How do I set up a growth experimentation program for product optimization?▼

Setting up a growth experimentation program involves generating hypotheses, prioritizing tests, and analyzing results, which this skill provides as a comprehensive framework to drive data-driven product decisions.

Does A/B testing require prior knowledge of statistical significance principles?▼

A/B testing requires an understanding of statistical significance and experimentation principles, and this skill supplies expert guidance to help you apply these concepts correctly when analyzing test results.

Can I get templates for documenting A/B test results and learnings?▼

You can get templates for documenting A/B tests, results, and learnings directly through this skill, ensuring your growth experimentation program maintains consistent records of all test setups and outcomes.

Related Skills

Explore More Product & Management Skills→
TedTschoppTedTschopp

ab-test-setup

Define A/B test hypotheses, metrics, sample size, and decision criteria.

Community
Advanced
stratagastrataga

ab-test-setup

Design statistically valid A/B tests with sample-size calculations and result interpretation.

Community
Advanced
ryzamediaryzamedia
1

ab-testing

Design and evaluate statistically rigorous A/B and multivariate experiments.

Community
Advanced
GuitarAlchemistGuitarAlchemist

ix-bandit

Simulate multi-armed bandit algorithms with epsilon-greedy, UCB1, and Thompson sampling.

Official
Intermediate