ab-testing

Design and analyze A/B and multivariate experiments with statistical validation.

2|Updated Jun 28, 2026
One-click install
npx skills add https://github.com/AureliusIvan/ai-geo-by-ivan --skill ab-testing-aureliusivan
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-testing
Source: https://github.com/AureliusIvan/ai-geo-by-ivan/tree/main/skills/ab-testing
Command: npx skills add https://github.com/AureliusIvan/ai-geo-by-ivan --skill ab-testing-aureliusivan

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This skill removes the guesswork from product and marketing optimization by providing a structured framework for designing experiments that yield statistically significant, actionable business insights.

Core Features & Use Cases

  • Hypothesis Framework: Guides you through creating strong, data-backed hypotheses using a proven structure.
  • Statistical Rigor: Provides sample size calculations and duration guidelines to prevent common pitfalls like peeking and false positives.
  • Growth Experimentation: Supports the creation of a continuous experimentation program, including ICE prioritization and playbook management.
  • Use Case: Use this when you need to determine if a new landing page headline will actually increase signups, or when you want to build a systematic backlog of growth experiments for your product.

Quick Start

Use the ab-testing skill to design a hypothesis and calculate the required sample size for a new pricing page experiment.

Frequently Asked Questions about ab-testing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate sample size for an A/B test to avoid false positives?

Calculate A/B test sample size using standard statistical confidence thresholds to prevent peeking and false positives. The skill provides sample size calculations and duration guidelines to ensure your conversion rate experiments yield statistically significant, actionable business insights.

What is a strong hypothesis framework for conversion rate optimization?

A strong hypothesis framework for conversion rate optimization uses a proven data-backed structure to guide experiment design. This approach removes guesswork from product and marketing optimization by ensuring your UI, copy, or feature changes are rigorously validated.

Can I use this for multivariate experiments on landing page headlines?

Yes, you can use this for multivariate experiments on landing page headlines and pricing pages. The skill facilitates the design and analysis of controlled A/B and multivariate experiments to optimize conversion rates and validate marketing copy changes.

What is the best way to prioritize a backlog of growth experiments?

The best way to prioritize growth experiments is using ICE prioritization framework management. The skill supports creating a continuous experimentation program, helping you build a systematic backlog of growth experiments for your product development workflow.

Why does peeking at A/B test results cause false positives?

Peeking at A/B test results causes false positives by violating standard statistical confidence thresholds before reaching the required sample size. The skill addresses this by providing duration guidelines and rigorous result interpretation to prevent common statistical pitfalls.