ab-test-setup

Generate A/B test plans from templates with sample-size guidance.

118|12|Updated May 5, 2026
One-click install
npx skills add https://github.com/alecs5am/ralphy --skill ab-test-setup-alecs5am
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ab-test-setup
Source: https://github.com/alecs5am/ralphy/tree/main/notes/skills/ab-test-setup
Command: npx skills add https://github.com/alecs5am/ralphy --skill ab-test-setup-alecs5am

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This section explains that it helps teams quickly assemble a structured AB-test plan by reusing templates and reference guides, reducing setup time and avoiding misalignment between stakeholders and experiments.

Core Features & Use Cases

  • Template-driven test planning: Generate a complete test plan from standard AB testing templates (Test Plan, Hypothesis, Design, Variants, Metrics).
  • Reference-guided sizing and design: Use sample-size guidance and planning references to scope experiments and guardrails.
  • Stakeholder-ready documentation: Produce ready-to-share documents for kickoff and reporting.

Quick Start

Run the AB-test-setup workflow to generate a complete test plan from the included templates and references.

Frequently Asked Questions about ab-test-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a complete A/B test plan with hypotheses and metrics?

Create an A/B test plan by applying standard templates to document test scope, hypotheses, design variants, and metrics. This generates a structured test plan document ready for stakeholder distribution and kickoff.

What's the best way to calculate sample size for web experiment design?

Calculate sample size for web experiment design by applying built-in sample-size guidance and planning references. This scopes experiments correctly and establishes guardrails to validate your test inputs before launch.

How do I document A/B testing variants and guardrails for stakeholders?

Document A/B testing variants and guardrails using template-driven planning references. This produces ready-to-share documentation covering hypotheses, design choices, and metrics to align stakeholders on experiment scope.

Can I use standard A/B test templates for common web experiments?

Yes, you can use standard A/B test templates for common web experiments. The workflow validates inputs and applies reference guides to plan test scope, ensuring the generated documentation fits standard web experiment structures.

What is included in a template-driven A/B test setup workflow?

A template-driven A/B test setup includes test plan, hypothesis, design, variants, and metrics templates. It applies sample-size guidance to scope experiments and outputs ready-to-distribute guidance for stakeholders.

Why do I need to validate inputs before generating an A/B test plan document?

Validating inputs before generating an A/B test plan ensures the experimental design and sample-size guidance are applied correctly. This prevents misalignment between stakeholders and avoids scoping errors in the final test plan document.