skills.rest
KentoShimizu
KentoShimizuCOMMUNITY
Explore all skills by this author →
𝕏@KStartup_GitHub

ab-testing

Plan and govern AB experiments with pre-registered metrics and validation scripts.

7|Updated Feb 14, 2026
Search Tags:#templates#compliance#governance#experimentation#ab-testing#decision-records
One-click install
npx skills add https://github.com/KentoShimizu/sw-agent-skills --skill ab-testing-kentoshimizu
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ab-testing
Source: https://github.com/KentoShimizu/sw-agent-skills/tree/main/skills/ab-testing
Command: npx skills add https://github.com/KentoShimizu/sw-agent-skills --skill ab-testing-kentoshimizu

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

AB testing governance unifies planning, execution, and decision recording so teams can run experiments with auditable criteria and pre-registered thresholds.

Core Features & Use Cases

  • Predefined templates for experiment plans and decision records.
  • Centralized references and governance contracts to ensure compliance across teams.
  • Reusable artifacts for project-wide and surface-level experiments.

Quick Start

Create an AB test plan using the templates in assets and validate with the provided script to ensure governance compliance.

Frequently Asked Questions about ab-testing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
What is AB testing governance and why do I need pre-registered decision metrics?▼

AB testing governance unifies experiment planning, execution, and decision recording using pre-registered thresholds and auditable criteria. It ensures teams maintain compliance and prevent data manipulation across project-wide experiments.

How do I create an experiment plan and validate it for governance compliance?▼

Create an AB test plan using predefined templates in the assets directory, then run the included validation script to verify your experiment plans and decision records comply with established governance contracts.

Can I use these AB testing templates for surface-level experiments or only project-wide tests?▼

Yes, you can use these reusable artifacts for both project-wide and surface-level experiments. The centralized references and governance contracts ensure compliance and clarity regardless of the experiment's scale.

What are guardrails in AB experimentation and how do they protect test integrity?▼

Guardrails in AB experimentation are pre-registered safety metrics monitored during tests to prevent negative impacts. They protect test integrity by establishing explicit approval flows and auditable thresholds before execution begins.

Does AB testing governance require any specific dependencies or environment setup?▼

No external dependencies are required. This AB testing governance setup relies entirely on internal components including predefined templates, centralized references, and a validation script to ensure compliance with governance contracts.

Related Skills

Explore More Data & Analytics Skills→
samjhechtsamjhecht
4

initialize-governance

Generate Constitution, Roadmap, and process documentation templates for project governance.

Community
Advanced
indranilbanerjeeindranilbanerjee
726

cro

Identify conversion bottlenecks and generate end-to-end CRO plans.

Community
Advanced
proffesor-for-testingproffesor-for-testing
436

test-reporting-analytics

Generate and index test reporting analytics for QE metrics in CI/CD pipelines.

Community
Advanced
LiuHarry1LiuHarry1
4

create-subagent

Create specialized subagents with YAML frontmatter name and description for isolated AI tasks.

Community
Advanced