srm-check

Official

Detect SRM and halt faulty analyses upfront.

Authorai-analyst-lab
Version1.0.0
Installs0

System Documentation

What problem does it solve?

SRM is a critical randomization integrity check — if the treatment/control split deviates significantly from the designed ratio, results cannot be trusted. This skill acts as a safety gate that blocks analysis when randomization is broken.

Core Features & Use Cases

  • Auto-fire on detection of experiment data and common assignment columns (e.g., variant, group, treatment, arm, experiment_group) to guard downstream analyses.
  • Executes a chi-squared goodness-of-fit test against the designed or default ratio to decide PASS, WARNING, or BLOCK.
  • Provides per-segment and temporal SRM diagnostics to identify when randomization integrity breaks.
  • Halts all downstream analysis when BLOCK is reported and offers actionable investigation directions.

Quick Start

Load your experiment data and let SRM Check automatically verify randomization before any outcome analysis.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: srm-check
Download link: https://github.com/ai-analyst-lab/ai-analyst-plus/archive/main.zip#srm-check

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.