small-n-stats-guardrails

Validate small-sample study results with statistical guardrails and correction checks.

Updated Apr 18, 2026
One-click install
npx skills add https://github.com/Centaurioun/osteogenesis_imperfecta --skill small-n-stats-guardrails
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: small-n-stats-guardrails
Source: https://github.com/Centaurioun/osteogenesis_imperfecta/tree/main/.claude/skills/small-n-stats-guardrails
Command: npx skills add https://github.com/Centaurioun/osteogenesis_imperfecta --skill small-n-stats-guardrails

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps researchers apply rigorous small-sample statistical guardrails for N=34 studies to prevent overstated claims, ensure adherence to the prespecified statistical analysis plan (SAP), and document necessary caveats alongside reported p-values and effect sizes.

Core Features & Use Cases

  • Checklist Enforcement: Validates that test selection matches endpoint type, enforces Holm correction, and reports post-correction p-values.
  • Effect Size & Uncertainty: Requires reporting of effect sizes with bootstrap confidence intervals (≥2000 replicates) and runs leave-one-out sensitivity checks.
  • Suppression & Reporting Rules: Suppresses unsupported predictive or interaction claims, flags small subgroup analyses as exploratory, and inserts small-N caveats into manuscript language.
  • Use case: Run this guardrail before finalizing a manuscript results section to generate a checklist report detailing passed and failed checks with remediation guidance.

Quick Start

Run the small-n-stats-guardrails skill with your results, group sizes, p-values, and effect sizes to produce a checklist report and conditional approval status.

Frequently Asked Questions about small-n-stats-guardrails

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I prevent overclaiming statistical significance in small-sample studies?

To prevent overclaiming in small-sample studies, apply statistical guardrails that validate test selection, enforce Holm correction for multiple comparisons, and require effect sizes with bootstrap confidence intervals before finalizing manuscript results.

What statistical corrections are needed for small-n manuscript reporting?

Small-n manuscript reporting requires Holm correction for multiple p-values, bootstrap confidence intervals with at least 2000 replicates for effect sizes, and leave-one-out sensitivity checks to ensure claims are robust and compliant with the prespecified analysis plan.

How do I check if my study results meet SAP compliance before publication?

Check SAP compliance by validating that test choices match endpoint types, confirming post-correction p-values are reported, and verifying that predictive or interaction claims meet minimum sample thresholds before manuscript submission.

When should I suppress subgroup claims in small-sample datasets?

Suppress subgroup claims in small-sample datasets when analyses do not meet minimum sample thresholds, flag any small subgroup analyses as exploratory, and insert small-N caveats into the manuscript language to prevent overstated findings.

Can I use leave-one-out sensitivity analysis for N=34 oral-dental study results?

Yes, leave-one-out sensitivity analysis is applicable for N=34 oral-dental datasets and serves as a required guardrail to verify that reported effect sizes and p-values remain stable when individual observations are sequentially removed during manuscript review.

What are the limitations of small-sample statistical guardrails for effect size reporting?

Small-sample statistical guardrails cannot validate predictive claims lacking minimum sample thresholds, convert exploratory subgroup findings into confirmatory conclusions, or substitute for proper test selection when endpoint types are mismatched in the analysis plan.