statistical-analysis

Plan and interpret statistical analyses for computer science experiments.

3|Updated Mar 11, 2026
One-click install
npx skills add https://github.com/JunMA98/Computer-science-claude-skills --skill statistical-analysis-junma98
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: statistical-analysis
Source: https://github.com/JunMA98/Computer-science-claude-skills/tree/main/skills/statistical-analysis
Command: npx skills add https://github.com/JunMA98/Computer-science-claude-skills --skill statistical-analysis-junma98

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires numpy, pandas, scipy, matplotlib, seaborn, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Plan and interpret statistical analyses for CS experiments, benchmarks, user studies, and offline evaluations, ensuring appropriate test selection, assumption checks, and clear reporting.

Core Features & Use Cases

  • Provides guidance for choosing parametric vs nonparametric tests based on design and data distribution.
  • Performs normality, variance, linearity, and outlier diagnostics; computes effect sizes and power analyses; and supports transparent CS research reporting.
  • Includes reference materials and executable utilities in scripts/ and references/ to accelerate reproducible analyses.

Quick Start

Run comprehensive_assumption_check on your dataset to obtain a full diagnostic summary.

Frequently Asked Questions about statistical-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I choose between parametric and nonparametric tests for CS benchmark results?

The skill determines appropriate hypothesis testing by applying normality, variance, and outlier diagnostics to your data distribution. It then recommends parametric or nonparametric tests based on the assumption check results.

What is the best way to report uncertainty when comparing models across different seeds?

The best way to report uncertainty is by computing effect sizes and confidence intervals across seeds. The skill provides structured reporting utilities to transparently document variance and statistical significance in CS experiments.

How do I perform a power analysis for an offline evaluation?

Use the Python utilities in scripts/ to compute power analyses for offline evaluations. The skill calculates required sample sizes and effect sizes to ensure your benchmarks and user studies have sufficient statistical power.

Can I use pandas DataFrames with SciPy for assumption checks in this skill?

Yes, the skill integrates pandas and SciPy to perform normality, variance, and outlier diagnostics. You can run comprehensive_assumption_check directly on your dataset to obtain a full diagnostic summary.

When should I not use parametric tests for ablation study analysis?

Avoid parametric tests when the skill's assumption checks indicate non-normal distributions or unequal variances. In these constraint cases, the skill applies nonparametric alternatives for accurate ablation analysis.