fyp-statistical-validator

Automate statistical validation and APA-formatted reporting for ML experiments.

Updated Nov 9, 2025
One-click install
npx skills add https://github.com/Ming-Kai-LC/fyp-project --skill fyp-statistical-validator
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: fyp-statistical-validator
Source: https://github.com/Ming-Kai-LC/fyp-project/tree/main/FYP_Code/.claude/skills/fyp-statistical-validator
Command: npx skills add https://github.com/Ming-Kai-LC/fyp-project --skill fyp-statistical-validator

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires numpy, scipy, scikit-learn, statsmodels, pandas, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Automates calculation of 95% confidence intervals, hypothesis testing (McNemar, paired t-test), and APA-formatted results tables for TAR UMT thesis chapters.

Core Features & Use Cases

  • Confidence interval calculations using multiple methods
  • Hypothesis testing suite (McNemar, paired t-test, Bonferroni)
  • APA-style result tables generator

Quick Start

Use the included scripts to generate a reproducibility section and format results.

Frequently Asked Questions about fyp-statistical-validator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate 95% confidence intervals for machine learning experiment results?

Confidence interval calculation automates computation of 95% CIs using multiple methods including normal approximation, bootstrap, and multi-seed approaches. This Skill provides ready-to-use Python APIs that compute intervals across model predictions and experimental runs, returning thesis-ready statistics without manual computation.

Can I run hypothesis tests like McNemar's and paired t-tests on ML model comparisons?

Hypothesis testing suite performs McNemar's test, paired t-test, and Bonferroni correction for multiple comparisons. The Skill automates test execution across model pairs and seeds, generating statistical significance results formatted for thesis chapters.

How do I generate APA-formatted tables for thesis statistical results?

APA table generation converts raw experiment statistics into publication-ready tables following APA style conventions. The Skill formats confidence intervals, test results, and sample sizes automatically, eliminating manual table construction for thesis submission.

What's the best way to document reproducibility across multiple model seeds?

Reproducibility documentation generates standardized statements capturing random seeds, model versions, and data splits used in experiments. The Skill creates thesis-ready reproducibility sections that satisfy TAR UMT standards across multiple experimental runs.

Does this work with scikit-learn and statsmodels for validation?

Yes. The Skill integrates with numpy, scipy, scikit-learn, statsmodels, and pandas to extract predictions and compute statistics. It accepts outputs from these libraries directly, automating validation workflows without data reformatting.

What statistics does this validate for thesis chapters?

Statistical validation covers 95% confidence intervals, hypothesis tests, Bonferroni correction, and APA table formatting per TAR UMT thesis standards. The Skill validates ML experiment results against these academic requirements end-to-end.