model-building

Build and validate sports prediction models with walk-forward validation and held-out evaluation.

1|Updated May 5, 2026
One-click install
npx skills add https://github.com/sports-data-hq/hockey-skills --skill model-building-sports-data-hq
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: model-building
Source: https://github.com/sports-data-hq/hockey-skills/tree/main/skills/model-building
Command: npx skills add https://github.com/sports-data-hq/hockey-skills --skill model-building-sports-data-hq

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you build sports outcome prediction models that are evaluated honestly, so you can avoid misleading training scores and future-data leakage.

Core Features & Use Cases

  • Starts with logistic regression and moves to random forest, XGBoost, or a hard-vote ensemble only when walk-forward gains justify the added complexity.
  • Enforces temporal validation, inner-fold hyperparameter tuning, and overfitting checks so season-by-season performance is trustworthy.
  • Supports feature importance review, model versioning, and structured training reports for workflows like hockey game prediction, betting research, and probability modeling.

Quick Start

Ask the model to train a walk-forward sports prediction model from your prepared features and report only held-out test accuracy, log loss, feature importance, and overfitting gaps.

Frequently Asked Questions about model-building

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I train a sports prediction model using walk-forward validation?

Walk-forward validation trains sports prediction models by sequentially expanding the training window season-by-season, ensuring temporal integrity and preventing future-data leakage. This Skill enforces leakage-safe training folds and inner-fold hyperparameter tuning for honest held-out evaluation.

What's the best way to prevent data leakage when training sports analytics models?

Preventing data leakage in sports analytics models requires strict temporal validation where training folds never include future information. This Skill enforces leakage-safe training folds, walk-forward validation, and inner-fold hyperparameter tuning to guarantee trustworthy season-by-season performance.

How do I compare logistic regression and XGBoost for game outcome prediction?

Comparing logistic regression and XGBoost for game outcome prediction involves starting with a baseline model and advancing only when walk-forward gains justify the complexity. This Skill evaluates both algorithms and a hard-vote ensemble, reporting accuracy, log loss, and Brier score.

Can I use ensemble methods for season-by-season hockey analytics classification?

Ensemble methods support season-by-season hockey analytics classification by combining predictions from logistic regression, random forest, and XGBoost. This Skill applies a hard-vote ensemble only when walk-forward validation demonstrates clear performance gains over simpler baseline models.

What metrics should I report to detect overfitting gaps in sports prediction models?

Detecting overfitting gaps in sports prediction models requires comparing training scores against honest held-out test accuracy, log loss, and Brier score. This Skill enforces overfitting checks and structured training reports to expose misleading training performance.