One-click install
npx skills add https://github.com/PuckAPI/claude-sports-analytics --skill model-building-puckapi
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: model-building
Source: https://github.com/PuckAPI/claude-sports-analytics/tree/main/skills/model-building
Command: npx skills add https://github.com/PuckAPI/claude-sports-analytics --skill model-building-puckapi

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires scikit-learn, xgboost, and includes scripts (resource) components.

What problem does it solve?

This Skill helps sports analysts and data scientists develop and validate predictive models for game outcomes, ensuring honest accuracy assessments without data leakage.

Core Features & Use Cases

  • Predict Game Outcomes: Train classifiers like logistic regression or XGBoost to forecast match results based on historical data.
  • Model Selection and Tuning: Guide users in choosing algorithms, tuning hyperparameters using walk-forward methodology, and comparing performance.
  • Feature Importance and Pruning: Identify influential features and remove low-importance ones to improve model robustness and reduce overfitting.
  • Use Case: A user wants to build an NHL game prediction model that accurately estimates win probabilities over multiple seasons, avoiding overfitting, and providing interpretable insights.

Quick Start

Describe to the AI your dataset of game features and targets, specify if you prefer logistic regression or XGBoost, then initiate model training with hyperparameter tuning and walk-forward validation.

Frequently Asked Questions about model-building

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I train a sports prediction model without data leakage?

Walk-forward validation prevents data leakage in sports prediction models by sequentially tuning hyperparameters on past game data and testing on future matches. This approach ensures honest performance measurement and avoids overfitting when training classifiers like XGBoost or logistic regression.

How do I build an XGBoost classifier for predicting game outcomes?

Building an XGBoost classifier for game outcomes involves training on historical match data and tuning hyperparameters via walk-forward validation. This Skill guides the training process while pruning low-importance features to improve model robustness and provide interpretable win probability estimates.

What is walk-forward validation in machine learning model training?

Walk-forward validation in machine learning model training sequentially evaluates predictive models on chronological data splits. It tunes hyperparameters by training on past game records and testing on future outcomes, preventing data leakage and overfitting in sports prediction workflows.

How do I identify feature importance to reduce overfitting in classification models?

You identify feature importance to reduce overfitting by analyzing classifier insights from the trained model and pruning low-impact variables. This Skill provides feature importance metrics for classifiers like XGBoost, allowing you to remove noisy features and improve robustness in sports prediction.

Can I use scikit-learn for NHL game prediction model development?

Yes, you can use scikit-learn for NHL game prediction model development. This Skill supports training classifiers like logistic regression from scikit-learn on historical game data, tuning them with walk-forward validation to estimate win probabilities while avoiding overfitting across multiple seasons.

What's the best way to validate betting models before deployment?

The best way to validate betting models before deployment is using walk-forward validation to measure honest accuracy. This Skill tunes hyperparameters on chronological sports data, preventing data leakage and overfitting while providing feature importance insights for strategic decision-making.