What problem does it solve?
This Skill prevents misleading evaluation results in time-series sports prediction by replacing leakage-prone k-fold cross-validation with proper walk-forward validation. It helps you measure whether a model is actually predictive, stable across seasons, and better than simple baselines.
Core Features & Use Cases
- Walk-Forward Evaluation: Builds expanding-window or sliding-window season splits that respect game order.
- Leakage Prevention: Enforces temporal discipline so rolling stats, standings, and other features are computed without peeking ahead.
- Model Comparison: Measures accuracy, log loss, and Brier score against home-win, market, and prior-season baselines.
- Statistical Significance: Checks whether observed performance is real or just noise before you trust the model.
- Use Case: A hockey analyst can validate an NHL prediction model across multiple seasons and confirm whether it beats the betting market.
Quick Start
Use the walk-forward-validation skill to evaluate my sports prediction model with season-based folds, baseline comparisons, and statistical significance testing.