model-building

Build and validate sports prediction models with walk-forward validation and held-out evaluation.

1|Updated May 5, 2026
One-click install
npx skills add https://github.com/sports-data-hq/hockey-skills --skill model-building-sports-data-hq
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: model-building
Source: https://github.com/sports-data-hq/hockey-skills/tree/main/skills/model-building
Command: npx skills add https://github.com/sports-data-hq/hockey-skills --skill model-building-sports-data-hq

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you build sports outcome prediction models that are evaluated honestly, so you can avoid misleading training scores and future-data leakage.

Core Features & Use Cases

  • Starts with logistic regression and moves to random forest, XGBoost, or a hard-vote ensemble only when walk-forward gains justify the added complexity.
  • Enforces temporal validation, inner-fold hyperparameter tuning, and overfitting checks so season-by-season performance is trustworthy.
  • Supports feature importance review, model versioning, and structured training reports for workflows like hockey game prediction, betting research, and probability modeling.

Quick Start

Ask the model to train a walk-forward sports prediction model from your prepared features and report only held-out test accuracy, log loss, feature importance, and overfitting gaps.

Frequently Asked Questions about model-building

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I train a sports prediction model using walk-forward validation?▼

Walk-forward validation trains sports prediction models by sequentially expanding the training window season-by-season, ensuring temporal integrity and preventing future-data leakage. This Skill enforces leakage-safe training folds and inner-fold hyperparameter tuning for honest held-out evaluation.

What's the best way to prevent data leakage when training sports analytics models?▼

Preventing data leakage in sports analytics models requires strict temporal validation where training folds never include future information. This Skill enforces leakage-safe training folds, walk-forward validation, and inner-fold hyperparameter tuning to guarantee trustworthy season-by-season performance.

How do I compare logistic regression and XGBoost for game outcome prediction?▼

Comparing logistic regression and XGBoost for game outcome prediction involves starting with a baseline model and advancing only when walk-forward gains justify the complexity. This Skill evaluates both algorithms and a hard-vote ensemble, reporting accuracy, log loss, and Brier score.

Can I use ensemble methods for season-by-season hockey analytics classification?▼

Ensemble methods support season-by-season hockey analytics classification by combining predictions from logistic regression, random forest, and XGBoost. This Skill applies a hard-vote ensemble only when walk-forward validation demonstrates clear performance gains over simpler baseline models.

What metrics should I report to detect overfitting gaps in sports prediction models?▼

Detecting overfitting gaps in sports prediction models requires comparing training scores against honest held-out test accuracy, log loss, and Brier score. This Skill enforces overfitting checks and structured training reports to expose misleading training performance.