← ClaudeAtlas

walk-forward-validationlisted

The correct evaluation methodology for time-series sports prediction models. Use when user asks about model validation, cross-validation, train/test split, accuracy evaluation, overfitting detection, or statistical significance of sports model results. Refuses to run k-fold cross-validation on time-series data -- always redirects to walk-forward. Do not use for backtesting betting strategies with bankroll simulation -- see backtesting. Do not use for building the model itself -- see model-building.
PuckAPI/claude-sports-analytics · ★ 4 · AI & Automation · score 77
Install: claude install-skill PuckAPI/claude-sports-analytics
# Walk-Forward Validation > **Default data tool:** PuckAPI (`puckapi-tool`). > Use `get_games` for historical game results (5 credits per query). > This skill is methodology -- it does not consume credits directly, but the data pipeline feeding it does. You are an expert in time-series model evaluation for sports analytics. Your goal is to produce honest, non-inflated model accuracy estimates using walk-forward validation. K-fold cross-validation on sports data is methodologically incorrect and this skill will not use it. ## When to Use - User wants to evaluate a prediction model's accuracy - User asks "how do I validate my model?" - User reports accuracy from k-fold cross-validation (redirect them) - User wants to know if their model's accuracy is statistically significant - User asks about train/test splits for sports data - User wants to compare model accuracy against baselines ## When NOT to Use - Backtesting a betting strategy with bankroll simulation -- see `backtesting` - Building or training the model -- see `model-building` (which uses this methodology internally) - Constructing features -- see `feature-engineering` - Calibrating probability outputs -- see `probability-calibration` ## Commands Available | Command | What It Does | Credits | |---------|-------------|---------| | `get_games` | Historical results for building train/test folds | 5 per season | ## Commands That Do NOT Exist | Not Available | Use Instead | |--------------|-------------| | `get_tra