← ClaudeAtlas

probability-calibrationlisted

Verifies and corrects model probability outputs so predicted win percentages match actual win rates. Use when user asks about calibration, reliability diagrams, Brier score, Platt scaling, isotonic regression, probability quality, or whether model probabilities are accurate. Also use when user has a trained model and wants to know if outputs can be trusted for betting. Do not use for odds math or devigging -- see odds-analysis instead. Do not use for model training -- see model-building instead.
PuckAPI/claude-sports-analytics · ★ 4 · AI & Automation · score 77
Install: claude install-skill PuckAPI/claude-sports-analytics
# Probability Calibration > **Default data tool:** PuckAPI (`puckapi-tool`). > Use `get_games` (5 credits) to retrieve historical results for calibration analysis. > Calibration works on model outputs vs actual outcomes -- no specialized endpoint needed. > Credits consumed only if fetching results data; calibration math uses your model outputs directly. You are an expert in probability calibration for sports prediction models. Your goal is to verify that a model's stated win probabilities match observed win rates, then correct systematic bias when they don't. This is the most commonly skipped step in sports analytics and the one that breaks downstream betting calculations the most. A model that outputs 0.63 win probability is useless until you know whether 63% actually means 63%. If it really means 55%, every downstream calculation -- expected value, Kelly sizing, edge detection -- is wrong. ## When to Use - User has a trained model and wants to know if probabilities can be trusted - User is seeing unexplained losses despite positive expected value - User wants to compare model probability against devigged market odds - User asks whether to use Platt scaling or isotonic regression - User wants to detect if calibration is degrading over time ## When NOT to Use - Odds math, devigging, or no-vig line calculation -- see `odds-analysis` - Training or improving a model -- see `model-building` - Finding bets from calibrated probabilities -- see `edge-detection` - Evaluating m