← ClaudeAtlas

dataset-sourcinglisted

Find and evaluate datasets for training or validating a model — checking license, quality, leakage risk, bias, and whether the dataset's actual distribution matches the real deployment domain. Use whenever a project needs training or validation data, and before treating any found dataset as ready to use as-is.
hemapriyan-rk/claude-rigor-skills · ★ 1 · AI & Automation · score 74
Install: claude install-skill hemapriyan-rk/claude-rigor-skills
# Dataset Sourcing A benchmark dataset that doesn't match the real deployment distribution will produce a model that looks great in evaluation and fails in the field — this is the single most common way ML projects quietly fail. This skill checks the match, not just the existence, of candidate datasets. ## Step 1 — Define the real deployment distribution first Before searching, state what real input actually looks like in production: sensor noise characteristics, real-world class balance, the actual environmental/population variation the deployed system will see. A dataset search with no stated acceptance criteria isn't a search, it's browsing. ## Step 2 — Search across the layers that matter - Domain-specific benchmark datasets for the exact task. - Adjacent-domain datasets that could transfer, when nothing matches exactly. - Where nothing fits well: what it would actually take to collect or synthesize a small, correctly-distributed set instead of forcing a mismatched public dataset to work. Naming this option explicitly matters even when it isn't chosen — it's the honest alternative to a bad-fit shortcut. ## Step 3 — License check, before anything else Commercial-use restrictions, attribution requirements, share-alike terms that could constrain what the resulting model is allowed to be used for. Flag immediately if a dataset that otherwise fits well has a license that blocks the intended use — this needs to surface before time is spent on it, not after. ## Step 4 —