← ClaudeAtlas

confound-checklisted

Stress-test causal claims for confounds before anyone believes them. Use when an analysis concludes that one thing caused, drove, lifted, hurt, or explained another; when reviewing A/B test results, observational analyses, backtests, or metric-movement postmortems; when designing a study, experiment, or backtest so controls get decided upfront instead of defended afterward; and whenever causal language ("drove", "because of", "the impact of", "X% lift from", "attributable to") appears over data that was not randomized. Also use to audit queries, notebooks, and pipelines for structural bugs that manufacture confounds — lookahead bias, survivorship, mix shift, post-treatment controls.
0xNagato/confound-check · ★ 0 · Data & Documents · score 70
Install: claude install-skill 0xNagato/confound-check
# Confound Check ## The rule A confound is any explanation, other than the claimed cause, that produces the same observed pattern. Two consequences drive everything below: 1. **Naming a confound is worthless without the observation that would distinguish it.** Every rival explanation gets a discriminating test, or it stays live and the claim gets softened. "This could be confounded by seasonality" is not a finding. "If it were seasonality, last year's same-week data would show the same bump — check it" is. 2. **If you cannot name the units that did *not* get the treatment, and say why they were comparable, there is no causal estimate.** There is a description with a causal verb attached to it. ## Mode Route on what already exists. Do not run the full pass when a shorter one is called for. | Situation | Mode | Run | |---|---|---| | Nothing measured yet | **Design** | §1, §2, §6, then write the §4 ledger as the pre-registration: arms, controls, the confounds being accepted, and the checks that will decide each one | | A result exists and is being reviewed | **Review** | §1–§8, full | | Causal language appeared mid-analysis | **Guardrail** | §1 and §2 only, no ledger. If §2 produces an untested list, stop and surface it *before* the conclusion is written down | Guardrail triggers — fire on these in any draft, comment, commit message, or chart title over non-randomized data: *drove, caused, led to, resulted in, because of, thanks to, the impact of, X% lift