← ClaudeAtlas

reviewlisted

Adversarially review a proposed or applied change to a training/evaluation pipeline: did the claimed mechanism actually engage, is the measurement still valid, what did it silently break. Use for `/tml:review`, "I made training faster, check it", "review this diff before I merge", "why did throughput improve but accuracy drop", "did this speedup actually work", "check my optimiser swap", or on any diff touching a training loop, data pipeline, optimiser, precision, architecture or evaluation path. Walks a pitfall catalogue — score inflation, dead knobs, the throughput fallacy, changes that never engaged, stale step-unit hyperparameters, train/eval mismatch, leakage, beta-convention errors across optimisers. Read-only; verdicts, not edits. Do NOT use to find new opportunities (that is /tml:audit), to interpret a sweep (that is /tml:analyze), or for general code review of non-ML code (that is /code-review).
emaballarin/ccplugins · ★ 3 · Code & Development · score 77
Install: claude install-skill emaballarin/ccplugins
# /tml:review — did it work, and what did it cost Adversarial by construction. The default posture is that the change **did not do what it claims**, and the review's job is to find out whether that default survives contact with the diff. ## Hard rules 1. **Read-only.** No edits, no writes, not even to `./.tml/`. Verdicts only. 2. **Three questions, always, in order**: did the mechanism engage, is the measurement still valid, what did it silently break. 3. **"Improved throughput" is not an answer** to any of them. 4. **A verdict without a check behind it is an opinion.** Name the file, the line, the trace, or the number. ## Procedure ### 1. What is claimed, and what would falsify it State the claim in one sentence, then its **radius** (`references/evidence-grades.md` §3.1) read mechanically off the diff, then what observation would show it false. If nothing would, say so — an unfalsifiable claim is the finding. ### 2. Did the mechanism engage The most common failure is a change that is present in the source and inert at runtime: - A flag set after the object it configures was constructed. - A fast path guarded by a condition that never holds — dtype, shape, contiguity, device, or a version check. - A compiled path recompiling every step (count the recompilations; a recompilation per step is worse than no compilation). - A kernel that silently fell back because its workspace did not fit — which is also why an interior batch-size optimum can appear (`tier-b-