← ClaudeAtlas

preregisterlisted

Lock a confirmatory falsification target and its fixed multiple-comparison family before observing the confirmatory result. Use before promoting an exploratory finding to a main claim or whenever several related hypotheses need Bonferroni control. Records metric, threshold, family id/size, correction, and seed budget.
whenpoem/aiscientist · ★ 8 · AI & Automation · score 76
Install: claude install-skill whenpoem/aiscientist
# Preregister This skill supports "decide before observing" for confirmatory claims. Exploratory runs may still use seed_perturb / pin_metric, but any number intended as a main publication claim should have a matching prereg row first. ## When to invoke - Before a result is promoted from exploratory to a confirmatory manuscript claim. - Right after `bt-tournament` returns the top-2 hypotheses when the next run is explicitly confirmatory. - Whenever the user types `/preregister`. ## Required arguments | arg | meaning | example | |---|---|---| | `hypothesis_id` | id from `mem_nodes` (kind=hypothesis) | `hyp_a3f9...` | | `metric_name` | exact claim text the engineer will pin later | `"test accuracy"` | | `direction` | `higher_better` or `lower_better` | `higher_better` | | `threshold` | number that separates `met` from `missed` | `0.85` | | `seed_count` | how many seeds the seed_perturb call must use | `5` | | `alpha` | nominal Type-I error rate | `0.05` | | `mc_correction` | `bonferroni` (default), `none`, or legacy alias `bh` | `bonferroni` | | `family_id` | stable id shared by related confirmatory tests | `primary_metrics` | | `family_size` | total number of tests planned in that family | `4` | | `heldout_dataset` | optional dataset name to be queried via query_heldout | `mnist-test` | ## Workflow 1. Call `mcp__verify__list_preregistrations(hypothesis_id=...)`. If a row exists with status `open`, do not fail the session. Ask whether to reuse that lock, withdraw it outs