← ClaudeAtlas

autoresearchlisted

Autonomous hill-climbing on any measurable problem: qualify the four legs, freeze an eval referee, then loop mutate-evaluate-keep/revert until the stopping condition fires. Works on tests, latency, bundle size, cost.
magnusrodseth/dotfiles · ★ 2 · Data & Documents · score 68
Install: claude install-skill magnusrodseth/dotfiles
# Autoresearch Autonomous **hill-climbing** over a **mutable artifact**, judged by a **frozen referee**, advanced by a **git ratchet**: keep what measurably improves, revert what doesn't, never stop until the stopping condition fires. The human programs the protocol; you run the experiments; the referee decides. Generalized from [karpathy/autoresearch](https://github.com/karpathy/autoresearch). **Continue mode**: if invoked as `continue` (or the repo already has a `PROTOCOL.md` and `results.tsv` on an `autoresearch/*` branch), read both, skip to phase 4, and resume the loop under the existing protocol. ## 1. Qualify The pattern stands on four legs. Name each concretely before anything else: | Leg | Question | Example | |---|---|---| | Mutable artifact | Which files may the loop edit? | `src/translator/**` | | Quantitative metric | One number; which direction is better? | tests passed, higher | | Bounded eval | One command, fixed budget, prints the metric | `pnpm eval`, ~30s | | Keep/discard | Can a bad change be fully reverted? | git commit / reset | A missing metric or eval command is normal: you construct it in phase 3. But if the artifact isn't revertible or nothing is measurable even in principle, say so and stop. This problem does not hill-climb. ## 2. Align: grill the protocol out of the user Invoke the `grill-with-docs` skill on the proposed run (fall back to `grilling` if unavailable). The grilling must pin down, at minimum: - **Objective**: the single metric