← ClaudeAtlas

autoresearchlisted

Autonomous experiment loop: edit code, commit, run benchmark, extract metrics, keep improvements or revert, repeat forever. Use this skill when the user asks to "run autoresearch", "start an experiment loop", "optimize a metric autonomously", "autonomous experiments", "benchmark loop", "keep/discard experiments", "optimize test speed", "optimize bundle size", "optimize build time", "run experiments overnight", "speed up my tests", "make my build faster", "reduce compile time", "keep trying until it's faster", "run experiments while I sleep", "overnight optimization", "edit-measure-keep loop", "autoresearch status", or mentions "autoresearch", "experiment loop", "autonomous optimization". Always use this skill when the user wants to iteratively and autonomously improve any measurable metric — even if they don't use the word "autoresearch". Also use when the user asks about the status of a running autoresearch session or wants to cancel/stop one.
proyecto26/autoresearch-ai-plugin · ★ 12 · AI & Automation · score 77
Install: claude install-skill proyecto26/autoresearch-ai-plugin
# Autoresearch: Autonomous Experiment Loop An autonomous optimization loop where Claude edits code, runs a benchmark, measures a metric, and keeps improvements or reverts — repeating forever until stopped. ## Core Concept The loop is simple: **edit → commit → run → measure → keep or discard → repeat**. - **Primary metric is king.** Lower (or higher, depending on direction) is better. Improved → keep the commit. Equal or worse → `git revert`. - **State survives context resets** via `autoresearch.jsonl` (append-only log) and `autoresearch.md` (living session document). - **Domain-agnostic.** Works for any measurable target: test speed, bundle size, LLM training loss, Lighthouse scores, build times, etc. - **Be careful not to overfit to the benchmarks and do not cheat on the benchmarks.** Optimize the real workload, not the measurement harness. ## Setup Phase When the user triggers autoresearch, gather the following (ask if not provided). If `$ARGUMENTS` is provided, use it as the optimization goal: 1. **Goal** — what to optimize (e.g., "reduce unit test runtime") — use `$ARGUMENTS` if provided 2. **Command** — the benchmark to run (e.g., `pnpm test`, `uv run train.py`) 3. **Primary metric** — name, unit, and direction (`lower` or `higher` is better) 4. **Secondary metrics** — optional additional metrics to track for tradeoff monitoring (e.g., memory, compile time) 5. **Files in scope** — which files can be modified 6. **Constraints** — time budget, off-limits files, corr