autoresearch

Featured

Autonomous improvement loop: scan codebase metrics, scaffold experiment files, run agent-driven iterations until metric improves

AI & Automation 5,772 stars 755 forks Updated today CC-BY-SA-4.0

Install

View on GitHub

Quality Score: 96/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Autoresearch: Autonomous Improvement Loop Scan codebase quality metrics, propose improvement loops, and run autonomous agent iterations. Inspired by [karpathy/autoresearch](https://github.com/karpathy/autoresearch), adapted from ML research to code quality. **Concept**: The agent proposes a code change, runs the measurement, keeps the change if the metric improved, reverts via `git reset` if not, and repeats until manually stopped. **Time**: Scan ~30s | Per iteration: depends on scope | Loop: runs indefinitely until you stop it --- ## Mode 1: Scan (default) Measure current state, detect existing loops, propose next actions. ### Instructions Run the following metrics and display a prioritized proposal table. **Step 1: Measure codebase metrics** Adapt grep patterns to your project's conventions. These are TypeScript defaults, adjust for your stack. ```bash # M1: Function declarations (prefer arrow functions) M1=$(grep -r "export function " src/ --include="*.ts" --include="*.tsx" -l 2>/dev/null | wc -l | tr -d ' ') # M2: Interface declarations (prefer type aliases) M2=$(grep -r "export interface " src/ --include="*.ts" --include="*.tsx" -l 2>/dev/null | wc -l | tr -d ' ') # M3: ESLint disables M3=$(grep -r "eslint-disable" src/ --include="*.ts" --include="*.tsx" -l 2>/dev/null | wc -l | tr -d ' ') # M4: Type casts to any M4=$(grep -r " as any" src/ --include="*.ts" --include="*.tsx" -l 2>/dev/null | wc -l | tr -d ' ') # M5: TODO comments M5=$(grep -r "// TODO" s...

Details

Author
FlorianBruniaux
Repository
FlorianBruniaux/claude-code-ultimate-guide
Created
7 months ago
Last Updated
today
Language
Python
License
CC-BY-SA-4.0

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

autoresearch

Autonomous iterative experimentation loop for any programming task. Guides the user through defining goals, measurable metrics, and scope constraints, then runs an autonomous loop of code changes, testing, measuring, and keeping/discarding results. Inspired by Karpathy's autoresearch. USE FOR: autonomous improvement, iterative optimization, experiment loop, auto research, performance tuning, automated experimentation, hill climbing, try things automatically, optimize code, run experiments, autonomous coding loop. DO NOT USE FOR: one-shot tasks, simple bug fixes, code review, or tasks without a measurable metric.

15 Updated 2 weeks ago
a-tokyo
AI & Automation Listed

autoresearch

Autonomous experiment loop inspired by Karpathy's autoresearch. Iteratively modifies code, runs evaluation, measures a metric, and keeps or discards changes using git. Use when optimizing code against a measurable target (test pass rate, performance, bundle size, model quality, etc).

3 Updated 3 days ago
Silex-Research
AI & Automation Listed

autoresearch-impl

Runs a Karpathy-autoresearch-style keep-or-discard iteration loop over an already-implemented branch — propose one variant, run it against tests/benchmarks, keep it if the metric improves or discard and revert, repeat within a fixed budget — before handing off to code-review/QA. Use this after subagent-driven-development (or opencode-subagent-driven-development) finishes a task, whenever the user wants to "squeeze out more performance", "try a few implementation variants", "iterate on this implementation before review", or mentions autoresearch/Karpathy about code that already runs.

0 Updated 2 days ago
darkstar1227