autoresearch-fleet

Solid

Karpathy-inspired autonomous research loop. Agent edits one file, evals, keeps or discards, repeats. Plateau-triggered web search breaks through ceilings. Git as state machine. Runs until stopped or budget exhausted. Supports claude, codex, and pi providers.

Data & Documents 1 stars 0 forks Updated 4 days ago Apache-2.0

Install

View on GitHub

Quality Score: 80/100

Stars 20%
10
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Autoresearch Fleet Autonomous research loop inspired by [karpathy/autoresearch](https://github.com/karpathy/autoresearch). One mutable file, one immutable eval harness, git as state machine, and a "NEVER STOP" directive. The agent modifies code, evaluates the result, keeps improvements, discards regressions, and repeats indefinitely. **Open-world extension**: when the agent plateaus (N consecutive discards), the orchestrator injects a web-search prompt, breaking through knowledge ceilings the LLM can't cross alone. ## When to use - Optimizing a single metric (latency, accuracy, loss, score) - The problem has a fast, deterministic eval harness - You want autonomous overnight runs (100+ experiments while you sleep) - The search space is too large for manual exploration ## How it works ``` ┌─────────────────────────────────────────────────┐ │ orchestrator.sh │ │ │ │ for each iteration: │ │ 1. Count trailing discards in results.tsv │ │ 2. If >= plateau_threshold → search prompt │ │ 3. Spawn agent (claude -p, codex exec, or pi -p) │ │ 4. Agent reads program.md, edits file, evals │ │ 5. Agent updates results.tsv, keeps/reverts │ │ 6. Check stop conditions (iter/cost/plateau) │ │ 7. Loop │ └─────────────────────────────────────────────────┘ ``` The agent handles everything: reading files, ed...

Details

Author
quickcall-dev
Repository
quickcall-dev/skills
Created
4 months ago
Last Updated
4 days ago
Language
Shell
License
Apache-2.0

Similar Skills

Semantically similar based on skill content — not just same category

Code & Development Solid

autoresearch

Scaffold and run Karpathy-style autoresearch loops in any git repo. This skill should be used when setting up autonomous code improvement, generating adversarial eval harnesses, running hypothesis-implement-eval-keep/discard loops, or checking autoresearch progress. Triggers on "autoresearch", "autonomous improvement", "eval loop", "hypothesis loop", "self-improvement loop".

41 Updated yesterday
tdimino
AI & Automation Solid

autoresearch

Autonomous iterative experimentation loop for any programming task. Guides the user through defining goals, measurable metrics, and scope constraints, then runs an autonomous loop of code changes, testing, measuring, and keeping/discarding results. Inspired by Karpathy's autoresearch. USE FOR: autonomous improvement, iterative optimization, experiment loop, auto research, performance tuning, automated experimentation, hill climbing, try things automatically, optimize code, run experiments, autonomous coding loop. DO NOT USE FOR: one-shot tasks, simple bug fixes, code review, or tasks without a measurable metric.

15 Updated 2 weeks ago
a-tokyo
AI & Automation Listed

autoresearch

Orchestrates end-to-end autonomous AI research projects using a two-loop architecture. The inner loop runs rapid experiment iterations with clear optimization targets. The outer loop synthesizes results, identifies patterns, and steers research direction. Routes to domain-specific skills for execution, supports continuous agent operation via Claude Code /loop and OpenClaw heartbeat, and produces research presentations and papers. Use when starting a research project, running autonomous experiments, or managing a multi-hypothesis research effort.

0 Updated 3 days ago
Jensen-Yao