autoresearch

Solid

Autoresearch v2. Meta-Harness-informed self-improving skill loop. Upgrades from Karpathy hill-climbing to trace-informed diagnosis: full execution trace access, counterfactual diagnosis after regressions, additive-only safety valve, multi-candidate filesystem. Runs on any skill that produces scoreable output. Also runs on CLAUDE.md routing logic itself. If you can score it, you can autoresearch it.

AI & Automation 3 stars 0 forks Updated today MIT

Install

View on GitHub

Quality Score: 79/100

Stars 20%
20
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Autoresearch v2.0. The Self-Improving Skill Loop > **Lineage**: Karpathy autoresearch (v1) → Stanford Meta-Harness (Lee et al., 2026) > **Core insight**: Scores-only hill climbing plateaus. Full execution trace access + counterfactual diagnosis converges faster and finds better optima. ## Source & Pairs with - **Primary lineage refs**: Karpathy autoresearch loop pattern (2025) + Stanford Meta-Harness paper (Lee et al., 2026) - `skills/loop-experiment/SKILL.md`. sister autoresearch pattern lift (from a public autoresearch sandbox pilot) - A trio audit of public autoresearch repos (gepa / uditgoenka / zkarimi22). - A content-curator pilot's round-1 results (Critic+Generate-B wins) - `scripts/eval/skill_failure_tracker.py`. the failure ledger that feeds autoresearch's regression diagnosis - `memory/Decisions.md`. past autoresearch ship decisions for calibration - Sister skills: `skills/critic/SKILL.md` (the validated subagent that pairs well with autoresearch's diagnose step), `skills/save/SKILL.md` (captures insights from autoresearch runs) ## Example output (autoresearch run on a content Critic prompt) ```markdown # autoresearch run. content Critic prompt, round 3 date: 2026-05-11 baseline_score: 7.2/10 (avg over 5 historical drafts) candidate_count: 3 winner: Critic-B (score 8.4/10, +1.2pp lift) ## diagnose (regression on round 2): - root cause: Critic prompt over-indexed on "sourcing" dimension, lost "precision" calibration - trace: 3 of 5 drafts cited correct source...

Details

Author
0xUrsanomics
Repository
0xUrsanomics/utopia-os
Created
5 days ago
Last Updated
today
Language
Python
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category