loop-experiment

Solid

Run a Karpathy-loop / autoresearch-style optimization experiment on any task with measurable fitness. Bounds the loop with the stack's discipline (fitness-function gating, branch/worktree isolation, anti-slop, audit logging). Use when running prompt evolution, code optimization, content A/B testing. anywhere with a stable measurable metric and cheap iteration.

AI & Automation 3 stars 0 forks Updated today MIT

Install

View on GitHub

Quality Score: 79/100

Stars 20%
20
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# /loop-experiment. Disciplined autoresearch-style optimization Lifts the `setup.md` pattern from `zkarimi22/autoresearch-anything` (public repo; pattern lifted, not installed) and grafts it onto the stack's discipline. ## Phase 0. Fitness-Function Gate (HARD STOP if fail) Before scaffolding ANY loop experiment, screen the task against 2 conditions. If either fails, refuse to set up the experiment. Push back to the user. 1. **Stable measurable fitness function exists**: a function that maps (input, output) → number. Examples: engagement count, qualified-lead yield, classification accuracy, test pass rate, token count, latency. NOT examples: "the operator's taste", "feels right", "looks better". 2. **Cost-per-iteration cheap enough for 50-700 attempts**: each loop iteration must be runnable in seconds-to-minutes, not hours-to-days. A once-daily content draft is borderline. Most subjective tasks fail this gate. Example screen: - ✅ a content pipeline (engagement = likes+replies+bookmarks; iter = 1 draft/day, batch on 30+ days) - ✅ lead-gen prompts (qualified-lead yield per query; iter = batch query) - ✅ a sub-agent's scope classifier (HANDLE/ESCALATE accuracy; iter = prompt rerun) - ✅ skill prompt optimization (`skill_failure_tracker.py` count; iter = tracked over usage) - ❌ sourcing, intel, subjective outreach drafts (no stable fitness. the operator's taste IS the metric) If the user requests a loop experiment for a non-fit task: refuse politely, explain the gate, suggest...

Details

Author
0xUrsanomics
Repository
0xUrsanomics/utopia-os
Created
5 days ago
Last Updated
today
Language
Python
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

experiment

Autonomous metric-driven iteration loop. Modify code, measure a metric, keep improvements, discard regressions via git rollback. Works with any numeric metric and any direction (minimize/maximize). Use when: optimizing performance, reducing latency, minimizing bundle size, improving Lighthouse scores, or tuning any measurable metric. Triggers on: experiment, optimize, reduce latency, improve performance, minimize, maximize, benchmark, iterate, metric-driven, autoresearch

6 Updated today
ArieGoldkin
AI & Automation Listed

simple-experiment-loop

Use when the user wants to fix a failing test, resolve build errors, reduce bundle size, optimize a function, or run a TDD loop. Drives a fast, deterministic inner loop using local terminal commands.

0 Updated 6 days ago
cauldnz
AI & Automation Solid

autoresearch

Autonomous experiment loop: edit code, commit, run benchmark, extract metrics, keep improvements or revert, repeat forever. Use this skill when the user asks to "run autoresearch", "start an experiment loop", "optimize a metric autonomously", "autonomous experiments", "benchmark loop", "keep/discard experiments", "optimize test speed", "optimize bundle size", "optimize build time", "run experiments overnight", "speed up my tests", "make my build faster", "reduce compile time", "keep trying until it's faster", "run experiments while I sleep", "overnight optimization", "edit-measure-keep loop", "autoresearch status", or mentions "autoresearch", "experiment loop", "autonomous optimization". Always use this skill when the user wants to iteratively and autonomously improve any measurable metric — even if they don't use the word "autoresearch". Also use when the user asks about the status of a running autoresearch session or wants to cancel/stop one.

12 Updated 1 weeks ago
proyecto26