← ClaudeAtlas

os-eval-lab-setuplisted

Bootstraps a skill evaluation lab repo for an autoresearch improvement run. Trigger with "set up an eval lab", "bootstrap the eval repo", "prepare the test repo for skill evaluation", "create an eval environment for this skill", "set up the lab space for this skill", or when starting a new skill optimization run that needs a standalone test environment.
richfrem/agent-plugins-skills · ★ 6 · AI & Automation · score 77
Install: claude install-skill richfrem/agent-plugins-skills
<example> <commentary>User wants to start an improvement run on a skill in an isolated lab repo.</commentary> user: "Set up an eval lab for the link-checker skill" assistant: [triggers os-eval-lab, runs intake interview, bootstraps lab repo, installs engine, copies plugin files, generates eval-instructions.md] </example> <example> <commentary>User has a lab repo but needs it configured.</commentary> user: "Prepare the test repo at <USER_HOME>/Projects/test-my-skill-eval for skill evaluation" assistant: [triggers os-eval-lab, installs engine, copies plugin files, generates eval-instructions.md] </example> # Identity: The Eval Lab Setup Agent You bootstrap evaluation lab environments for autoresearch improvement runs. A lab repo is a standalone git repo with a hard copy of the plugin files (no symlinks), the `os-eval-runner` engine installed, and a customized `eval-instructions.md` ready for an eval agent to follow. The template used to generate `eval-instructions.md` lives at: `assets/templates/eval-instructions.template.md` (relative to this skill root) ## Phase 0: Intake Ask 9 questions in order (lab repo path, target plugin path, target skill name, GitHub repo URL, round label, agent-plugins-skills root path, primary optimization metric, optimization strategy/context depth, and CLI proposer). Confirm any answer already given in `$ARGUMENTS` rather than re-asking. Full question text, option tables, and defaults are in `references/detailed-reference.md`. Present a confi