bare-eval

Featured

Run isolated eval and grading calls using CC 2.1.81 --bare mode. Constructs claude -p --bare invocations for skill evaluation, trigger testing, and LLM grading without plugin/hook interference. Use when running eval pipelines, grading skill outputs, benchmarking prompt quality, or testing trigger accuracy in isolation.

AI & Automation 229 stars 25 forks Updated today MIT

Install

View on GitHub

Quality Score: 89/100

Stars 20%
79
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Bare Eval — Isolated Evaluation Calls Run `claude -p --bare` for fast, clean eval/grading without plugin overhead. **CC 2.1.81 required.** The `--bare` flag skips hooks, LSP, plugin sync, and skill directory walks. ## When to Use - Grading skill outputs against assertions - Trigger classification (which skill matches a prompt) - Description optimization iterations - Any scripted `-p` call that doesn't need plugins ## When NOT to Use - Testing skill routing (needs `--plugin-dir`) - Testing agent orchestration (needs full plugin context) - Interactive sessions ## Prerequisites ```bash # --bare requires ANTHROPIC_API_KEY (OAuth/keychain disabled) export ANTHROPIC_API_KEY="sk-ant-..." # Verify CC version claude --version # Must be >= 2.1.81 ``` ## Quick Reference | Call Type | Command Pattern | |-----------|----------------| | Grading | `claude -p "$prompt" --bare --max-turns 1 --output-format text` | | Trigger | `claude -p "$prompt" --bare --json-schema "$schema" --output-format json` | | Streaming grade | `claude -p "$prompt" --bare --max-turns 1 --output-format stream-json` | | Optimize | `echo "$prompt" \| claude -p --bare --max-turns 1 --output-format text` | | Force-skill | `claude -p "$prompt" --bare --print --append-system-prompt "$content"` | | @-file in prompt | `claude -p "grade @fixtures/case-1.md against rubric" --bare` (CC 2.1.113 Remote Control autocomplete) | > **Long harness runs (CC 2.1.199+):** set `CLAUDE_CODE_RETRY_WATCHDOG=1` for unattended ev...

Details

Author
yonatangross
Repository
yonatangross/orchestkit
Created
8 months ago
Last Updated
today
Language
TypeScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

evaluate-skill

Use when you want to behaviorally evaluate a Claude Code skill — measure whether it auto-activates on the prompts it should and stays quiet on near-misses (trigger recall and specificity), whether its output actually satisfies its own discipline (correct-usage), and whether it beats the no-skill baseline (with/without) — producing a scorecard with confidence intervals. Triggers on "evaluate this skill", "test my skill", "does my skill fire", "measure or benchmark skill performance", "is my description triggering", "build an eval for this skill", or running "/evaluate-skill". Claude Code only — it spawns many headless `claude -p` runs, so it is cost-gated; show the plan first. Not for a one-off manual spot-check, for judging a skill's design qualitatively (that is a fresh-eyes panel, not a behavioral eval), or for listing which skills are installed (that is toolkit-awareness).

2 Updated 5 days ago
grimaldost
Web & Frontend Listed

eval-harness

Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD). Use this skill whenever defining success criteria for a feature before building it, writing capability / regression / quality evals, measuring pass@k reliability, or setting up eval-driven checks to catch regressions across changes.

0 Updated yesterday
sardonyx0827
AI & Automation Listed

eval-harness

Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles

4 Updated today
immacualate