beltlisted

# agent-belt `belt` is a CLI that evaluates headless coding-agent CLIs by running multi-turn scenarios against them and scoring the results with rule-based checks plus optional LLM judges. The `belt` console script is the only public surface - never import internals. ## 1. Verify install before doing anything ```bash belt doctor ``` Checks Python, registered agents (auth + reachability), LLM scoring providers (cloud keys + Ollama), and which `belt` clone the command resolves to. If `doctor` is unhappy, fix what it reports before attempting anything else - most user-reported problems are solved by reading its output. ```bash belt agent list # registered agents (entry-point discovered) belt agent info <name> # capabilities of one agent (cli_options, env vars, fields it supports) ``` ## 2. Run an evaluation `belt eval` chains **run → score → aggregate** in one command. Start here. ```bash belt quickstart # auto-detect, single rules-only belt eval examples/scenarios/showcase --modes rules --tags real-runnable # whole runnable showcase belt eval my-scenarios/ --modes rules,llm --workers 3 # rules + LLM judge, parallel belt eval my-scenarios/ --dry-run # list matched scenarios, no run belt eval my-scenarios/ --modes rules --export junit:report.xml # JUnit report for CI test reporters ``` **`--modes rules`** runs withou