benchmarklisted

# zuvo:benchmark — Multi-Provider Coding Benchmark Measures how well different AI coding agents handle a task. Dispatches to all available providers in parallel, collects responses, and uses an opposite-model Claude meta-judge to score on four dimensions (completeness, accuracy, actionability, no_hallucinations). Outputs a ranked leaderboard with cost and time breakdown. **Use corpus mode (`--mode corpus`) to compare runs across time.** The corpus uses fixed OrderService + useSearchProducts tasks — the same prompt every time — so runs from different days are directly comparable. ## Argument Parsing Parse `$ARGUMENTS` for these flags: | Flag | Effect | |------|--------| | `--diff [ref]` | Benchmark against a git diff (default: HEAD~1) | | `--files <path>` | Benchmark on a file or newline-separated list of files as task input | | `--prompt <text>` | Use a literal text prompt as the task (alias: `--task`) | | `--mode corpus` | Use fixed corpus tasks (OrderService + useSearchProducts) | | `--mode default` | Use user-provided task (default) | | `--with-tests` | Run Round 2: have providers write tests for their own Round 1 code | | `--with-adversarial` | Run adversarial cross-review on Round 1 code | | `--with-test-adversarial` | Run adversarial cross-review on Round 3 tests (requires `--with-tests`) | | `--with-static-checks` | Run tsc + jest on generated code (best-effort, null if tools missing) | | `--provider <name>` | Restrict to one or more providers, comma-separated (al