benchmark-models

Solid

Cross-model benchmark for vibestack skills. Runs the same prompt through Claude, GPT (via Codex CLI), and Gemini side-by-side — compares latency, tokens, cost, and optionally quality via LLM judge. Answers "which model is actually best for this skill?" with data instead of vibes.

AI & Automation 5 stars 0 forks Updated 1 weeks ago MIT

Install

View on GitHub

Quality Score: 78/100

Stars 20%
26
Recency 20%
90
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

## When to invoke Use when: "benchmark models", "compare models", "which model is best for X", "cross-model comparison", "model shootout". ## Preamble ```bash eval "$(~/.vibestack/bin/vibe-slug 2>/dev/null)" 2>/dev/null || SLUG="unknown" _LEARN_FILE="${VIBESTACK_HOME:-$HOME/.vibestack}/projects/${SLUG:-unknown}/learnings.jsonl" if [ -f "$_LEARN_FILE" ]; then _LEARN_COUNT=$(wc -l < "$_LEARN_FILE" 2>/dev/null | tr -d ' ') echo "LEARNINGS: $_LEARN_COUNT entries loaded" if [ "$_LEARN_COUNT" -gt 5 ] 2>/dev/null; then ~/.vibestack/bin/vibe-learnings-search --limit 5 2>/dev/null || true fi else echo "LEARNINGS: none yet" fi ``` {{include lib/snippets/session-host.md}} {{include lib/snippets/decision-brief.md}} {{include lib/snippets/working-protocols.md}} {{include lib/snippets/state-protocols.md}} # /benchmark-models — Cross-Model Skill Benchmark Different from `/benchmark` — that skill measures web page performance (Core Web Vitals, load times). This skill measures AI model performance on skills or arbitrary prompts. --- ## Step 0: Locate the binary ```bash BIN="$HOME/.vibestack/bin/vibe-model-benchmark" [ -x "$BIN" ] || { echo "ERROR: model benchmark binary not found." >&2; exit 1; } echo "BIN: $BIN" ``` If not found, stop and tell the user: "`vibe-model-benchmark` is required for this skill but is not installed at `~/.vibestack/bin/vibe-model-benchmark`. **vibestack does not bundle this binary** — it's a separate dependency. See [`docs/external-tools.m...

Details

Author
timurgaleev
Repository
timurgaleev/vibestack
Created
3 months ago
Last Updated
1 weeks ago
Language
TypeScript
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category