iblai-vibe-agent-evals

Solid

Add the agent Evals tab (run the agent against benchmarks, score responses with LLM-as-Judge reviews or manual scores, export CSV) to your Next.js app

AI & Automation 15 stars 5 forks Updated today MIT

Install

View on GitHub

Quality Score: 83/100

Stars 20%
40
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# /iblai-vibe-agent-evals Add the agent **Evals tab** -- run your agent against a benchmark (a set of test questions) and score every response, so you can catch weak spots and track improvements as you refine the agent. The tab bundles several surfaces into one component: a benchmark picker, an evaluations table with status badges and a per-row actions menu (View results / New review / Check status / Export CSV / Delete), a **New Evaluation** dialog, an embedded **Manage benchmarks** dialog (create benchmarks, add Q&A pairs manually or via CSV upload), a results modal showing every trace with its scores and LLM-as-Judge reviews, and an **Evaluate** (new review) modal with an LLM provider/model picker. This is one tab in the wider agent-settings family (`access`, `api`, `datasets`, `disclaimers`, `embed`, `evals`, `history`, `llm`, `memory`, `prompts`, `safety`, `settings`, `tasks`, `tools`). Each tab is a separate skill. All tabs share the same `AgentSettingsProvider` wrapper -- set it up once and mount as many tabs as you need. ![Evals tab with benchmark picker and evaluations table](https://raw.githubusercontent.com/iblai/vibe/refs/heads/main/skills/iblai-vibe-agent-evals/iblai-vibe-agent-evals-1-list.png) ![Manage benchmarks dialog (search, New Benchmark)](https://raw.githubusercontent.com/iblai/vibe/refs/heads/main/skills/iblai-vibe-agent-evals/iblai-vibe-agent-evals-3-manage-benchmarks.png) ![Results modal (traces, scores, reviews)](https://raw.githubusercontent.com/ib...

Details

Author
iblai
Repository
iblai/vibe
Created
5 months ago
Last Updated
today
Language
JavaScript
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category