iblai-api-agent-evallisted

# iblai-api-agent-eval Measure and improve an agent's quality from the API: build evaluation datasets, run experiments that send each question to the agent, then grade the results with LLM-as-Judge and/or human scores and export to CSV. Use to test an agent against a dataset and grade the results. ## Auth & conventions - **Base URL:** `https://api.iblai.app` - **Header:** `Authorization: Api-Token $IBLAI_API_KEY` on every request. (The dev docs phrase this as `Authorization: Token <key>` — it is the same platform key; use **Api-Token**.) - **Path vars:** `{org}` = `$IBLAI_ORG`, `{username}` = `$IBLAI_USERNAME`. - **Host root:** `…/dm/api/ai-mentor/orgs/{org}/users/{username}/evaluations/`. Below, `…/evals` = that root. (`ai-mentor` is the canonical mount; the `ai-agent` spelling is an accept-only alias for the same routes.) - Not connected yet? Run **`/iblai-api-login`** first to populate `IBLAI_ORG`, `IBLAI_USERNAME`, and `IBLAI_API_KEY`. ## Concepts - **These eval datasets are not the agent's RAG datasets.** `evaluations/datasets/` hold graded test cases (input + expected output) for measuring agent quality. They are unrelated to an agent's knowledge/training datasets in **`/iblai-api-agent-dataset`** (RAG documents) — do not cross-wire the two. - **Eval data is org-scoped and isolated.** Datasets, items, runs, scores, and score configs belong to `$IBLAI_ORG` alone — no other org can read them or grade against them. - **Runs and judges are async tas