benchmark

Solid

Benchmark one session (or a small recent set) against the rolling average using Agent Monitor data — cost, total tokens, tool count, and workflow complexity score — and report where each metric lands as a percentile of the population. Tells you whether a session was normal, cheap, or an outlier. Use when judging whether a session was typical or out of band.

API & Backend 850 stars 193 forks Updated today MIT

Install

View on GitHub

Quality Score: 87/100

Stars 20%
98
Recency 20%
100
Frontmatter 20%
40
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Benchmark Score a session against the rolling population average and report its percentile on cost, tokens, tool count, and complexity using Agent Monitor data. ## Input The user provides: **$ARGUMENTS** This may be: - A single session ID — benchmark that session - "latest" — benchmark the most recent session - "latest N" — benchmark the N most recent sessions, each vs the average - empty — benchmark the most recent session (default) ## Data Sources | Endpoint | Returns | |----------|---------| | `GET /api/sessions?limit=N` | Population of sessions with `cost`, `model`, `started_at`, `metadata` (turn_count, total_turn_duration_ms) — builds the rolling baseline | | `GET /api/pricing/cost/{sessionId}` | `{ total_cost, breakdown:[{ input_tokens, output_tokens, cache_read_tokens, cache_write_tokens, cost }] }` — the target session's cost and tokens | | `GET /api/workflows/{sessionId}` | `complexity` (score), `stats` (tool/event counts), `toolFlow` (distinct tools used) — the target session's tool count and complexity | | `GET /api/analytics` | `avg_events_per_session`, `tool_usage`, `daily_sessions` — corroborates population-level averages | ## Report Sections ### 1. Build the Baseline Fetch the population with `GET /api/sessions?limit=200` (the rolling set). For each session gather cost (`GET /api/pricing/cost/{id}` or the list `cost` field), total tokens (sum of the 4 token types from the pricing breakdown), tool count and complexity (`GET /api/workflows/{id}`). Compu...

Details

Author
hoangsonww
Repository
hoangsonww/Claude-Code-Agent-Monitor
Created
4 months ago
Last Updated
today
Language
TypeScript
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category