verification-rubriclisted
Install: claude install-skill metraton/gaia
# Verification Rubric
Verification-rubric is the judging discipline for a `task_gates` entry whose
`verification_type` is `semantic` or `self_review`: it reads the gate's
`evidence_shape` as an explicit rubric, assesses the produced work against
each stated criterion independently, and emits a structured, justified
pass/fail verdict -- never a hollow "looks fine." It is the judgment-based
counterpart to the deterministic-oracle mode, which re-runs a `command`/`code`
gate and diffs the result; there is no command to re-run here, only evidence
to weigh against criteria.
## Core principle
Two of the four `verification_type` values (`gaia.state.VALID_VERIFICATION_TYPES`,
`gaia/state/__init__.py`) route to this skill: **`semantic`** (`evidence_shape`
carries an externally authored rubric -- the contract-envelope's own
`requires_human` marker names the same discipline: "needs human/rubric
validation") and **`self_review`** (`evidence_shape` is the producer's own
statement of what it checked -- the envelope's `reviewed` field is the same
idea, and it is the honesty-rule floor from `agent-protocol`, not a shortcut
around it). Both are LLM-as-judge tasks, not code execution.
Three forces shape the judgment:
- **Explicit criteria beat holistic impression.** Read the rubric as a list of
discrete, independently-checkable claims, not one paragraph to eyeball. A
verdict built on an overall feeling collapses the moment someone asks "which
part, exactly?"
- **Judge each criterion