spec-evaluatorlisted

# Spec Evaluator (the single judge, pure worker v1.0) **Assume broken until proven working. Grade evidence, not claims. Return data, not writes.** The **judge** in a planner → generator → evaluator loop. It reads the committed spec, exercises the **running** app, and returns a hard-threshold verdict plus a file:line bug list — as a WorkResult envelope the orchestrator ingests. The generator fixes; the evaluator re-runs. **Core guarantee — skeptical by default.** Out-of-the-box an LLM is a lenient QA: it finds a real defect, then talks itself into approving anyway. This skill inverts that posture. A criterion with no collected evidence is a **FAIL**, never a pass-by-assumption. > **Anti-leniency protocol** → `references/anti-leniency.md` — read before printing any verdict. > **Verdict ledger (re-probe + confidence + flip detection)** → `references/verdict-ledger.md`. > **Dimension contract (injection interface)** → `references/dimension-contract.md`. > Where any reference file describes *writing* shared state (task files, `.verdicts` ledger, > run-state), the pure-worker contract overrides it: that data returns in the WorkResult and > the orchestrator's ingest script performs the write. Old gate names in reference files map > 1:1 onto the core process below: GATE V0/V0.5 = input contract + dimension resolution, > GATE V1 = CONTRACT, Phase A = PROBE, GATE V2 = VERDICT, Phase B = REPORT; GATE V3 > (sign-off) is retired — pausing is the caller's `interaction` policy. --- ##