media-judgelisted
Install: claude install-skill vargHQ/skills
# Media judge
> Step 9 of 10 in [How to make a video with an AI agent in ten steps](https://varg.ai/how-to/make-a-video-in-ten-steps). The full guide, with every test and source: https://varg.ai/how-to/judge-an-ai-video-without-bias (as Markdown: add `.md`).
**Measure, don't grade.** A judgment here is a time, a number and a picture. "Looks great", "8/10" and "feels premium"
are not findings, and neither is any adjective with no measurement behind it.
Code finds the moment and a fresh pair of eyes reads only that moment, in that order, because the other way round fails:
12 vision models scored at most 54.1% on spotting temporal glitches; Claude Opus caught 17.5% of them, Gemini 3 Flash
said "glitch" to about 87% of clean clips ([TempGlitch](https://arxiv.org/abs/2605.21443), gameplay clips). Uniform sampling
at 0.5 fps caught 11.81% of faults under 0.2 s ([SynFlash](https://arxiv.org/abs/2603.17374)), and GPT-4 preferred its own
output 0.705 and 0.912 of the time on tasks where people saw equal quality ([Panickssery et al.](https://arxiv.org/abs/2404.13076)). So:
1. **Facts:** `judge.py` reads every frame and every sample. It does not sample.
2. **Eyes:** a fresh agent opens only the evidence and answers narrow questions.
3. **Verdict:** counted defects. Ranking follows from the counts, never from a feeling.
**What this has been tested on.** Planted defects in footage it never saw while being tuned: 18 of 22 caught, 6 of 8 clean controls (25 of 25 and 10 of 10 on the foo