verify

Featured

Paper-vs-code consistency audit. After research:scientist implements a method from a paper, verify the implementation matches paper claims across five dimensions — formula matching [F], hyperparameter parity [H], eval protocol [E], notation consistency [N], and citation chain [C]. Reads paper (PDF path / arXiv URL / pasted text), maps claims to codebase, emits verification table with match status and severity.

AI & Automation 27 stars 4 forks Updated today Apache-2.0

Install

View on GitHub

Quality Score: 88/100

Stars 20%
48
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

<constants> ```yaml HARD_CUTOFF: 900 # seconds — advisory; Agent() calls are synchronous and cannot be interrupted mid-flight ``` </constants> <objective> Paper-vs-code consistency audit. After `research:scientist` implements method from paper, verify implementation matches paper claims. Audits five dimensions — formula matching, hyperparameter parity, eval protocol, notation consistency, citation chain. Emits verification table with match status and severity. NOT for: running experiments (use `/research:run`); judging experimental methodology (use `/research:judge`); literature search (use `/research:topic`); general code review (use `/develop:review` (requires `develop` plugin)). Verify audits implementation-vs-paper fidelity only — does not evaluate whether paper's claims are valid. </objective> <workflow> ## Agent Resolution `research:scientist` same plugin as this skill — no fallback needed if research plugin installed. Scientist handles all five audit dimensions in single spawn to preserve cross-dimension context (e.g., notation inconsistency explaining formula mismatch needs holistic paper understanding). ## Verify Mode (Steps V1–V6) Triggered by `verify <paper>` where `<paper>` is PDF path, arXiv URL, or multi-line quoted text. **Task tracking**: create tasks for V1, V2, V3, V4, V5, V6 at start — before any tool calls. ### Step V1: Parse paper input **Input resolution** (priority order): 1. Path ending `.pdf` — read via Read tool (use `pages: "1-20"` f...

Details

Author
Borda
Repository
Borda/AI-Rig
Created
6 months ago
Last Updated
today
Language
Python
License
Apache-2.0

Similar Skills

Semantically similar based on skill content — not just same category