verify

Solid

Paper-vs-code consistency audit. After research:scientist implements a method from a paper, verify the implementation matches paper claims across five dimensions — formula matching [F], hyperparameter parity [H], eval protocol [E], notation consistency [N], and citation chain [C]. Reads paper (PDF path / arXiv URL / pasted text), maps claims to codebase, emits verification table with match status and severity.

AI & Automation 23 stars 3 forks Updated yesterday Apache-2.0

Install

View on GitHub

Quality Score: 87/100

Stars 20%
46
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

<constants> ```yaml HARD_CUTOFF: 900 # seconds — advisory; Agent() calls are synchronous and cannot be interrupted mid-flight ``` </constants> <objective> Paper-vs-code consistency audit. After `research:scientist` implements method from paper, verify implementation matches paper claims. Audits five dimensions — formula matching, hyperparameter parity, eval protocol, notation consistency, citation chain. Emits verification table with match status and severity. NOT for: running experiments (use `/research:run`); judging experimental methodology (use `/research:judge`); literature search (use `/research:topic`); general code review (use `/develop:review` (requires `develop` plugin)). Verify audits implementation-vs-paper fidelity only — does not evaluate whether paper's claims are valid. </objective> <workflow> ## Agent Resolution `research:scientist` same plugin as this skill — no fallback needed if research plugin installed. Scientist handles all five audit dimensions in single spawn to preserve cross-dimension context (e.g., notation inconsistency explaining formula mismatch needs holistic paper understanding). ## Verify Mode (Steps V1–V6) Triggered by `verify <paper>` where `<paper>` is PDF path, arXiv URL, or multi-line quoted text. **Task tracking**: create tasks for V1, V2, V3, V4, V5, V6 at start — before any tool calls. ### Step V1: Parse paper input **Input resolution** (priority order): 1. Path ending `.pdf` — read via Read tool (use `pages: "1-20"` f...

Details

Author
Borda
Repository
Borda/AI-Rig
Created
5 months ago
Last Updated
yesterday
Language
Python
License
Apache-2.0

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

academic-paper-verify

Thoroughly verify all code, tables, figures, modeling decisions, and quantitative claims in an academic paper against its source R scripts and output files. Use this skill whenever you need to audit, replicate, or verify an academic research paper - including cross-checking LaTeX tables against R output, validating econometric modeling choices, ensuring sample sizes are consistent, building a verification manifest, and running automated replication tests. Trigger this skill for any mention of: paper verification, replication check, table audit, code-paper consistency, reproducing results, verifying estimates, checking coefficients, or any variant of "does the paper match the code."

0 Updated yesterday
robuxref2005
AI & Automation Listed

paper-verify

引用存在性核验命令。当用户要核查参考文献是否真实存在、查引用有没有编造、核实 DOI、 查某条引用是否已撤稿、查元数据(作者/年份/标题)对不对得上、检查参考文献格式 (GB/T 7714)、查论文结论是否夸大超出结果支撑,或说 verify / 核验 / 核对引用 / 查 DOI / 参考文献自查 / 投稿前自查 / 查撤稿 / 格式检查 / 国标 / 结论夸大 / 说过头话 时使用—— 即使用户只说"帮我查查这些引用是真的吗""这些参考文献有没有问题""投稿前帮我自查一下" "这条 DOI 能查到吗"也应使用。行为铁律:逐条以真实 API 响应为准判六态(已核实 / 元数据不符 / 已撤稿 / 未找到(疑似不存在)/ 无法核实 / 待人工核对),绝不凭记忆判存在性;中文文献绝不 标编造嫌疑、一律待人工核对并附知网 / 万方核对包;"疑似不存在"只陈述查证结果(查无此文)、 不指控动机(编造 / 虚假);结论夸大检查只摆结论-结果对照、不下定论。不替用户判定编造 / 学术不端、不指控动机、不替用户改写参考文献表。

2 Updated today
cabbage2000-lab
AI & Automation Solid

paper-skill

End-to-end, Chinese-first academic research and publication workflow for reading papers, literature reviews, research framing, manuscript planning and writing, Chinese-English translation, LaTeX, figures, citation verification, reporting-guideline checks, journal selection, peer review, rebuttals, revisions, and submission packages. Use for SCI, IEEE, Nature-family, IJCAI, TRO, theses, systematic reviews, clinical/observational/animal studies, and any task where claims, evidence, references, manuscript files, or journal requirements must be checked rather than invented.

69 Updated 1 weeks ago
cLin-c