citation-audit

Featured

Verify that every citation in a manuscript is real, correctly attributed, and accurately described. Detects ghost papers, wrong arXiv IDs, inverted claims, and dead links by fetching each cited work. Optional fix mode applies bib metadata corrections and surfaces prose rewrites for claim errors. Triggers on: "check my citations", "verify references", "citation audit", "are my references real", "check bib", "reference check", "bib audit", "citation verification". Companion to manuscript-review (Pass 5 hygiene); this skill audits factual truth.

DevOps & Infrastructure 313 stars 46 forks Updated 4 days ago MIT

Install

View on GitHub

Quality Score: 93/100

Stars 20%
83
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Citation Audit Skill ## Purpose Verify every citation in a manuscript against its actual source. LLMs hallucinate citations, invent arXiv IDs, misattribute findings, and confuse authors. This skill catches all of that by fetching and reading each cited work. ## Why This Exists LLMs are unreliable with citations in three distinct ways: 1. **Ghost papers** — The paper does not exist. Title, authors, or venue are fabricated. 2. **Wrong metadata** — The paper exists but the bib entry has the wrong arXiv ID, wrong authors, wrong year, or wrong venue. 3. **Inverted claims** — The paper exists and the bib is correct, but the manuscript mischaracterizes what the paper says. All three are invisible to structural audits (cross-reference checks, compilation tests). They require reading the actual cited work. ## Inputs - The manuscript `.tex` file(s) - The `.bib` file - Web access (to fetch papers from arXiv, conference sites, URLs) ## Execution ### Phase 1: Extract citation contexts For each `\citep{}`, `\citet{}`, `\cite{}` in the manuscript: 1. Record the bib key 2. Record the surrounding sentence or paragraph (the **claim context**) 3. Classify the claim type: - **FACTUAL**: "X et al. found Y" / "X et al. measured Y" - **METHODOLOGICAL**: "We follow X" / "We use the benchmark from X" - **POSITIONAL**: "Unlike X, we..." / "X does not measure..." - **PARENTHETICAL**: "(X, 2024)" — no specific claim, just a reference 4. For FACTUAL and POSITIONAL claims,...

Details

Author
Mathews-Tom
Repository
Mathews-Tom/armory
Created
5 months ago
Last Updated
4 days ago
Language
Python
License
MIT

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category