citation-verification

Validates academic citations for existence, appropriateness, and completeness across a three-phase pipeline.

6|1|Updated May 11, 2026
One-click install
npx skills add https://github.com/yakeworld/Synthos --skill citation-verification-yakeworld
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: citation-verification
Source: https://github.com/yakeworld/Synthos/tree/main/skills/extended/external-automation/automation-skills/quality/citation-verification
Command: npx skills add https://github.com/yakeworld/Synthos --skill citation-verification-yakeworld

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pymupdf, pdfplumber, and includes references (resource) components.

What problem does it solve? Academic papers often contain fabricated DOIs, tampered metadata, withdrawn papers, mismatched authors, and missing key references that manual review misses. This Skill runs a three-phase verification pipeline over a paper directory to detect fake references, confirm each citation actually supports the claim it is attached to, and find important literature that was never cited. ## Core Features & Use Cases - Phase 1 — Existence check: Verifies every DOI against doi.org, Crossref, and Semantic Scholar, distinguishing fully fabricated references from tampered DOIs, replacing fake entries, and running a D10a regression check so no orphan \cite keys remain in the .tex file. - Phase 2 — Appropriateness check: Reads each reference PDF in full (via pymupdf/pdfplumber), compares title, author, year, and content against the citation context, and detects withdrawn papers, cross-domain DOIs, fabricated author names, and Nature/Springer download mix-ups using pdfinfo. - Phase 3 — Completeness check: Independently searches Semantic Scholar for high-citation literature on the paper's topics and classifies omissions as critical, suggested, or optional based on citation count and topic-match thresholds. - Use Case: Before submitting a CRISP-DM methodology paper, point the Skill at the paper directory; it flags a fabricated SMOTE reference whose DOI resolves to a finance paper, repairs a tampered Kapoor 2023 DOI, and recommends adding the Martinez-Plumed 2021 CRISP-DM retrospective. ## Quick Start Run citation verification on my paper directory papers/my-paper and produce the phase1, phase2, phase3, and overall verification report with a repaired bib file.

Frequently Asked Questions about citation-verification

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect fake DOIs in a BibTeX bibliography?

Check each DOI against three sources: doi.org resolution, the Crossref API, and a Semantic Scholar title search. A DOI returning 404 on doi.org and Crossref with no Semantic Scholar match is treated as fabricated and must be replaced, not repaired.

How to verify a citation actually supports the claim in my paper?

Extract the citation context from the .tex file, then read the reference PDF in full using pymupdf or pdfplumber. Compare title, first author, year, and content against the claim; API-level title matching alone cannot confirm appropriateness.

Does Crossref still support the format=bibtex parameter?

No. The format=bibtex parameter was deprecated and returns a 400 validation error. Request the default JSON response and manually build the BibTeX entry from the title, author, container-title, volume, issue, page, and DOI fields.

Why does Semantic Scholar search return empty results silently?

Semantic Scholar silently returns empty lists when the SEMANTIC_SCHOLAR_API_KEY environment variable is not set, because rate-limit 429 responses get caught as empty results. Always assert the API key exists before running searches.

What happens to tex citations after deleting a fabricated reference?

Deleting a bib entry leaves orphan \cite keys in the .tex file, dropping citation consistency. Run a D10a regression check using comm -23 between tex-cited keys and bib entries, then fix or remove the orphaned citations.

Can a real DOI still point to the wrong paper?

Yes. A genuine DOI can resolve to a cross-domain paper unrelated to the citation, and download pipelines can fetch adjacent articles from Nature or Springer. Validate with pdfinfo that the PDF title matches the BibTeX title before accepting it.