Bib verify

Skill agentscope-ai/OpenJudge/skills/bib-verify

Verify a BibTeX file for hallucinated or fabricated references by cross-checking every entry against CrossRef, arXiv, and DBLP. Reports each reference as verified, suspect, or not found, with field-level mismatch details (title, authors, year, DOI). Use when the user wants to check a .bib file for fake citations, validate references in a paper, or audit bibliography entries for accuracy.From its SKILL.md

Install

npx -y skills add agentscope-ai/OpenJudge --skill bib-verify

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

runs commandsInstructs the agent to run 4 commands, including `pip install py-openjudge litellm` and 3 more.

SKILL.md

2.7 KB, 566 tokens by cl100k_base, as published. Nobody here has run it

BibTeX Verification Skill

Check every entry in a .bib file against real academic databases using the OpenJudge PaperReviewPipeline in BibTeX-only mode:

Parse — extract all entries from the .bib file
Lookup — query CrossRef, arXiv, and DBLP for each reference
Match — compare title, authors, year, and DOI
Report — flag each entry as verified, suspect, or not_found

Prerequisites

pip install py-openjudge litellm

Gather from user before running

Info	Required?	Notes
BibTeX file path	Yes	`.bib` file to verify
CrossRef email	No	Improves CrossRef API rate limits

Quick start

# Verify a standalone .bib file
python -m cookbooks.paper_review --bib_only references.bib

# With CrossRef email for better rate limits
python -m cookbooks.paper_review --bib_only references.bib --email [email protected]

# Save report to a custom path
python -m cookbooks.paper_review --bib_only references.bib \
  --email [email protected] --output bib_report.md

Relevant options

Flag	Default	Description
`--bib_only`	—	Path to `.bib` file (required for standalone verification)
`--email`	—	CrossRef mailto — improves rate limits, recommended
`--output`	auto	Output `.md` report path
`--language`	`en`	Report language: `en` or `zh`

Interpreting results

Each reference entry is assigned one of three statuses:

Status	Meaning
`verified`	Found in CrossRef / arXiv / DBLP with matching fields
`suspect`	Title or authors do not match any real paper — likely hallucinated or mis-cited
`not_found`	No match in any database — treat as fabricated

Field-level details are shown for suspect entries:

title_match — whether the title matches a real paper
author_match — whether the author list matches
year_match — whether the publication year is correct
doi_match — whether the DOI resolves to the right paper

Additional resources

Full pipeline options: ../paper-review/reference.md
Combined PDF review + BibTeX verification: ../paper-review/SKILL.md

What ships with it

Read from the repository

Just SKILL.md. No reference files, no scripts.