paper-claim-audit

Verify quantitative paper claims against raw result files.

2|1|Updated Apr 19, 2026
One-click install
npx skills add https://github.com/raja21068/AutoResearch --skill paper-claim-audit-raja21068
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: paper-claim-audit
Source: https://github.com/raja21068/AutoResearch/tree/main/skills/aris/paper-claim-audit
Command: npx skills add https://github.com/raja21068/AutoResearch --skill paper-claim-audit-raja21068

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Prevents paper-to-evidence mismatch by checking that every quantitative claim in a manuscript exactly matches raw result files, with a zero-context reviewer to avoid confirmation bias.

Core Features & Use Cases

  • Zero-context paper-to-evidence audit: Extracts every number, percentage, comparison, and scope statement from the paper and traces it to raw metrics/config files.
  • Rounding and arithmetic integrity: Flags rounding drift, best-seed cherry-picking, delta miscalculation, and aggregation/run-count mismatches.
  • Strict input hygiene: Uses only paper .tex sources and raw results/config artifacts while excluding executor summaries and prior audit narratives.

Quick Start

Ask the system to run paper-claim-audit on your paper directory (for example, before submission or after paper-writing) to generate PAPER_CLAIM_AUDIT.md and PAPER_CLAIM_AUDIT.json with a PASS/WARN/FAIL verdict.

Frequently Asked Questions about paper-claim-audit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify that quantitative claims in my paper match raw experiment results?

To verify paper claims against raw evidence, use a zero-context audit that extracts every number, percentage, and comparison from your manuscript and traces it to raw metrics and config files. This ensures exact matching and flags rounding drift or aggregation mismatches.

Can I check for rounding and arithmetic integrity issues in my manuscript before submission?

Yes, a paper claim audit checks rounding and arithmetic integrity by flagging rounding drift, best-seed cherry-picking, delta miscalculation, and aggregation or run-count mismatches against declared raw result files. This applies to manuscript submission readiness and post-writing reconciliation.

What is a zero-context paper-to-evidence audit and how does it prevent confirmation bias?

A zero-context paper-to-evidence audit uses a fresh review thread to extract every quantitative claim and scope statement from your paper, then traces it to raw result files. This prevents confirmation bias by avoiding prior summaries and narratives during verification.

Do I need LaTeX source files to run a paper claim audit?

Yes, the audit requires strict input hygiene using your paper .tex sources and raw results or config artifacts. It excludes executor summaries and prior audit narratives to ensure numbers, rounding, configs, and run counts are reconciled against declared result files only.

What does a paper claim audit output after checking my manuscript numbers?

The audit generates PAPER_CLAIM_AUDIT.md and PAPER_CLAIM_AUDIT.json files containing a PASS, WARN, or FAIL verdict. These outputs document whether every quantitative claim in your manuscript exactly matches the corresponding raw result evidence.

When should I run a paper-to-evidence reconciliation check?

You should run a paper-to-evidence reconciliation check during manuscript submission readiness, post–paper-writing reconciliation, and before or after improvement loops that may change metrics, tables, or captions. This ensures every quantitative claim matches raw evidence.