paper-claim-audit

Verify quantitative claims in academic papers against raw result files.

2|Updated Aug 12, 2025
One-click install
npx skills add https://github.com/goupup-ai/miccai25 --skill paper-claim-audit-goupup-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: paper-claim-audit
Source: https://github.com/goupup-ai/miccai25/tree/main/ARIS/skills/paper-claim-audit
Command: npx skills add https://github.com/goupup-ai/miccai25 --skill paper-claim-audit-goupup-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Academic paper authors often accidentally misreport quantitative results due to confirmation bias, rounding errors, cherry-picking best seeds, or mismatched experiment configurations, leading to inaccurate claims that can invalidate research findings and cause submission rejections.

Core Features & Use Cases

  • Zero-context fresh reviewer audit: Uses a separate, context-free cross-model reviewer to compare paper claims against raw result files, eliminating executor confirmation bias.
  • Comprehensive claim checking: Verifies all numbers, percentages, comparisons, scope statements, and figure/table captions for accuracy, catching failure modes like number inflation, aggregation mismatches, and delta errors.
  • Use Case: Run this audit before submitting your MICCAI 2025 paper to ensure every reported metric exactly matches your raw experimental results, avoiding rejection due to data inaccuracies.

Quick Start

Use the paper-claim-audit skill to verify every numeric claim in your paper against the corresponding raw experimental result files.

Frequently Asked Questions about paper-claim-audit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify that quantitative claims in my paper match raw experimental results before submission?

To verify quantitative claims against raw result files, you need to audit paper .tex source files and raw JSON/CSV/YAML data to eliminate confirmation bias. This pre-submission check catches number inflation, cherry-picking, and aggregation errors by using a fresh zero-context cross-model reviewer to produce a structured per-claim verification report.

What is a zero-context fresh reviewer audit for academic papers?

A zero-context fresh reviewer audit uses a separate, context-free cross-model reviewer to compare paper claims against raw experimental data. This mechanism eliminates executor confirmation bias by independently verifying all numbers, percentages, and scope statements without prior exposure to the research context.

How do I check for best-seed cherry-picking and number inflation in computer vision research papers?

Checking for best-seed cherry-picking and number inflation requires comparing all reported metrics in your .tex source files against raw experimental result files. A comprehensive pre-submission audit verifies every number, percentage, and comparison to ensure exactly matched data and flags configuration mismatches.

Do I need .tex source files to perform a paper-to-data mismatch audit?

Yes, you need paper .tex source files and raw result JSON/CSV/YAML files to perform a paper-to-data mismatch audit. Access to these specific formats allows the reviewer to parse quantitative claims and exactly match them against raw experimental outputs to eliminate data misreporting.

What's the best way to audit scope overclaims and configuration mismatches for MICCAI submissions?

The best way to audit scope overclaims and configuration mismatches for MICCAI submissions is running a comprehensive pre-submission check that verifies all scope statements, figure captions, and table data against raw result files. This process outputs a structured audit report with per-claim verification status and an overall pass, warn, or fail verdict.

What types of data misreporting does a pre-submission paper audit catch?

A pre-submission paper audit catches data misreporting including number inflation, best-seed cherry-picking, configuration mismatches, aggregation errors, delta errors, and scope overclaims. It verifies all numbers, percentages, comparisons, and figure captions against raw experimental result files to prevent submission rejections.