paper-review

Review academic papers for correctness, quality, and novelty from PDF or LaTeX sources.

775|63|Updated Jul 8, 2025
One-click install
npx skills add https://github.com/agentscope-ai/OpenJudge --skill paper-review-agentscope-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: paper-review
Source: https://github.com/agentscope-ai/OpenJudge/tree/main/skills/paper-review
Command: npx skills add https://github.com/agentscope-ai/OpenJudge --skill paper-review-agentscope-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires litellm, pypdfium2, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the complex and time-consuming process of reviewing academic papers, ensuring thoroughness and consistency in evaluation.

Core Features & Use Cases

  • Multi-stage Review: Conducts safety checks, correctness validation, quality assessment, and BibTeX verification.
  • Flexible Input: Supports both PDF files and LaTeX source packages (.tar.gz/.zip).
  • Use Case: A researcher needs to assess a submitted manuscript for a conference. They can use this Skill to get an initial evaluation covering technical accuracy, novelty, and reference integrity before human reviewers delve deeper.

Quick Start

Use the paper-review skill to evaluate the attached PDF file named 'my_research_paper.pdf'.

Frequently Asked Questions about paper-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate academic paper review for correctness and novelty?

To automate academic paper review, you can use this Skill to run a multi-stage pipeline that assesses technical correctness, evaluates quality, scores novelty, and verifies BibTeX references against external databases. It processes PDF and LaTeX source packages.

Can I check BibTeX references against external databases automatically?

Yes, you can check BibTeX references automatically. The review pipeline includes a specific stage that validates citations from the submitted manuscript against external databases to ensure reference integrity.

Does the paper review pipeline support LaTeX source packages?

Yes, the paper review pipeline supports LaTeX source packages in .tar.gz or .zip formats, alongside standard PDF files, allowing it to evaluate manuscripts directly from their original source files.

What is the best way to perform a safety check on a research manuscript?

Performing a safety check on a research manuscript is best handled through the initial stage of this multi-stage review pipeline, which screens for safety issues before proceeding to validate objective errors and assess quality.

How does the AI assess the criticality of objective errors in a paper?

The AI assesses the criticality of objective errors by evaluating validated mistakes within the manuscript's technical content. This multi-stage pipeline scores quality and novelty while specifically grading the severity and impact of identified issues.