benchmark-extractor

Extract benchmark datasets, metrics, baselines, and SOTA claims from academic paper PDFs.

330|25|Updated Apr 5, 2026
One-click install
npx skills add https://github.com/chtc66/academic-skills --skill benchmark-extractor
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: benchmark-extractor
Source: https://github.com/chtc66/academic-skills/tree/main/benchmark-extractor
Command: npx skills add https://github.com/chtc66/academic-skills --skill benchmark-extractor

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires python, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the challenge of manually extracting and organizing benchmark information from academic papers, streamlining the process and enhancing efficiency.

Core Features & Use Cases

  • Benchmark Information Extraction: Automatically extract structured information from academic papers, including tasks, datasets, metrics, baselines, and SOTA claims.
  • Output Modes: Provides both a summary and a detailed comparison table for easy analysis.
  • Use Case: Ideal for researchers or students who need to quickly analyze benchmark data across multiple papers to inform their work.

Quick Start

Utilize the benchmark-extractor skill to generate a benchmark comparison table from a set of provided PDFs.

Frequently Asked Questions about benchmark-extractor

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract benchmark information from academic papers automatically?

You can extract SOTA claims and baselines from academic papers using this Skill to automate structured information extraction. It processes provided PDFs to identify and organize state-of-the-art claims, baseline models, and evaluation metrics into a structured comparison table.

Can I generate a benchmark comparison table from multiple PDFs?

Yes, generating a benchmark comparison table from multiple PDFs is the core use case. The Skill processes academic papers to output structured formats like tables and JSON, summarizing datasets and metrics across documents for easy comparative analysis.

Do I need Python to extract structured information from research papers?

Yes, Python is required to extract structured information from research papers. The Skill utilizes Python scripts to process PDFs and generate structured output formats like tables and JSON for benchmark extraction.

What is the best way to organize datasets and metrics from research papers?

The best way to organize datasets and metrics from research papers is using this Skill to extract structured information. It automatically targets dataset and metric details, outputting them as structured JSON or comparison tables for streamlined academic analysis.

What output formats are supported for benchmark extraction from PDFs?

Supported output formats for benchmark extraction include tables and JSON. The Skill processes your academic PDFs to generate both a quick summary and a detailed comparison table containing the structured benchmark data.

Does this tool work for comparative analysis of SOTA claims across papers?

Yes, this tool works for comparative analysis of SOTA claims across papers. It specifically targets researchers requiring quick access to SOTA claims, baselines, and metrics, generating detailed comparison tables to inform your work.