extract-from-pdfs

Extract structured data from scientific PDFs and export to Python, R, Excel, CSV, or SQLite.

12|1|Updated Oct 17, 2025
One-click install
npx skills add https://github.com/brunoasm/my_claude_skills --skill extract-from-pdfs
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: extract-from-pdfs
Source: https://github.com/brunoasm/my_claude_skills/tree/main/extract_from_pdfs
Command: npx skills add https://github.com/brunoasm/my_claude_skills --skill extract-from-pdfs

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires anthropic>=0.40.0, pybtex>=0.24.0, rispy>=0.6.0, json-repair>=0.25.0, jsonschema>=4.20.0, pandas>=2.0.0, openpyxl>=3.1.0, pyreadr>=0.5.0, requests>=2.31.0, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill turns large collections of scientific PDFs into structured data ready for meta-analyses, systematic reviews, and database creation, automating extraction, validation, enrichment, and export.

Core Features & Use Cases

  • Organize metadata from BibTeX, RIS, directories, or DOI lists
  • Filter papers by abstract (Claude or local models) to focus on relevant literature
  • Extract structured data from full PDFs using Claude's vision capabilities
  • Repair and validate outputs, enrich with external databases, and export to Python, R, CSV, Excel, or SQLite
  • Use case: conduct a rapid systematic review across hundreds of papers

Quick Start

Start by preparing your metadata and extraction schema, then run the 6-step pipeline as outlined in the repository workflow. Example files are provided in assets; to kick off the pipeline, run the steps in sequence: 01_organize_metadata.py, 02_filter_abstracts.py, 03_extract_from_pdfs.py, 04_repair_json.py, 05_validate_with_apis.py, and 06_export_database.py.

Frequently Asked Questions about extract-from-pdfs

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from scientific PDFs at scale?

Extract structured data from scientific PDFs using Claude's vision capabilities combined with configurable schemas, abstract filtering, and JSON repair. The workflow handles bulk PDF collections, applies your extraction schema to each document, validates outputs, and exports results to Python, R, Excel, CSV, or SQLite formats.

Can I filter papers by abstract before extracting full PDF content?

Yes. Filter papers by abstract using Claude or local models to focus extraction on relevant literature, reducing processing time and costs. This filtering step runs before full PDF extraction in the pipeline.

What metadata formats can I organize for PDF extraction workflows?

Organize metadata from BibTeX, RIS files, DOI lists, or directory structures. The pipeline reads these formats, standardizes the metadata, and uses it to coordinate extraction and enrichment across your PDF collection.

How do I validate and repair extracted data from PDFs?

Validate and repair extracted JSON using schema validation and JSON repair functions, then enrich with external databases. The pipeline includes dedicated steps for JSON repair and API validation before final export.

What's the best way to conduct a systematic review across hundreds of papers?

Automate systematic review workflows by organizing metadata, filtering abstracts, extracting structured data from PDFs using Claude vision, repairing and validating outputs, and exporting to analysis-ready formats. This end-to-end pipeline reduces manual effort on large literature collections.

Do I need to write code to use PDF extraction with Claude and external databases?

The workflow includes Python scripts for each stage—metadata organization, abstract filtering, PDF extraction, JSON repair, API validation, and database export—so you configure schemas and run steps sequentially rather than writing extraction logic from scratch.