skills.rest
xiaoyu-ops
xiaoyu-opsCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

literature-pdf-ocr-library

Discover academic papers, download open-access PDFs, and convert them to Markdown.

Updated Apr 1, 2026
Search Tags:#ocr#markdown#metadata#literature#arxiv#corpus#open-access
One-click install
npx skills add https://github.com/xiaoyu-ops/the_work_of_dedup --skill literature-pdf-ocr-library
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: literature-pdf-ocr-library
Source: https://github.com/xiaoyu-ops/the_work_of_dedup/tree/main/.claude/skills/literature-pdf-ocr-library
Command: npx skills add https://github.com/xiaoyu-ops/the_work_of_dedup --skill literature-pdf-ocr-library

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, pdfminer.six, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This tool helps researchers build a traceable, machine-readable literature corpus by discovering papers, downloading legally accessible PDFs, OCR'ing PDFs or page images into Markdown, and organizing results into a centralized knowledge base.

Core Features & Use Cases

  • Search across Open Access sources (arXiv, Semantic Scholar, OpenAlex, and Hugging Face daily papers) to locate relevant papers.
  • Download open-access PDFs and convert them to Markdown with PaddleOCR layout parsing (or fall back to pdfminer for text extraction).
  • Organize papers into a canonical library under .pipeline/literature/<corpus-name>/ with per-paper metadata, OCR manifests, and a consolidated library index for AI workloads.

Quick Start

Batch OCR a directory of PDFs into Markdown and generate a searchable literature library.

Frequently Asked Questions about literature-pdf-ocr-library

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert academic PDFs to Markdown for a research corpus?▼

This tool converts academic PDFs to Markdown using PaddleOCR layout parsing, falling back to pdfminer.six if no token is provided, outputting per-paper metadata and a consolidated library index.

How do I find and download open-access papers from arXiv automatically?▼

Find open-access papers by querying arXiv, Semantic Scholar, OpenAlex, and Hugging Face via API discovery. The workflow narrows topics, downloads legal PDFs, and OCRs them into Markdown.

What is the best way to build a traceable literature corpus from PDFs?▼

Build a traceable literature corpus by discovering papers, downloading open-access PDFs, and OCR-ing them to Markdown. It organizes outputs into a canonical library with per-paper metadata and a central index.

Do I need a PaddleOCR token to extract text from PDFs?▼

No, a PaddleOCR token is optional. The tool uses PaddleOCR for layout parsing when a token is provided, and automatically falls back to pdfminer.six for text extraction otherwise.

How does this tool organize OCR manifests and metadata for machine learning?▼

It organizes OCR manifests and paper metadata into a canonical library under .pipeline/literature/<corpus-name>/, generating a consolidated library index designed for AI workloads and machine-readable access.

Related Skills

Explore More Education & Research Skills→
jacardljacardl

arxiv

Query the arXiv REST API by keyword, author, category, or ID to retrieve paper metadata and PDF links.

Community
Intermediate
robertbr123robertbr123

qdrant-vector-search

Build and manage vector databases for RAG and semantic search with Qdrant.

Community
Advanced
SignmanalSignmanal
1

arxiv

Query the arXiv REST API for papers by keyword, author, category, or ID.

Community
Intermediate
vinayakgvinayakg

pdf

Extract text and tables from PDFs into JSON or CSV.

Community
Intermediate