skills.rest
lth0
lth0COMMUNITY
Explore all skills by this author →
GitHub

keyword-literature-download

Search scholarly databases for keywords and download legally accessible PDFs.

Updated May 15, 2026
Search Tags:#deduplication#literature search#open access#research workflow#pdf downloading#keyword queries
One-click install
npx skills add https://github.com/lth0/codexSkill --skill keyword-literature-download
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: keyword-literature-download
Source: https://github.com/lth0/codexSkill/tree/main/skills/codex/keyword-literature-download
Command: npx skills add https://github.com/lth0/codexSkill --skill keyword-literature-download

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pandas, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Researchers often spend days manually searching across multiple scholarly databases and then chasing down legally accessible full-text PDFs, which delays literature reviews, proposals, and gap-finding work.

Core Features & Use Cases

  • Keyword-driven multi-source search: queries run against PubMed/PMC, Europe PMC, Crossref, and OpenAlex to assemble a broad candidate set for any English or Chinese topic.
  • Priority scoring + candidate tables: ranks candidates using include/secondary/exclude term hits, publication-type signals, and metadata signals to produce high/medium-priority tables.
  • Legally accessible PDF downloading with guardrails: parallel downloads save only true PDFs (verified by PDF signature) to a PDF-only folder while caching HTML/XML helper files separately for later second-pass PDF link discovery.
  • Resume + second-pass PDF chasing: continues pending downloads and attempts to extract additional PDF links from cached auxiliary HTML pages.
  • Deduplication for clean PDF collections: deduplicates the final PDF set using DOI, normalized title, and file hashes, producing a deduplicated PDF-only folder and manifest.

Quick Start

Request a keyword literature harvest by saying: “Use $keyword-literature-download with my topic keywords to search PubMed/PMC, Europe PMC, Crossref, and OpenAlex, rank candidates, download only legally accessible PDFs into my PDF output folder, chase missing PDFs from cached HTML, then deduplicate the final PDFs and produce the candidate and download reports.”

Frequently Asked Questions about keyword-literature-download

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I batch download open access PDFs for a literature review?▼

To batch download open access PDFs for a literature review, you can harvest scholarly literature across PubMed/PMC, Europe PMC, Crossref, and OpenAlex using keyword queries, automatically verifying and saving only legally accessible full-text PDFs.

Can I search PubMed and OpenAlex together and save the full-text PDFs?▼

Yes, you can search PubMed and OpenAlex together to assemble a broad candidate set, rank candidates by publication-type signals, and save true full-text PDFs into a dedicated, deduplicated PDF-only collection.

What is the best way to deduplicate downloaded research papers by title and DOI?▼

The best way to deduplicate downloaded research papers by title and DOI is to validate file signatures during parallel downloading and apply DOI, normalized title, and file hash-based deduplication to produce a clean PDF manifest.

How to find missing PDFs from cached HTML pages during literature harvesting?▼

To find missing PDFs from cached HTML pages during literature harvesting, a second-pass PDF chasing mechanism attempts to extract additional PDF links from separately cached auxiliary HTML/XML helper files.

Does this literature search workflow handle interrupted PDF downloads?▼

Yes, this literature search workflow handles interrupted PDF downloads by featuring a resume capability that continues pending downloads and robust logging to track the status of legally accessible full-text PDF retrieval.

Do I need pandas to run keyword queries for research papers?▼

Yes, you need pandas installed to run keyword queries for research papers, as the two-phase pipeline relies on this dependency to process metadata and generate candidate and download reports.

Related Skills

Explore More Education & Research Skills→
zhongzhxzhongzhx
70

keyword-research-harvest

Automate keyword-driven literature harvesting from PubMed, Europe PMC, Crossref, and OpenAlex.

Community
Advanced
ManfronEnricoManfronEnrico

literature-review

Conduct multi-database literature searches and synthesize findings into Markdown and PDF reports.

Community
Advanced
skytiger6724skytiger6724
2

pdf

Extract text, tables, and metadata from PDF files using pypdf and pdfplumber.

Community
Intermediate
WILLOSCARWILLOSCAR
497

agent-survey-corpus

Download open-access arXiv survey PDFs and extract text for style analysis.

Community
Basic