Parse arXiv listing pages into structured paper metadata records.
npx skills add https://github.com/AgentComputerAI/torch --skill arxiv-agentcomputerai
Please help me install this Agent Skill. Skill: arxiv Source: https://github.com/AgentComputerAI/torch/tree/main/skills/sites/arxiv Command: npx skills add https://github.com/AgentComputerAI/torch --skill arxiv-agentcomputerai
arXiv listing pages are static HTML and straightforward to parse, but collecting consistent metadata across categories is tedious. It automates fetching and structuring listing data into reusable records for rapid analysis.
Activate this skill on an arXiv listing URL to fetch and parse the page into structured paper records.
High-intent search queries and answers about installing and using this skill.
Extracting metadata from arXiv listing pages involves fetching static HTML from /list/ and /abs/ URLs and parsing it into structured records. This process captures arXiv ID, title, authors, subjects, and URLs without client-side rendering.
Scraping arXiv paper data for a literature survey is best done by parsing static HTML listing pages into reusable records. This approach automates the collection of titles, authors, and subjects across categories to build a local index.
This arXiv HTML parser does not handle JavaScript rendering or anti-bot evasion. It uses a lightweight parsing approach designed exclusively for static HTML content found on standard arXiv listing and abstract pages.
You can capture all entries from an arXiv category listing by applying the optional pagination feature. This allows the parser to process multiple pages of static HTML to ensure complete data extraction for a category.
The structured arXiv records include specific data fields such as the arXiv ID, paper title, authors, subjects, and URLs. These are extracted directly from the parsed HTML to provide ready-to-use metadata.
chrisliu298Fetch arXiv papers by resolving IDs from URLs or bare IDs.
learningmatter-mitRetrieve ArXiv paper metadata using keyword, author, category, and title filters.
EurecaMomentClean and preprocess datasets using Data-Juicer tools.
brittaniebuffiecsuSearch, retrieve, and parse academic papers from the arXiv repository.
