Verified:Website 𝕏@cameronraysmith GitHub

doc-to-md

Convert PDF or arXiv LaTeX documents into structured markdown repositories.

14|Updated May 28, 2024

Search Tags:#markdown conversion #arxiv #pdf to markdown #research documentation #scholarly documents #latex to markdown

Ready to run

npx skills add https://github.com/cameronraysmith/vanixiets --skill doc-to-md

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: doc-to-md
Source: https://github.com/cameronraysmith/vanixiets/tree/main/modules/home/ai/skills/src/core/doc-to-md
Command: npx skills add https://github.com/cameronraysmith/vanixiets --skill doc-to-md

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pandoc, git-lfs, curl, uv, tiktoken, gh-cli, ntfy-cli, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill automates the conversion of scholarly documents (papers, books) from various sources like PDF or arXiv LaTeX into a structured, modular markdown repository, making research more accessible and manageable.

Core Features & Use Cases

Source Conversion: Converts scholarly references from PDF or arXiv LaTeX into markdown.
Structured Output: Organizes content into modular markdown files with indexed sections, a README, and token counts.
Use Case: A researcher can input an arXiv ID and a local PDF of a paper, and the Skill will generate a well-organized markdown repository ready for further analysis or documentation.

Quick Start

Convert the scholarly paper referenced by '10.1109/CVPR.2023.00042' into a markdown repository.

Frequently Asked Questions about doc-to-md

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I convert an arXiv LaTeX source to markdown?▼

To convert arXiv LaTeX to markdown, this Skill uses pandoc to transform the source into structured, modular markdown files. It extracts metadata and generates a README with token counts, organizing the scholarly document for further analysis.

What is the best way to convert a research PDF to markdown?▼

The best way to convert a research PDF to markdown is using marker-pdf for local extraction. This Skill processes the PDF into modular markdown files, indexes sections, and initializes a Git repository with LFS configuration for large assets.

Does this PDF to markdown conversion tool require git-lfs?▼

Yes, the PDF to markdown conversion process requires git-lfs to handle large file storage. It initializes a Git repository and configures LFS to manage the original PDF assets alongside the generated markdown files.

Can I convert scholarly documents into a modular markdown repository?▼

Yes, you can convert scholarly documents into a modular markdown repository. The Skill extracts content from PDFs or arXiv LaTeX, organizes it into indexed section files, and supports optional aggregation into a larger repository structure.

How does token counting work for converted markdown files?▼

Token counting for converted markdown files uses tiktoken to calculate token counts for each generated section. These counts are included in the generated README, providing researchers with immediate metrics for context window planning.

What are the limitations of converting PDFs to markdown with pandoc?▼

Pandoc is used exclusively for LaTeX to markdown conversion, not PDF. For local PDF conversion, the Skill relies on marker-pdf instead, ensuring accurate extraction of scholarly text into the structured markdown repository format.