heavy-file-ingestion

Convert heavyweight files into markdown, CSV, and an index.

4.4k|856|Updated Mar 11, 2026
One-click install
npx skills add https://github.com/NateBJones-Projects/OB1 --skill heavy-file-ingestion-natebjones-projects
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: heavy-file-ingestion
Source: https://github.com/NateBJones-Projects/OB1/tree/main/skills/heavy-file-ingestion
Command: npx skills add https://github.com/NateBJones-Projects/OB1 --skill heavy-file-ingestion-natebjones-projects

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pdfplumber, python-docx, python-pptx, openpyxl, markitdown, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Heavy File Ingestion prevents agents from wasting costly model context and tokens on raw, heavyweight files by converting PDFs, slide decks, spreadsheets, and documents into cheaper, structured artifacts and a small quality-aware index before any reasoning step.

Core Features & Use Cases

  • Deterministic-first conversion to markdown for documents and presentations, CSV per sheet for spreadsheets, and simple text copies for plain files.
  • Automatic index generation with counts, preview lines, quality flags, and a recommended next step so the main agent can decide whether escalation is warranted.
  • Use case: run the converter on a large vendor invoice PDF or multi-sheet workbook to produce a markdown or CSV artifact plus an index that guides efficient summarization or extraction.

Quick Start

Run the bundled converter on the source file, inspect the generated index.md to decide whether to read the extracted artifact or escalate to a stronger converter or model.

Frequently Asked Questions about heavy-file-ingestion

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert PDFs and DOCX files into markdown for AI agents?

Convert PDFs and DOCX files into markdown using local deterministic converters like pdfplumber and python-docx. The process extracts structured text and generates markdown artifacts alongside an index to minimize token consumption during agent processing.

Why does feeding large spreadsheets directly to an agent waste context?

Feeding large spreadsheets wastes context because raw XLSX and CSV files contain verbose formatting that consumes excessive tokens. Converting them to per-sheet CSV artifacts with a lightweight index prevents wasting costly model context before any reasoning step begins.

Can I extract text from PPTX slide decks for automated summarization?

Yes, you can extract text from PPTX slide decks for automated summarization using the python-pptx library. The converter transforms presentation content into markdown, allowing agents to efficiently read and summarize slides without processing raw binary formats.

Do I need markitdown installed to convert heavy files for agents?

markitdown is an optional tool for converting heavy files for agents. The Skill relies primarily on deterministic local converters like pdfplumber, python-docx, python-pptx, and openpyxl, using markitdown as an optional escalation path when needed.

What is the best way to index large vendor invoices for token-efficient extraction?

The best way to index large vendor invoices is converting the source PDF into markdown or CSV, then generating an index.json with counts, preview lines, and quality flags. This allows the main agent to decide whether to read extracted artifacts or escalate to a stronger model.

When should I not use automated file conversion before processing attachments?

You should avoid automated file conversion when the source file is already lightweight plain text, or when precise layout rendering is critical. The converter produces quality flags in the index to indicate when extraction may be insufficient and escalation to a stronger model is warranted.