document-processing-generator

What problem does it solve?

This Skill automates the generation or modification of document processing pipelines for RAG (Retrieval-Augmented Generation), simplifying the extraction, embedding, and indexing of documents.

Core Features & Use Cases

• Document Extraction: Extract text from various document formats (PDF, DOCX, TXT, MD).
• Chunking and Embedding: Process extracted text into chunks and generate embeddings using OpenAI.
• Upsert in Qdrant: Store embeddings in Qdrant for efficient retrieval.
• Status Tracking: Track document processing status (PENDING, PROCESSING, COMPLETED/ERROR).
• Use Case: Ideal for supporting new file types, modifying chunking strategies, or debugging document processing issues.

Quick Start

Generate a new document processing pipeline for a new file type using the document-processing-generator skill with the argument 'new-type'.