databricks-unstructured-pdf-generation

Generate synthetic PDF documents with JSON metadata for RAG evaluation.

Updated Mar 10, 2026
One-click install
npx skills add https://github.com/slysik/databricks-claude-coding --skill databricks-unstructured-pdf-generation-slysik
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-unstructured-pdf-generation
Source: https://github.com/slysik/databricks-claude-coding/tree/main/.claude/skills/databricks-unstructured-pdf-generation
Command: npx skills add https://github.com/slysik/databricks-claude-coding --skill databricks-unstructured-pdf-generation-slysik

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill automates the creation of realistic synthetic PDF documents, essential for developing and testing retrieval-augmented generation (RAG) systems and unstructured data workflows.

Core Features & Use Cases

  • Synthetic PDF Generation: Creates professional PDF documents with LLM-generated content.
  • RAG Evaluation Data: Generates accompanying JSON files with questions and evaluation guidelines for RAG testing.
  • Unity Catalog Integration: Automatically uploads generated PDFs and metadata to Databricks Unity Catalog Volumes.
  • Use Case: Generate 20 technical documentation PDFs for a new SaaS platform to build a robust RAG system for customer support.

Quick Start

Use the generate_pdf_documents MCP tool to create 10 technical documentation PDFs for a cloud infrastructure platform, saving them to the 'my_catalog' catalog and 'my_schema' schema.

Frequently Asked Questions about databricks-unstructured-pdf-generation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate synthetic PDFs for RAG testing?

To generate synthetic PDFs for RAG testing, this Skill uses the `generate_pdf_documents` MCP tool to create professional documents with LLM-generated content. It automatically uploads them to Databricks Unity Catalog Volumes for immediate use in retrieval-augmented generation workflows.

What is synthetic PDF generation for unstructured data use cases?

Synthetic PDF generation for unstructured data use cases is the automated creation of realistic documents and accompanying JSON metadata. It provides essential testing data, including questions and evaluation guidelines, to develop robust RAG systems without needing real-world data.

Can I customize the number and size of generated PDF documents?

Yes, you can customize the number and size of generated PDF documents. The generation process supports configuration of document count, content size, and specific storage locations within your Databricks Unity Catalog Volumes.

Does Databricks Unity Catalog support synthetic PDF metadata storage?

Yes, Databricks Unity Catalog supports synthetic PDF metadata storage. The Skill automatically uploads both the generated PDF documents and their accompanying JSON metadata files directly to Unity Catalog Volumes for centralized management.

What is the best way to create evaluation data for RAG systems?

The best way to create evaluation data for RAG systems is generating synthetic PDFs with accompanying JSON files. This approach provides LLM-generated content alongside structured questions and evaluation guidelines, ensuring comprehensive testing coverage for unstructured data workflows.