databricks-unstructured-pdf-generation

Generate synthetic PDFs with JSON metadata for RAG evaluation and upload to Unity Catalog Volumes.

Updated Mar 10, 2026
One-click install
npx skills add https://github.com/robkisk/coding-agents-databricks-app --skill databricks-unstructured-pdf-generation-robkisk
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-unstructured-pdf-generation
Source: https://github.com/robkisk/coding-agents-databricks-app/tree/main/.claude/skills/databricks-unstructured-pdf-generation
Command: npx skills add https://github.com/robkisk/coding-agents-databricks-app --skill databricks-unstructured-pdf-generation-robkisk

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the creation of realistic synthetic PDF documents, streamlining the process of generating test data for Retrieval-Augmented Generation (RAG) systems and unstructured data use cases.

Core Features & Use Cases

  • Synthetic PDF Generation: Creates professional PDF documents with LLM-generated content based on user-defined descriptions.
  • RAG Evaluation Data: Accompanies PDFs with JSON files containing questions and evaluation guidelines, ideal for testing retrieval systems.
  • Unity Catalog Integration: Automatically uploads generated documents to specified Unity Catalog Volumes.
  • Use Case: Generate 15 technical documentation PDFs for a cloud infrastructure platform to build a robust RAG system for internal knowledge base.

Quick Start

Use the generate_pdf_documents tool to create 10 technical documentation PDFs for a cloud infrastructure platform, saving them to the 'ai_dev_kit' catalog and 'tech_docs' schema.

Frequently Asked Questions about databricks-unstructured-pdf-generation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate synthetic PDF documents for testing a RAG system?

You generate synthetic PDFs for RAG testing by defining content descriptions, which the tool uses to create documents and accompanying JSON metadata containing evaluation questions and guidelines.

Does this tool upload generated PDFs directly to Databricks Unity Catalog?

Yes, the tool integrates with Unity Catalog to automatically upload generated synthetic PDF documents to specified catalog volumes and schemas for immediate access.

Can I control the size and volume placement of synthetic unstructured data?

Yes, you can control document size and specify custom volume and folder placement for generated synthetic PDFs to match your unstructured data application requirements.

What is the best way to create evaluation datasets for unstructured data retrieval?

Creating evaluation datasets involves generating PDFs alongside JSON files that contain retrieval questions and guidelines, providing structured test data to evaluate unstructured data retrieval performance.

Do I need an LLM to generate synthetic PDFs for Databricks?

Yes, the tool relies on LLM-driven content creation to produce realistic synthetic PDF documents based on your provided descriptions for Databricks RAG applications.