databricks-unstructured-pdf-generation

Generate synthetic unstructured PDF documents with JSON metadata for RAG evaluation in Databricks.

Updated Jan 30, 2026
One-click install
npx skills add https://github.com/teegin-g/Slopcast --skill databricks-unstructured-pdf-generation-teegin-g
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-unstructured-pdf-generation
Source: https://github.com/teegin-g/Slopcast/tree/main/.agents/skills/databricks-unstructured-pdf-generation
Command: npx skills add https://github.com/teegin-g/Slopcast --skill databricks-unstructured-pdf-generation-teegin-g

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Generate synthetic, unstructured PDF documents for testing, RAG workflows, and evaluation datasets within Databricks environments.

Core Features & Use Cases

  • Create realistic PDFs using an LLM-based approach guided by a description.
  • Produce accompanying JSON metadata (questions/guidelines) for RAG evaluation and optional upload to Unity Catalog volumes.
  • Use cases include building test corpora for retrieval systems, demos, and end-to-end RAG pipelines in Databricks.

Quick Start

Provide a high-level description of the PDFs you want and run the generate_pdf_documents MCP tool with catalog, schema, description, and count.

Frequently Asked Questions about databricks-unstructured-pdf-generation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate synthetic PDF documents for RAG evaluation in Databricks?

To generate synthetic PDF documents for RAG evaluation in Databricks, provide a high-level description and run the generate_pdf_documents MCP tool with your catalog, schema, and desired count to create realistic unstructured PDFs.

Can I create unstructured PDFs for RAG test datasets using an LLM?

You can create unstructured PDFs for RAG test datasets using an LLM-based approach guided by a description, which generates realistic documents alongside JSON metadata containing questions and guidelines for evaluation.

Does Databricks support generating PDF documents for retrieval benchmarking?

Databricks supports generating PDF documents for retrieval benchmarking by utilizing the generate_pdf_documents MCP tool to create test corpora within your data analytics environment for performance benchmarking.

How do I save generated PDFs to a specific location in Databricks?

To save generated PDFs to a specific location in Databricks, use the optional volume and folder parameters when running the generate_pdf_documents MCP tool to control output locations and optionally upload to Unity Catalog volumes.

What metadata is produced alongside synthetic PDFs for RAG workflows?

The synthetic PDF generation process produces accompanying JSON metadata containing questions and guidelines specifically designed for RAG evaluation and building end-to-end retrieval pipelines in Databricks.

What is the best way to build a test corpus for a Databricks RAG pipeline?

The best way to build a test corpus for a Databricks RAG pipeline is generating realistic unstructured PDFs using an LLM guided by a description, which provides test data for demos and performance benchmarking.