unstructured-pdf-generation

Generate synthetic PDF documents with JSON evaluation files for RAG systems.

1|1|Updated Nov 9, 2025
One-click install
npx skills add https://github.com/Paldom/databricks-apps-streamlit-vibe-coding-starter --skill unstructured-pdf-generation-paldom
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: unstructured-pdf-generation
Source: https://github.com/Paldom/databricks-apps-streamlit-vibe-coding-starter/tree/main/.agents/skills/unstructured-pdf-generation
Command: npx skills add https://github.com/Paldom/databricks-apps-streamlit-vibe-coding-starter --skill unstructured-pdf-generation-paldom

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill automates the creation of realistic PDF documents and accompanying evaluation data, streamlining the process of populating knowledge bases and testing retrieval systems.

Core Features & Use Cases

  • Synthetic PDF Generation: Creates LLM-generated PDF documents based on detailed descriptions.
  • RAG Evaluation Data: Generates companion JSON files with question/guideline pairs for automated RAG pipeline evaluation.
  • Unity Catalog Integration: Automatically uploads generated files to Databricks Unity Catalog Volumes.
  • Use Case: Generate 20 technical documentation PDFs for a new software platform, complete with questions and answers, to populate a RAG system for internal developer support.

Quick Start

Use the unstructured-pdf-generation skill to create 10 HR policy documents for the 'ai_dev_kit' catalog and 'hr_demo' schema, saving them to the 'hr_policies' folder.

Frequently Asked Questions about unstructured-pdf-generation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate synthetic PDFs for RAG pipeline testing?

Generate synthetic PDFs for RAG by defining custom content descriptions and document size configurations. The Skill outputs LLM-generated unstructured PDF documents to facilitate RAG pipeline testing and knowledge base population.

Does this tool create evaluation data for RAG systems alongside the documents?

Yes, RAG evaluation data is generated as companion JSON files containing question and guideline pairs. These files enable automated evaluation of retrieval pipelines alongside the synthetic PDF documents.

Can I upload generated PDF documents directly to Unity Catalog Volumes?

Yes, synthetic PDF generation supports direct upload to Databricks Unity Catalog Volumes. You can specify the target catalog, schema, and folder path to automatically store the generated unstructured data.

What is the best way to populate a knowledge base with synthetic unstructured data?

The best way to populate a knowledge base with synthetic unstructured data is using LLM-generated PDFs with custom descriptions. This automates creating realistic technical or policy documents specifically for testing retrieval systems.

Do I need any dependencies to create LLM-generated PDFs for document generation?

No dependencies are required to create LLM-generated PDFs for document generation. The Skill operates independently to produce synthetic PDFs and JSON evaluation files for RAG systems.