databricks-unstructured-pdf-generation

Generate synthetic unstructured PDF documents with JSON metadata for RAG evaluation in Databricks.

Updated Jan 30, 2026
One-click install
npx skills add https://github.com/teegin-g/Slopcast --skill databricks-unstructured-pdf-generation-teegin-g
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-unstructured-pdf-generation
Source: https://github.com/teegin-g/Slopcast/tree/main/.agents/skills/databricks-unstructured-pdf-generation
Command: npx skills add https://github.com/teegin-g/Slopcast --skill databricks-unstructured-pdf-generation-teegin-g

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Generate synthetic, unstructured PDF documents for testing, RAG workflows, and evaluation datasets within Databricks environments.

Core Features & Use Cases

  • Create realistic PDFs using an LLM-based approach guided by a description.
  • Produce accompanying JSON metadata (questions/guidelines) for RAG evaluation and optional upload to Unity Catalog volumes.
  • Use cases include building test corpora for retrieval systems, demos, and end-to-end RAG pipelines in Databricks.

Quick Start

Provide a high-level description of the PDFs you want and run the generate_pdf_documents MCP tool with catalog, schema, description, and count.

Frequently Asked Questions about databricks-unstructured-pdf-generation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate synthetic PDF documents for RAG evaluation in Databricks?▼

To generate synthetic PDF documents for RAG evaluation in Databricks, provide a high-level description and run the generate_pdf_documents MCP tool with your catalog, schema, and desired count to create realistic unstructured PDFs.

Can I create unstructured PDFs for RAG test datasets using an LLM?▼

You can create unstructured PDFs for RAG test datasets using an LLM-based approach guided by a description, which generates realistic documents alongside JSON metadata containing questions and guidelines for evaluation.

Does Databricks support generating PDF documents for retrieval benchmarking?▼

Databricks supports generating PDF documents for retrieval benchmarking by utilizing the generate_pdf_documents MCP tool to create test corpora within your data analytics environment for performance benchmarking.

How do I save generated PDFs to a specific location in Databricks?▼

To save generated PDFs to a specific location in Databricks, use the optional volume and folder parameters when running the generate_pdf_documents MCP tool to control output locations and optionally upload to Unity Catalog volumes.

What metadata is produced alongside synthetic PDFs for RAG workflows?▼

The synthetic PDF generation process produces accompanying JSON metadata containing questions and guidelines specifically designed for RAG evaluation and building end-to-end retrieval pipelines in Databricks.

What is the best way to build a test corpus for a Databricks RAG pipeline?▼

The best way to build a test corpus for a Databricks RAG pipeline is generating realistic unstructured PDFs using an LLM guided by a description, which provides test data for demos and performance benchmarking.