synthetic-data-generation
OfficialGenerate synthetic data for Spark on Databricks.
Authordatabricks-solutions
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill generates realistic synthetic data for Databricks workloads using Faker and Spark, enabling safe testing, demos, and data validation without exposing real customer data.
Core Features & Use Cases
- Generate master and related tables (customers, orders, tickets) with non-linear distributions, temporal patterns, and holiday effects.
- Save data to Databricks volumes as Parquet to support downstream SDP pipelines (bronze, silver, gold).
- Configure data size and date range to simulate varied analytics workloads and scenarios.
Quick Start
Run the data generation script to produce a synthetic dataset (e.g., 2,500 customers, 25,000 orders, 8,000 tickets) and write it to your Databricks volume. Install required libraries if missing: pip install faker holidays
Dependency Matrix
Required Modules
numpypandasfakerholidayspyspark
Components
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: synthetic-data-generation Download link: https://github.com/databricks-solutions/ai-dev-kit/archive/main.zip#synthetic-data-generation Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.