spark-native-bronze

What problem does it solve?

This Skill provides a standardized, scalable, and efficient method for generating synthetic data and creating Bronze Delta tables in Databricks, replacing inefficient manual or library-based approaches.

Core Features & Use Cases

• Scalable Synthetic Data Generation: Creates large datasets (100K to 1M+ rows) using spark.range() for distributed performance.
• Canonical Bronze Pattern: Enforces best practices for Bronze table creation, including metadata columns and direct Delta Lake writes.
• Interview Demo Ready: Optimized for speed and clarity, making it ideal for demonstrating data engineering patterns in interviews.
• Use Case: Generate a 100,000-row retail transaction dataset for a Databricks interview demo, ensuring it's ready for downstream Silver and Gold transformations.

Quick Start

Use the spark-native-bronze skill to generate 100,000 synthetic events for the retail domain.