gold-layer-setup

To automate Gold layer table creation from YAML in Databricks, you need a tool that generates DDL, merge scripts, and job configurations directly from schema definitions. This Skill orchestrates that end-to-end process, including Silver-to-Gold MERGE operations and Databricks Asset Bundle deployment.

Implementing SCD Type 1 and Type 2 merges in Delta Lake requires automated MERGE operations from source to target tables. This Skill handles SCD Type 1/2 logic, fact aggregation, and snapshot merges directly from YAML designs to ensure data consistency.

Applying foreign key constraints in a Databricks Gold layer is best handled during table creation and merge orchestration. This Skill automates FK application and validates Silver contracts to ensure referential integrity before Gold layer deployment.

Yes, you can use YAML schema definitions to generate Databricks Asset Bundle jobs. This Skill translates YAML files into production-ready deployment configurations, automating the orchestration of table creation and Silver-to-Gold merge operations.

Validating Silver layer contracts before building Gold tables requires schema and grain checks against source data. This Skill performs automated Silver contract validation to ensure data integrity before executing Gold layer merge operations.

No, this Gold layer setup tool requires existing Silver layer tables. It validates Silver contracts and performs Silver-to-Gold MERGE operations, meaning the Silver layer must be implemented and populated before orchestrating Gold table creation.