databricks-asset-bundles

Deploy Databricks resources using infrastructure as code by defining pipelines, dashboards, and jobs in a databricks.yml file and managing their deployment lifecycle across multiple environments. This enforces best practices for variable usage and path resolution.

The best way to manage Databricks jobs across dev and prod environments is to configure distinct deployment targets within your Databricks Asset Bundles. This allows you to define resources once and deploy them separately to development, staging, or production.

Scaffold a new Databricks Asset Bundle project with a recommended structure by generating the initial configuration files. This sets up the foundational project layout required to define and deploy resources like pipelines and applications.

Databricks Asset Bundles supports deploying Lakehouse dashboards and ETL pipelines together by allowing you to define both resources within the same configuration file. You can manage their deployment lifecycle simultaneously across your configured environments.

You need to use path resolution and variables in Databricks Asset Bundles because the system enforces these infrastructure-as-code best practices to ensure configurations remain dynamic, portable, and maintainable across different deployment targets like dev and prod.