What problem does it solve?
Azure Databricks provisioning and governance at scale: automates creation and configuration of workspaces, Unity Catalog governance, cluster and SQL warehouse setup, and security controls to enable consistent data platforms.
Core Features & Use Cases
- Workspace provisioning: create and configure Azure Databricks workspaces with standard governance guardrails.
- Unity Catalog governance: centralized data governance, catalogs, schemas, and access control across workspaces.
- Delta Lake & data lifecycle: manage Delta Lake tables, time travel, VACUUM, and optimized data layouts.
- MLflow integration: track experiments, model registries, and serving endpoints with Unity Catalog-backed registries.
- Jobs & workflows: orchestrate notebooks and jobs for end-to-end data pipelines.
- Security & secrets: manage secret scopes and access policies for secure workflows.
- CLI & automation: end-to-end provisioning via az databricks and databricks CLI.
Quick Start
Provision an Azure Databricks workspace with Unity Catalog using the az CLI and the Databricks CLI.