databricks-asset-bundles

Create and manage Databricks Asset Bundles for multi-environment deployments.

3|Updated Jan 2, 2025
One-click install
npx skills add https://github.com/ScottHMcKean/genai_notebooks --skill databricks-asset-bundles-scotthmckean
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-asset-bundles
Source: https://github.com/ScottHMcKean/genai_notebooks/tree/main/.cursor/skills/databricks-asset-bundles
Command: npx skills add https://github.com/ScottHMcKean/genai_notebooks --skill databricks-asset-bundles-scotthmckean

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill streamlines the creation, configuration, and deployment of Databricks resources across multiple environments, ensuring consistency and best practices.

Core Features & Use Cases

  • Project Scaffolding: Generate new Databricks Asset Bundle (DAB) projects with recommended structures.
  • Resource Management: Add and configure various Databricks resources like pipelines, jobs, dashboards, and alerts within a bundle.
  • Multi-Environment Deployment: Define and manage distinct configurations for development, staging, and production environments.
  • Use Case: You need to deploy a new data pipeline and an associated dashboard to both a development and a production Databricks workspace. This Skill helps you define the DAB, configure environment-specific settings (like catalog and schema), and deploy both resources consistently.

Quick Start

Use the databricks-asset-bundles skill to validate the default target configuration for your bundle.

Frequently Asked Questions about databricks-asset-bundles

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I deploy Databricks jobs and pipelines to multiple environments?

You can deploy Databricks jobs and pipelines to multiple environments using Databricks Asset Bundles to define distinct development and production configurations within a single project. This enforces consistent path resolution and variable usage across workspaces.

What is infrastructure as code for Databricks and when do I need it?

Infrastructure as code for Databricks is the process of defining resources like pipelines and dashboards in configuration files. You need it when managing multi-environment deployments and enforcing best practices for path resolution and variable usage across workspaces.

How do I structure a new Databricks Asset Bundle project for CI/CD?

You structure a new Databricks Asset Bundle project for CI/CD by using project scaffolding to generate a recommended structure. This supports configuring resources like jobs and alerts alongside environment-specific settings such as catalog and schema.

Can I configure environment-specific variables for Databricks dashboards and alerts?

Yes, you can configure environment-specific variables for Databricks dashboards and alerts by defining distinct development and production modes. This enforces best practices for variable usage and path resolution within your asset bundle configuration.

Does Databricks Asset Bundles support deploying volumes and pipelines together?

Yes, Databricks Asset Bundles supports deploying volumes and pipelines together. You can add and configure these resources within a single bundle to ensure both are deployed consistently across your development and production target environments.