skills.rest
mkgs-databricks-demos
mkgs-databricks-demosOFFICIAL
Explore all skills by this author →
GitHub

databricks-dbsql

Execute procedural SQL, MERGE upserts, and recursive queries in Databricks DBSQL.

1|1|Updated Oct 1, 2025
Search Tags:#databricks#materialized-views#dbsql#recursive-cte#ai-functions#sql-scripting#remote_query
One-click install
npx skills add https://github.com/mkgs-databricks-demos/synthea-on-fhir --skill databricks-dbsql-mkgs-databricks-demos
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-dbsql
Source: https://github.com/mkgs-databricks-demos/synthea-on-fhir/tree/main/.cursor/skills/databricks-dbsql
Command: npx skills add https://github.com/mkgs-databricks-demos/synthea-on-fhir --skill databricks-dbsql-mkgs-databricks-demos

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

DBSQL provides a consolidated toolkit of advanced features (procedural SQL, stored procedures, recursive CTEs, materialized views, Geospatial and AI functions) to accelerate analytics and automate data workflows in Databricks.

Core Features & Use Cases

  • Procedural SQL scripting for ETL, data cleansing, and orchestration.
  • Support for stored procedures, transactions, and multi-step workflows.
  • Advanced SQL features like Recursive CTEs, Materialized Views, and Pipe syntax to simplify complex transformations.
  • Built-in AI functions, HTTP requests, remote queries, and read_files for data enrichment and federation.
  • Geospatial and collation capabilities for spatial analytics and locale-aware processing.
  • Use Case: Build end-to-end data pipelines that ingest, enrich, and summarize data for BI dashboards.

Quick Start

Start by enabling a serverless SQL warehouse and loading the DBSQL skill to run sample queries.

Frequently Asked Questions about databricks-dbsql

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I write procedural ETL pipelines using SQL scripting in Databricks?▼

Procedural ETL pipelines in Databricks use DBSQL scripting for multi-step workflows, data cleansing, and orchestration. Stored procedures and transactions automate complex transformations directly within a serverless SQL warehouse environment.

Can I query recursive hierarchies and complex transformations with Databricks SQL?▼

Recursive hierarchies and complex transformations are supported in Databricks SQL through Recursive CTEs, Materialized Views, and Pipe syntax. These advanced SQL features simplify hierarchical data queries and structural data transformations.

Do I need a serverless SQL warehouse to use AI functions and remote queries in Databricks?▼

AI functions and remote queries require a Databricks serverless SQL warehouse with Unity Catalog enabled. This environment provides necessary access to Delta tables and Lakehouse data for executing external data federation and HTTP requests.

What is the best way to enrich data and access external sources via Databricks SQL?▼

The best way to enrich data in Databricks SQL involves built-in AI functions, HTTP requests, remote queries, and read_files. These features enable seamless external data access and federation without leaving the SQL environment.

How do I handle geospatial analysis and upserts using Databricks SQL?▼

Geospatial analysis and locale-aware processing are handled using Databricks SQL collation and geospatial capabilities. Data upserts utilize the MERGE statement to update and insert Delta table records efficiently.

Why use Materialized Views for summarizing data in Databricks?▼

Materialized Views in Databricks pre-compute and summarize complex query results to accelerate BI dashboard performance. They simplify transformations by caching intermediate results for repeated analytical querying.

Related Skills

Explore More Data & Analytics Skills→
ThomazRossitoThomazRossito
31

databricks-dbsql

Extend Databricks SQL with procedural scripts, stored procedures, and recursive queries.

Community
Advanced
jkitchinjkitchin
34

scientific-reviewer

Identify and evaluate claims and supporting evidence in scientific documents.

Community
Advanced
tomztomz

azure-databricks

Provision Azure Databricks workspaces with Unity Catalog governance via az CLI.

Community
Advanced
erichowenserichowens
181

data-pipeline-engineer

Automate ETL/ELT pipeline design, validation, and operation across medallion architectures.

Community
Advanced