databricks-python-sdk

Translate Databricks tasks into databricks-sdk-py usage with REST fallback.

1|Updated Apr 24, 2026
One-click install
npx skills add https://github.com/itsadijmbt/SecureMCP-Servers --skill databricks-python-sdk-itsadijmbt
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-python-sdk
Source: https://github.com/itsadijmbt/SecureMCP-Servers/tree/main/TEST_SERVERS/PORTED_TO_SECUREMCP/databrickslab-mcp/ai-dev-kit/databricks-skills/databricks-python-sdk
Command: npx skills add https://github.com/itsadijmbt/SecureMCP-Servers --skill databricks-python-sdk-itsadijmbt

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps you implement reliable Databricks workflows (clusters, jobs, SQL execution, Unity Catalog, serving, and vector search) by providing a practical, SDK-first reference so you don’t have to stitch together fragmented API docs and examples.

Core Features & Use Cases

  • Faster SDK-driven development: guidance for common Workspace API areas such as compute (clusters), jobs, SQL warehouses, statement execution, and Unity Catalog (tables, schemas, volumes).
  • Production-friendly operational patterns: covers authentication options, configuration defaults, pagination behavior, wait/async handling via *_and_wait and Wait objects, and basic error handling patterns.
  • Fallback to direct REST API: uses the SDK’s api_client.do() when an operation is not yet available or is awkward via higher-level SDK methods.
  • Real-world use case: create and manage a cluster, run a parameterized SQL statement on a warehouse, and then query results—optionally extending the workflow to catalogs/tables and model serving.

Quick Start

Use the databricks-python-sdk skill to generate a WorkspaceClient authentication setup and then run a parameterized SQL query against a warehouse using w.statement_execution.execute_statement().

Frequently Asked Questions about databricks-python-sdk

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I use the Databricks Python SDK to execute parameterized SQL statements on a warehouse?

To execute parameterized SQL statements on a warehouse with the Databricks Python SDK, instantiate a WorkspaceClient and call w.statement_execution.execute_statement(). You can then query the returned results directly within your local or production workflow.

What is the best way to manage Databricks clusters and jobs using the Python SDK?

The best way to manage Databricks clusters and jobs using the Python SDK is through the WorkspaceClient service clients. This approach automates development by translating common compute and job tasks into correct databricks-sdk-py usage with synchronous call patterns.

Can I use the Databricks Python SDK for Unity Catalog tables, schemas, and volumes?

Yes, you can use the Databricks Python SDK for Unity Catalog tables, schemas, and volumes. The SDK provides supported service clients that allow you to automate configurations and manage these catalog objects reliably within your workflows.

Does the Databricks Python SDK support vector search and model serving workflows?

Yes, the Databricks Python SDK supports vector search and model serving workflows. It translates these tasks into correct databricks-sdk-py usage, allowing you to integrate them into production workflows alongside compute and SQL operations.

How do I handle authentication when using databricks-sdk-py for local development and production?

To handle authentication when using databricks-sdk-py, specify your credentials via environment variables or named profiles. This configuration approach works for both local development with Databricks Connect and production workflows requiring synchronous SDK call patterns.

What should I do if a Databricks API endpoint is not supported by the higher-level Python SDK methods?

If a Databricks API endpoint is not supported by higher-level Python SDK methods, you should fall back to direct REST calls using api_client.do(). This allows you to execute unsupported operations while maintaining the WorkspaceClient authentication setup.