databricks-python-sdk

Manage Databricks resources programmatically with the Python SDK, CLI, and REST APIs.

1|1|Updated Oct 1, 2025
One-click install
npx skills add https://github.com/mkgs-databricks-demos/synthea-on-fhir --skill databricks-python-sdk-mkgs-databricks-demos
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-python-sdk
Source: https://github.com/mkgs-databricks-demos/synthea-on-fhir/tree/main/.cursor/skills/databricks-python-sdk
Command: npx skills add https://github.com/mkgs-databricks-demos/synthea-on-fhir --skill databricks-python-sdk-mkgs-databricks-demos

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

The Databricks Python ecosystem can be complex to navigate; this skill bundles guidance for using the Python SDK, Databricks Connect for local Spark development, the Databricks CLI, and REST API access to streamline automation and integration.

Core Features & Use Cases

  • Python SDK usage for programmatic access to workspaces, clusters, jobs, SQL warehouses, Unity Catalog, and serving endpoints.
  • Local development and automation with Databricks Connect, CLI workflows, and robust authentication patterns.
  • Reference-ready code snippets, architectural guidance, and end-to-end patterns for common Databricks tasks.

Quick Start

Install the Databricks Python SDK and follow the guidance to connect to your Databricks workspace, then run a sample script to list clusters.

Frequently Asked Questions about databricks-python-sdk

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I manage Databricks clusters and jobs using Python?

You can programmatically manage Databricks clusters and jobs using the Python SDK. It provides reference-ready code snippets and architectural patterns for automating typical workspace workflows.

What is the best way to set up local Spark development with Databricks Connect?

Databricks Connect enables local Spark development by connecting your local environment to a Databricks workspace. This skill provides setup guidance and configuration patterns to streamline local development and automation.

How do I authenticate Python SDK requests to a Databricks workspace?

Authenticating Python SDK requests requires configuring robust authentication patterns for your Databricks workspace. The skill covers various authentication options to securely connect and run sample scripts.

Can I use the Databricks REST API to manage Unity Catalog and SQL warehouses?

Yes, the Databricks REST API and Python SDK support programmatic access to manage Unity Catalog, SQL warehouses, and model serving endpoints. This skill provides end-to-end patterns for these integrations.

Does the Databricks CLI work with Python SDK workflows for automation?

The Databricks CLI integrates with Python SDK workflows to streamline automation and local development. This skill covers CLI workflows and provides guidance for combining them with SDK access to manage resources.

Why use the Python SDK instead of the REST API for Databricks automation?

The Python SDK simplifies Databricks automation by providing native Python interfaces for clusters, jobs, and Unity Catalog, avoiding direct REST API calls. It offers reference-ready code snippets for common tasks.