databricks-python-sdk

Guide developers in using the Databricks Python SDK, Connect, CLI, and REST API.

1|Updated Dec 15, 2025
One-click install
npx skills add https://github.com/lucaslessachaves/default --skill databricks-python-sdk-lucaslessachaves
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-python-sdk
Source: https://github.com/lucaslessachaves/default/tree/main/.claude/skills/databricks-python-sdk
Command: npx skills add https://github.com/lucaslessachaves/default --skill databricks-python-sdk-lucaslessachaves

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides practical guidance for using the Databricks Python SDK, including Databricks Connect, CLI, and REST API, to streamline development and automation on Databricks.

Core Features & Use Cases

  • Installation & setup: step-by-step guidance to install and configure Python SDKs and CLI for Databricks.
  • Authentication & access: patterns for environment-based, profile-based, and token-based authentication with the Databricks SDK.
  • Workflow patterns: examples covering workspace operations, cluster management, job orchestration, secret handling, and Unity Catalog interactions.
  • Use Case: automate an end-to-end workflow that creates a cluster, runs a job, and retrieves results via the SDK.

Quick Start

Install the Databricks Python SDK and Databricks Connect, then run a simple script to list clusters using WorkspaceClient.

Frequently Asked Questions about databricks-python-sdk

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I authenticate the Databricks Python SDK using environment variables and profiles?

You can automate Databricks cluster management and job orchestration via the Python SDK by using WorkspaceClient to programmatically create clusters, trigger job runs, and retrieve execution results in an end-to-end workflow script.

How do I install and configure Databricks Connect with the Python SDK?

Installing Databricks Connect and the Python SDK requires following step-by-step setup guidance to configure your local environment. Once configured, you can run local scripts connecting to remote Databricks clusters using WorkspaceClient.

Can I manage Unity Catalog and secrets using the Databricks REST API?

Yes, the Databricks SDK provides workflow patterns for Unity Catalog interactions and secure secret handling. You can programmatically access and manage data catalogs and secrets directly through the Python SDK or REST API endpoints.

What is the best way to troubleshoot Databricks CLI and Python SDK configuration errors?

Troubleshooting Databricks CLI and Python SDK errors involves following concrete setup steps and error handling patterns. The Skill provides specific troubleshooting steps addressing common API access, authentication, and configuration failures.

Does the Databricks Python SDK support workflow automation for real-world data projects?

Yes, the Databricks Python SDK supports workflow automation for real-world data projects by providing code patterns for workspace operations, cluster management, job orchestration, and data catalog interactions across Databricks environments.