skills.rest
thbeh
thbehCOMMUNITY
Explore all skills by this author →
GitHub

databricks-python-sdk

Guide Databricks development using Python SDK, Connect, CLI, and REST APIs.

Updated May 31, 2026
Search Tags:#cli#rest api#spark#python sdk#databricks
One-click install
npx skills add https://github.com/thbeh/coding-agents-databricks-apps --skill databricks-python-sdk-thbeh
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-python-sdk
Source: https://github.com/thbeh/coding-agents-databricks-apps/tree/main/.claude/skills/databricks-python-sdk
Command: npx skills add https://github.com/thbeh/coding-agents-databricks-apps --skill databricks-python-sdk-thbeh

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires databricks, databricks-connect, uv, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides comprehensive guidance and automation for Databricks development, simplifying Python SDK usage, Databricks Connect, CLI operations, and REST API interactions.

Core Features & Use Cases

  • SDK Documentation Access: Offers access to the SDK documentation for detailed reference.
  • Configuration Guidance: Provides setup instructions for virtual environments, configuration files, and environment variables.
  • Databricks Connect: Facilitates Spark operations locally against Databricks clusters.
  • REST API Access: Allows direct manipulation of Databricks resources via REST API.
  • CLI Usage: Includes examples for common CLI commands to manage clusters, jobs, and files.
  • Use Case: When developing a Databricks application, use this Skill to set up your environment, execute Spark code, and interact with Databricks APIs.

Quick Start

Use the databricks-python-sdk skill to connect to your Databricks workspace with the default profile.

Frequently Asked Questions about databricks-python-sdk

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I use the Databricks Python SDK to automate Spark operations locally?▼

To automate Spark operations locally with the Databricks Python SDK, you must configure Databricks Connect to execute Spark code against remote Databricks clusters. The Skill provides setup guidance for virtual environments and configuration files to facilitate this local execution.

What's the best way to manage Databricks clusters and jobs using the CLI?▼

Managing Databricks clusters and jobs is best handled using the Databricks CLI, which allows direct resource manipulation. The Skill includes examples of common CLI commands to help you manage clusters, jobs, and files efficiently.

How do I set up environment variables for Databricks REST API access?▼

Setting up environment variables for Databricks REST API access requires configuring your workspace credentials and profile settings. The Skill offers detailed configuration guidance for environment variables and configuration files to authenticate REST API requests.

Does Databricks Connect work with the Python SDK for local development?▼

Yes, Databricks Connect works with the Python SDK to enable local Spark operations against Databricks clusters. You need to install both the Databricks Python SDK and Databricks Connect dependencies to facilitate this local development workflow.

Why do I need Databricks Connect to run Spark code locally?▼

You need Databricks Connect to run Spark code locally because it bridges your local environment to remote Databricks clusters. This allows you to execute and test Spark operations without deploying code directly to the workspace.

Can I manipulate Databricks resources directly via the REST API?▼

Yes, you can manipulate Databricks resources directly via the REST API using the Python SDK. The Skill provides guidance on accessing REST APIs to manage workspace resources programmatically and automate Databricks tasks.

Related Skills

Explore More Software Engineering Skills→
rywerth-dbxrywerth-dbx

databricks-connect

Connect local Python code to a Databricks workspace via Databricks Connect.

Community
Intermediate
ScottHMcKeanScottHMcKean

databricks-python-sdk

Manage Databricks resources via Python SDK, Connect, CLI, and REST API.

Community
Advanced
mkgs-databricks-demosmkgs-databricks-demos

databricks-pipelines

Automates Lakeflow Spark Declarative Pipelines on Databricks for batch and streaming data.

Official
Advanced
mkgs-databricks-demosmkgs-databricks-demos
1

databricks-python-sdk

Manage Databricks resources programmatically with the Python SDK, CLI, and REST APIs.

Official
Advanced