skills.rest
ice-droid-99
ice-droid-99COMMUNITY
Explore all skills by this author →
GitHub

databricks-python-sdk

Guide Databricks authentication and API operations using the Python SDK.

Updated May 20, 2026
Search Tags:#rest api#python sdk#databricks#unity catalog#databricks connect#databricks cli#sql statement execution
One-click install
npx skills add https://github.com/ice-droid-99/BI-Dashboard-Generation-Agent-in-Databricks- --skill databricks-python-sdk-ice-droid-99
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-python-sdk
Source: https://github.com/ice-droid-99/BI-Dashboard-Generation-Agent-in-Databricks-/tree/main/.gemini/skills/databricks-python-sdk
Command: npx skills add https://github.com/ice-droid-99/BI-Dashboard-Generation-Agent-in-Databricks- --skill databricks-python-sdk-ice-droid-99

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

It solves the problem of uncertainty and friction when building or debugging Databricks integrations by giving a single, practical reference for configuring credentials, running Databricks Connect locally, and calling Databricks APIs via the Python SDK and REST when needed.

Core Features & Use Cases

  • Environment and authentication guidance: Configure DEFAULT profiles, ~/.databrickscfg, and required environment variables like DATABRICKS_HOST and DATABRICKS_TOKEN.
  • Local development with Databricks Connect: Run Spark code locally while targeting a remote Databricks cluster without using an incompatible .master("local[*]") setup.
  • Programmatic API operations: Prefer databricks-sdk-py methods for common tasks, and fall back to WorkspaceClient().api_client.do(...) for endpoints not yet covered or complex operations.
  • CLI workflows: Use the Databricks CLI for operational checks (versioning, listings, workspace navigation) alongside SDK-based automation.
  • API coverage reference: Covers major areas such as clusters, jobs, SQL statement execution, Unity Catalog (catalogs/schemas/tables/volumes), files, model serving, vector search, pipelines, and secrets, including key documentation link patterns.

Quick Start

Ask: "How do I authenticate with Databricks and run a SQL query using databricks-sdk-py against my warehouse?"

Frequently Asked Questions about databricks-python-sdk

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I authenticate with Databricks using the Python SDK?▼

To authenticate with the Databricks Python SDK, configure a DEFAULT profile in ~/.databrickscfg or set environment variables like DATABRICKS_HOST and DATABRICKS_TOKEN to establish a synchronous WorkspaceClient connection.

How do I run Spark code locally against a remote Databricks cluster?▼

Use Databricks Connect to run Spark code locally while targeting a remote Databricks cluster, ensuring you avoid setting an incompatible .master("local[*]") configuration in your local development environment.

What is the best way to execute a SQL query against a Databricks warehouse using Python?▼

The best way to execute SQL statements against a Databricks warehouse is using the databricks-sdk-py Python SDK, which provides structured methods for SQL statement execution workflows and programmatic API operations.

Can I call Databricks REST API endpoints not covered by the Python SDK?▼

Yes, you can call uncovered Databricks REST API endpoints by falling back to WorkspaceClient().api_client.do(...), allowing direct API requests when SDK abstractions are incomplete for complex operations.

Does the Databricks Python SDK support Unity Catalog management?▼

Yes, the Databricks Python SDK supports Unity Catalog management, providing programmatic API operations to create and manage catalogs, schemas, tables, and volumes within your Databricks workspace environment.

Why use the Databricks CLI alongside the Python SDK for operational tasks?▼

Use the Databricks CLI alongside the Python SDK for quick operational checks like versioning, listings, and workspace navigation, while reserving SDK-based automation for complex programmatic workflows and orchestration.

Related Skills

Explore More Software Engineering Skills→
i9wa4i9wa4
11

jupyter-notebook

Execute Jupyter notebooks on local Python kernels and Databricks clusters.

Community
Advanced
mkgs-databricks-demosmkgs-databricks-demos
1

databricks-python-sdk

Manage Databricks resources programmatically with the Python SDK, CLI, and REST APIs.

Official
Advanced
ScottHMcKeanScottHMcKean

databricks-python-sdk

Manage Databricks resources via Python SDK, Connect, CLI, and REST API.

Community
Advanced
itsadijmbtitsadijmbt
1

databricks-python-sdk

Translate Databricks tasks into databricks-sdk-py usage with REST fallback.

Community
Advanced