databricks-python-sdk

Guide Python development on Databricks using SDK, Connect, CLI, and REST API.

Updated Jun 11, 2026
One-click install
npx skills add https://github.com/Zack2626-ok/DATN_Website-Dat-Ban-Va-Quan-Ly-Nha-Hang --skill databricks-python-sdk-zack2626-ok
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-python-sdk
Source: https://github.com/Zack2626-ok/DATN_Website-Dat-Ban-Va-Quan-Ly-Nha-Hang/tree/main/.windsurf/skills/databricks-python-sdk
Command: npx skills add https://github.com/Zack2626-ok/DATN_Website-Dat-Ban-Va-Quan-Ly-Nha-Hang --skill databricks-python-sdk-zack2626-ok

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires databricks-sdk-py, databricks-connect, databricks-cli, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill provides comprehensive guidance and automation for Databricks development, simplifying the process of working with the Databricks platform using Python SDK, Databricks Connect, CLI, and REST API.

Core Features & Use Cases

  • SDK Documentation: Access detailed documentation for Databricks SDK, including Python SDK, Databricks Connect, CLI, and REST API.
  • Environment Setup: Guidance on setting up the environment, including virtual environments, Databricks Connect, and SDK installations.
  • Configuration: Instructions for configuring Databricks CLI and environment variables for authentication and access.
  • Databricks Connect: Execute Spark code locally against a Databricks cluster using Databricks Connect.
  • REST API Access: Perform operations directly using the Databricks REST API for tasks not covered by the SDK.
  • Databricks CLI: Execute common Databricks commands using the CLI, including listing clusters, jobs, and managing files.
  • SDK Documentation Architecture: Understand the structure of the SDK documentation for easy navigation and reference.
  • Authentication: Explore authentication options and code patterns for accessing Databricks resources securely.
  • Core API Reference: Detailed references for Databricks APIs, including clusters, jobs, SQL warehouses, tables, files, serving endpoints, and more.
  • Common Patterns: Best practices for working with the Databricks SDK in async applications, waiting for long-running operations, pagination, and error handling.
  • Quick Reference Links: Access quick reference links to various API documentation sections.

Quick Start

Use the databricks-python-sdk skill to create a new Databricks cluster with the latest Spark version.

Frequently Asked Questions about databricks-python-sdk

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I set up Python SDK and Databricks Connect for local development?

To set up Databricks Connect, install the required Python packages in a virtual environment, configure the Databricks CLI, and set environment variables for authentication to execute Spark code locally against a cluster.

What is the best way to run Spark operations locally against a Databricks cluster?

The best way to run Spark operations locally is using Databricks Connect, which allows you to execute Spark code directly against a remote Databricks cluster from your local development environment.

Can I use the Databricks REST API for tasks not covered by the Python SDK?

Yes, you can perform operations directly using the Databricks REST API for tasks not covered by the Python SDK, including managing clusters, jobs, SQL warehouses, and serving endpoints.

How do I configure Databricks CLI environment variables for authentication?

Databricks CLI configuration involves setting up specific environment variables for authentication and access, ensuring secure connections to your Databricks workspace resources.

What are common patterns for handling async applications and pagination in Databricks SDK?

Common patterns for Databricks SDK include best practices for waiting for long-running operations, handling pagination, managing errors, and working with asynchronous applications effectively.

Does Databricks CLI support listing clusters and managing files?

Yes, Databricks CLI supports executing common commands including listing clusters, managing jobs, and handling file operations directly from your terminal interface.