What problem does it solve?
This Skill provides comprehensive guidance and automation for Databricks development, simplifying the process of working with the Databricks platform using Python SDK, Databricks Connect, CLI, and REST API.
Core Features & Use Cases
- SDK Documentation: Access detailed documentation for Databricks SDK, including Python SDK, Databricks Connect, CLI, and REST API.
- Environment Setup: Guidance on setting up the environment, including virtual environments, Databricks Connect, and SDK installations.
- Configuration: Instructions for configuring Databricks CLI and environment variables for authentication and access.
- Databricks Connect: Execute Spark code locally against a Databricks cluster using Databricks Connect.
- REST API Access: Perform operations directly using the Databricks REST API for tasks not covered by the SDK.
- Databricks CLI: Execute common Databricks commands using the CLI, including listing clusters, jobs, and managing files.
- SDK Documentation Architecture: Understand the structure of the SDK documentation for easy navigation and reference.
- Authentication: Explore authentication options and code patterns for accessing Databricks resources securely.
- Core API Reference: Detailed references for Databricks APIs, including clusters, jobs, SQL warehouses, tables, files, serving endpoints, and more.
- Common Patterns: Best practices for working with the Databricks SDK in async applications, waiting for long-running operations, pagination, and error handling.
- Quick Reference Links: Access quick reference links to various API documentation sections.
Quick Start
Use the databricks-python-sdk skill to create a new Databricks cluster with the latest Spark version.