databricks-python-sdk

The Databricks Python SDK provides programmatic access to Databricks services, enabling you to apply Python methods for cluster management, SQL execution, and REST API interactions within local experiments, notebook workflows, and CI pipelines.

Configure authentication for the Databricks Python SDK by following best practices for credentials and environment configuration, enabling secure access to interact with Databricks REST APIs and resources from your local development environment or automated CI workflows.

Yes, the Databricks Python SDK supports executing SQL in notebook workflows through REST API abstractions and Python SDK methods, allowing you to interact with Databricks resources programmatically across local experiments and CI environments.

Yes, the Databricks Python SDK integrates with Databricks Connect for local development, offering installation and configuration guidance to connect to clusters and interact with Databricks APIs from your local code environment.

The best way to call Databricks REST APIs from a CI pipeline is using the Databricks Python SDK, which provides REST API abstractions and follows best practices for credentials and environment configuration to automate workflows securely.

You should avoid using the Python SDK for Databricks automation if your workflow does not require programmatic access to Databricks services, REST API interactions, or cluster management, or if your environment cannot support the necessary credentials and configuration.