databricks-jobs

Automate Databricks Jobs creation, listing, running, updating, and deletion.

1|Updated Dec 15, 2025

Search Tags:#automation #monitoring #orchestration #pipelines #databricks #jobs

Ready to run

npx skills add https://github.com/lucaslessachaves/default --skill databricks-jobs-lucaslessachaves

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: databricks-jobs
Source: https://github.com/lucaslessachaves/default/tree/main/.claude/skills/databricks-jobs
Command: npx skills add https://github.com/lucaslessachaves/default --skill databricks-jobs-lucaslessachaves

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Databricks Job orchestration and management is complex to implement at scale, requiring reliable creation, monitoring, and governance of pipelines.

Core Features & Use Cases

Create, list, run, update, and delete Databricks Jobs across notebooks, Python, SQL, dbt, and more.
Configure triggers, schedules, and health monitoring to automate end-to-end workflows.
Integrate with Asset Bundles, notifications, and permissions for secure, auditable pipelines.

Quick Start

Define a Databricks Job with tasks and a trigger, then run it to observe the full workflow.

Frequently Asked Questions about databricks-jobs

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate Databricks Jobs orchestration for data pipelines?▼

Databricks Jobs orchestration automates pipeline administration by handling job creation, listing, running, updating, and deletion. It configures triggers, schedules, and health monitoring to streamline end-to-end data workflows across notebooks, Python, and SQL tasks.

Can I configure schedules and triggers for Databricks Jobs using YAML or Asset Bundles?▼

Yes, Databricks Jobs management supports YAML and CLI/SDK-based configuration. You can integrate with Databricks Asset Bundles to define triggers, schedules, and job clusters for deploying automated data pipelines.

What task types are supported when building Databricks Jobs pipelines?▼

Databricks Jobs pipelines support multiple task types including notebooks, Python scripts, SQL queries, and dbt projects. This allows you to orchestrate diverse data processing workflows within a single automated job configuration.

How do I set up health rules and notifications for Databricks Jobs monitoring?▼

Databricks Jobs monitoring allows you to configure health rules and notifications directly within your job setup. This ensures secure, auditable pipelines by alerting you to workflow status changes and automated trigger failures.