skills.rest
ThomazRossito
ThomazRossitoCOMMUNITY
Explore all skills by this author →
Website𝕏@thomazrossitoGitHub

databricks-jobs

Create, list, run, update, or delete Databricks Jobs via CLI, Python SDK, or Asset Bundles.

31|18|Updated Apr 4, 2026
Search Tags:#automation#cli#sdk#pipeline#schedule#databricks#jobs
One-click install
npx skills add https://github.com/ThomazRossito/data-agents --skill databricks-jobs-thomazrossito
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-jobs
Source: https://github.com/ThomazRossito/data-agents/tree/main/skills/databricks/databricks-jobs
Command: npx skills add https://github.com/ThomazRossito/data-agents --skill databricks-jobs-thomazrossito

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Manual creation and manipulation of Databricks Jobs require repetitive CLI, SDK calls, and complex configuration, slowing data workflow automation.

Core Features & Use Cases

  • Unified job management: create, list, run, update, and delete jobs via a single skill.
  • Multi‑task DAGs and scheduling: define task dependencies, cron schedules, file‑arrival or table‑update triggers.
  • Cluster and environment control: configure job clusters, autoscaling, serverless, or existing clusters.
  • Monitoring and notifications: set email/webhook alerts, health rules, and run‑time limits.
  • Use case example: an engineer can quickly provision a daily ETL pipeline that runs a notebook, sends failure alerts, and scales resources automatically.

Quick Start

Ask the assistant to create a Databricks job named “daily‑etl” that runs a notebook at “/Workspace/etl” with a daily schedule.

Frequently Asked Questions about databricks-jobs

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate Databricks job creation and management programmatically?▼

You can automate Databricks job management by using this skill to create, list, run, update, or delete jobs through CLI, Python SDK, or Asset Bundles. It enables programmatic job orchestration, parameter handling, and cluster configuration within Databricks workspaces without repetitive manual calls.

Can I define multi-task DAGs and cron schedules for Databricks pipelines?▼

Yes, you can define multi-task DAGs and configure cron schedules for Databricks pipelines. The skill supports setting task dependencies, file-arrival triggers, and table-update triggers to satisfy complex job orchestration and scheduling requirements.

What is the best way to configure job clusters and autoscaling in Databricks?▼

The best way to configure Databricks job clusters and autoscaling is by defining the cluster parameters during job creation. This skill allows you to configure job clusters, autoscaling rules, serverless compute, or attach existing clusters to optimize pipeline resources.

How do I set up email or webhook alerts for Databricks job failures?▼

You set up email and webhook alerts for Databricks job failures by configuring notification settings within the job definition. This skill supports defining health rules, run-time limits, and webhook or email alerts to monitor pipeline execution effectively.

Related Skills

Explore More Data & Analytics Skills→
mirakuimirakui

databricks-python-sdk

Implement Databricks SDK workflows in Python to automate workspace tasks.

Community
Intermediate
m19cm19c

databricks-bundles

Automate creation, configuration, and deployment of Databricks Asset Bundles.

Community
Advanced
LaurentPRAT-DBLaurentPRAT-DB

databricks-resource-deployment

Deploy Databricks notebooks, jobs, clusters, SQL warehouses, and databases.

Community
Advanced
tanyagraytanyagray

bitbucket-pipeline

Manage Bitbucket Pipelines via the Bitbucket REST API.

Community
Advanced