skills.rest
alessandro9110
alessandro9110COMMUNITY
Explore all skills by this author →
GitHub

databricks-jobs

Create, run, and manage Databricks Jobs for multi-task data workflows.

4|2|Updated Feb 16, 2026
Search Tags:#ci/cd#workflow automation#orchestration#etl#databricks#jobs
One-click install
npx skills add https://github.com/alessandro9110/Speech-To-Text-With-Databricks --skill databricks-jobs-alessandro9110
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-jobs
Source: https://github.com/alessandro9110/Speech-To-Text-With-Databricks/tree/main/.claude/skills/databricks-jobs
Command: npx skills add https://github.com/alessandro9110/Speech-To-Text-With-Databricks --skill databricks-jobs-alessandro9110

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill simplifies the creation, management, and execution of Databricks Jobs, enabling efficient orchestration of complex data workflows and automated tasks.

Core Features & Use Cases

  • Job Creation & Management: Define and manage multi-task DAGs, configure triggers, schedules, and notifications.
  • Task Orchestration: Supports diverse task types including notebooks, Python scripts, SQL queries, and dbt projects.
  • Use Case: Automate a daily ETL pipeline that ingests data, transforms it, loads it into a data warehouse, and then refreshes a BI dashboard, all orchestrated as a single Databricks Job.

Quick Start

Use the databricks-jobs skill to create a new job named 'daily_etl_pipeline' that runs a notebook located at '/Workspace/Users/[email protected]/etl_notebook'.

Frequently Asked Questions about databricks-jobs

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate a Databricks ETL pipeline with multiple tasks?▼

Databricks Jobs orchestrate multi-task DAGs to automate ETL pipelines. You can configure sequential or parallel tasks using notebooks, Python scripts, SQL queries, and dbt projects to handle data ingestion, transformation, and loading within a single workflow.

What types of triggers can I configure for Databricks workflow automation?▼

Databricks workflow automation supports flexible triggers for job execution. You can configure schedules, trigger runs upon file arrival, activate jobs via table updates, or set up continuous execution to handle streaming data workflows.

Can I manage Databricks Jobs programmatically using Python SDK or CLI?▼

You can manage Databricks Jobs programmatically using the Python SDK and CLI. This enables you to create, list, run, update, and delete jobs, providing programmatic control and integration into existing automation scripts.

Does Databricks support infrastructure-as-code deployment for job orchestration?▼

Databricks supports infrastructure-as-code deployment via Databricks Asset Bundles. This allows you to define, manage, and deploy job orchestration configurations and multi-task DAGs as code within your version control system.

What is the best way to orchestrate dbt projects in Databricks?▼

The best way to orchestrate dbt projects in Databricks is by using Databricks Jobs. You can define dbt project execution as a task within a multi-task DAG, enabling you to automate transformations alongside notebooks and Python scripts.

Related Skills

Explore More Software Engineering Skills→
ThomazRossitoThomazRossito
31

databricks-config

Manage Databricks workspace profiles and authentication via the Python SDK.

Community
Intermediate
niznik-devniznik-dev
16

Run Experiment

Orchestrate SLURM fine-tuning jobs with torchtune and evaluate with inspect-ai.

Community
Advanced
aaronachermannaaronachermann

databricks-jobs

Manage Databricks Jobs lifecycle via Python SDK, CLI, or Asset Bundles.

Community
Advanced
RxFitRxFit

gcp-pipeline-orchestration

Generate and deploy Cloud Composer orchestration pipeline definitions for GCP workflows.

Community
Advanced