skills.rest
LaurentPRAT-DB
LaurentPRAT-DBCOMMUNITY
Explore all skills by this author →
GitHub

databricks-jobs

Create and manage Databricks Jobs with Python SDK, CLI, and Asset Bundles.

Updated Feb 27, 2026
Search Tags:#workflow automation#orchestration#etl#data pipelines#databricks#jobs
One-click install
npx skills add https://github.com/LaurentPRAT-DB/LPT_claude_config --skill databricks-jobs-laurentprat-db
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-jobs
Source: https://github.com/LaurentPRAT-DB/LPT_claude_config/tree/main/skills/databricks-jobs
Command: npx skills add https://github.com/LaurentPRAT-DB/LPT_claude_config --skill databricks-jobs-laurentprat-db

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill streamlines the creation, management, and execution of Databricks Jobs, automating complex data workflows and ensuring reliable job orchestration.

Core Features & Use Cases

  • Job Creation & Management: Define, update, and delete Databricks Jobs using Python SDK, CLI, or Asset Bundles.
  • Workflow Orchestration: Configure multi-task DAGs with flexible dependencies and triggers.
  • Use Case: Set up a daily ETL pipeline that extracts data, transforms it, loads it into a warehouse, and then runs data quality checks, all orchestrated as a single Databricks Job.

Quick Start

Use the databricks-jobs skill to create a new Databricks job named 'my-etl-job' that runs a notebook.

Frequently Asked Questions about databricks-jobs

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create and manage Databricks Jobs for ETL pipelines?▼

To create and manage Databricks Jobs for ETL pipelines, you can define, update, and delete jobs using the Python SDK, CLI, or Asset Bundles to automate complex data workflows and ensure reliable job orchestration.

Can I build complex multi-task DAGs with diverse task types in Databricks Jobs?▼

Yes, you can build complex multi-task Directed Acyclic Graphs (DAGs) in Databricks Jobs, supporting diverse task types including notebooks, Python scripts, SQL queries, and dbt projects with flexible dependencies.

What trigger mechanisms are available for Databricks Jobs workflow orchestration?▼

Databricks Jobs workflow orchestration supports various trigger mechanisms including schedules and file arrivals, enabling automated execution of your data pipelines based on time or event-driven conditions.

How do I configure compute resources and notifications for a Databricks Job?▼

You configure compute resources and notifications for a Databricks Job alongside parameters and health monitoring during job setup, ensuring robust workflow automation and reliable execution tracking.

Does the databricks-jobs skill support dbt projects and SQL queries as task types?▼

Yes, the databricks-jobs skill supports dbt projects and SQL queries as diverse task types within your multi-task DAGs, allowing you to integrate diverse data transformation processes into a single orchestrated workflow.

What is the best way to automate a daily ETL pipeline with data quality checks in Databricks?▼

The best way to automate a daily ETL pipeline with data quality checks in Databricks is to orchestrate it as a single Databricks Job, configuring extraction, transformation, loading, and quality checks as sequential multi-task DAG steps.

Related Skills

Explore More Software Engineering Skills→
ThomazRossitoThomazRossito
31

databricks-config

Manage Databricks workspace profiles and authentication via the Python SDK.

Community
Intermediate
mats16mats16
1

databricks-jobs

Query Databricks job status and run histories to diagnose failures.

Community
Advanced
slysikslysik

databricks-jobs

Manage Databricks Jobs for multi-task DAGs and scheduling triggers.

Community
Advanced
Zack2626-okZack2626-ok

databricks-jobs

Manage Databricks Jobs via Python SDK, CLI, or Asset Bundles.

Community
Advanced