Define and monitor multi-task Databricks Jobs with schedules and triggers.
npx skills add https://github.com/mirakui/dotfiles --skill databricks-jobs-mirakui
Please help me install this Agent Skill. Skill: databricks-jobs Source: https://github.com/mirakui/dotfiles/tree/main/claude/skills/databricks-jobs Command: npx skills add https://github.com/mirakui/dotfiles --skill databricks-jobs-mirakui
Databricks Jobs orchestration is complex; this Skill provides a structured guide to define, configure, and monitor multi-task Databricks jobs, aligning tasks with schedules, triggers, and health notifications.
Create a basic job with a single notebook task and a cron schedule to verify end-to-end execution.
High-intent search queries and answers about installing and using this skill.
Databricks jobs orchestration lets you define multi-task pipelines with schedules, triggers, and monitoring. You can configure task types like notebook, SQL, and dbt tasks, then apply cron schedules for automated ETL execution.
Databricks pipelines support periodic, file_arrival, table_update, and continuous triggers alongside cron. These flexible trigger options enable event-driven processing and cross-job orchestration for complex data workflows.
Asset Bundles deploy reproducible Databricks jobs pipelines across multiple environments. This approach ensures consistent configuration for multi-environment deployments when managing scheduled data refreshes and ETL workflows.
Databricks jobs provide integrated health monitoring and alerts for ETL pipelines. You can configure health notifications to track multi-task job execution, ensuring reliable data refreshes and prompt failure detection.
Databricks jobs orchestration can be managed via Python SDK, CLI, or Asset Bundles. The Python SDK provides programmatic control for defining cross-job workflows, while the CLI and bundles offer alternative configuration methods.
Databricks pipelines support comprehensive task types including notebook_task, sql_task, dbt_task, and run_job_task. This coverage allows you to combine multiple execution formats within a single orchestrated workflow.
m19cManage Databricks clusters, jobs, and SQL queries via the Python SDK.
RichJacobs69Analyze GitHub Actions workflow runs to debug failures and optimize batch timing.
databricksDevelop and deploy Databricks Lakeflow Jobs using Databricks Asset Bundles.
AradotsoAutomate data pipeline scheduling and monitoring with Apache Airflow DAGs.
