databricks-lineage

Extract orchestration lineage from Databricks jobs and notebooks.

Updated May 26, 2026

Search Tags:#data engineering #notebook management #lineage #databricks #job management

Ready to run

npx skills add https://github.com/rbutinar/ade-ops --skill databricks-lineage

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: databricks-lineage
Source: https://github.com/rbutinar/ade-ops/tree/main/.agents/skills/databricks-lineage
Command: npx skills add https://github.com/rbutinar/ade-ops --skill databricks-lineage

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill provides a comprehensive view of Databricks Job and Notebook Lineage, helping users understand the relationships between jobs, tasks, and notebooks.

Core Features & Use Cases

Job Structure Discovery: List available jobs and their task dependencies.
Job Definition Retrieval: Get detailed job specifications including tasks and dependencies.
Lineage Export: Export job lineage to JSON for further analysis.
Use Case: For a data engineer, this skill can be used to quickly visualize the lineage of a complex ETL job, ensuring all dependencies are correctly set up.

Quick Start

Use the /databricks-lineage skill to list all available jobs in your Databricks workspace.

Frequently Asked Questions about databricks-lineage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I trace task dependencies in a Databricks job?▼

You can trace task dependencies in a Databricks job by extracting orchestration lineage that details task relationships and notebook execution paths. This skill lists job structures and retrieves detailed job specifications to visualize your ETL workflow.

How do I get Databricks notebook execution paths for lineage analysis?▼

Getting Databricks notebook execution paths involves extracting orchestration lineage from jobs and notebooks. This skill details task dependencies and execution paths, and can export the complete job lineage to JSON for further analysis.

Do I need a configured MCP server to extract Databricks job lineage?▼

Yes, you need a configured MCP server and access to the Databricks Jobs API to extract job lineage. This environment setup is required for the skill to retrieve job definitions, list available jobs, and detail task dependencies.

What is the best way to document complex ETL job structures in Databricks?▼

The best way to document complex ETL job structures in Databricks is by extracting orchestration lineage to map task dependencies and notebook execution paths. This skill automates job structure discovery and exports job lineage to JSON.

Can I export Databricks job definitions to JSON for dependency tracking?▼

Yes, you can export Databricks job definitions to JSON for dependency tracking. This skill retrieves detailed job specifications, including tasks and their dependencies, and supports exporting the complete job lineage to JSON format.

Does this Databricks lineage extraction tool support notebook management?▼

Yes, this Databricks lineage extraction tool supports notebook management by detailing notebook execution paths within job workflows. It focuses on job structure and task dependencies to help you understand relationships between jobs, tasks, and notebooks.