Generates column-level lineage across tasks as JSON for metadata systems.
npx skills add https://github.com/starlake-ai/starlake --skill col-lineage
Please help me install this Agent Skill. Skill: col-lineage Source: https://github.com/starlake-ai/starlake/tree/main/.agent/skills/col-lineage Command: npx skills add https://github.com/starlake-ai/starlake --skill col-lineage
Column-level lineage generation to track how data flows and transforms across tasks, enabling governance and impact analysis.
Execute the command to generate column lineage for a specified task, for example starlake col-lineage --task <task_name>.
High-intent search queries and answers about installing and using this skill.
Column-level data lineage tracks how data flows and transforms from source to target columns across tasks. You need it for data governance, impact analysis, and debugging data pipelines to accurately propagate downstream changes when a source column is modified.
To generate column lineage for a specific task, execute the command starlake col-lineage --task <task_name>. This traces dependencies from source to transform across tasks and produces a structured lineage output for your specified task.
Yes, column lineage extraction produces a structured lineage in JSON format. This JSON output is designed for seamless integration with existing data governance workflows and metadata systems.
Yes, you can trace end-to-end data dependencies across tasks to perform impact analysis. The lineage extraction identifies and maps source to target column transformations, enabling you to see downstream effects accurately.
The best way to analyze downstream effects is by generating column-level lineage. It traces dependencies across tasks to identify exactly which target columns are affected, ensuring accurate change propagation and pipeline debugging.
miptah21Trace upstream data lineage for Airflow tables, columns, and DAGs.
superdesigndevGenerate interactive architecture maps and PR diff overlays from import graphs.
nrakowAutomate anomaly detection in dbt data pipelines for volume, freshness, and distribution issues.
astronomerTrace upstream data lineage by identifying sources and producing DAGs.
