data-lineage

Track DataFrame transformation lineage across Python notebooks and pipelines.

Updated Feb 17, 2026
One-click install
npx skills add https://github.com/etoyama/insight-blueprint --skill data-lineage-etoyama
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-lineage
Source: https://github.com/etoyama/insight-blueprint/tree/main/skills/data-lineage
Command: npx skills add https://github.com/etoyama/insight-blueprint --skill data-lineage-etoyama

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Track data transformation lineage across notebooks and Python scripts, enabling transparent auditing of how data evolves in your pipelines.

Core Features & Use Cases

  • Lineage tracking: wrap DataFrame pipelines with tracked_pipe to record transformations and row-count changes.
  • Mermaid visualization: export diagrams that visualize lineage flows for quick review and documentation.
  • Use Case: add lineage to notebooks during data wrangling to produce an auditable record of data transformations for reproducibility.

Quick Start

Open a notebook and enable lineage tracking using the provided workflow to generate a Mermaid diagram.

Frequently Asked Questions about data-lineage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I track data lineage in Python notebooks and scripts?

You can track data lineage in Python notebooks by wrapping DataFrame pipelines with the tracked_pipe wrapper, which records transformations and row-count changes to create an auditable record of data evolution.

How do I visualize DataFrame transformation lineage for pipeline auditing?

You can visualize DataFrame transformation lineage by exporting Mermaid diagrams that map pipeline flows, providing a quick graphical review for auditing and documentation of data evolution.

Does data lineage tracking work with standard Python data wrangling pipelines?

Yes, data lineage tracking applies to standard Python notebooks and scripts during data wrangling to produce an auditable record of transformations for reproducibility.

Why do I need tracked_pipe to record row-count changes in my pipeline?

You need tracked_pipe to wrap DataFrame pipelines because it actively monitors and records row-count changes across transformations, ensuring transparent auditing of how data evolves.

Can I expose a lineage management API for custom pipeline tracking?

Yes, the Skill exposes a lineage management API that allows you to programmatically manage data transformation tracking across notebooks and pipeline workflows.

What is the best way to document data evolution across multiple notebooks?

The best way to document data evolution across notebooks is to wrap pipelines with tracked_pipe to record transformations and export Mermaid visualizations for transparent auditing.