data-lineage

Trace data lineage from raw data to model inputs and output a lineage.md report.

Updated Mar 20, 2026
One-click install
npx skills add https://github.com/thbraet/claude-template --skill data-lineage-thbraet
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-lineage
Source: https://github.com/thbraet/claude-template/tree/main/skills/data-lineage
Command: npx skills add https://github.com/thbraet/claude-template --skill data-lineage-thbraet

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Data lineage tracking is essential for trust, reproducibility, and governance. This skill automatically traces data from raw sources through cleaning, feature engineering, and formatting to model inputs, producing a comprehensive lineage report and an easy-to-read diagram.

Core Features & Use Cases

  • End-to-end lineage tracking across raw, cleaned, features, and formatted datasets.
  • Output both a markdown lineage report and a text-based lineage diagram for quick review.
  • Supports CRISP-DM-style pipelines by mapping transformations to pipeline stages in the docs.

Quick Start

Place this skill in your project to automatically generate a data lineage report from raw to formatted data.

Frequently Asked Questions about data-lineage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
What is data lineage and how does it support data pipeline governance?

Data lineage tracks data transformations from raw sources to model inputs, enabling reproducibility and governance reporting. It audits cleaning and feature engineering stages to ensure trusted, traceable data pipelines.

How do I trace data transformations from raw data to model inputs?

Trace data transformations by analyzing raw files in data/raw and processed datasets in data/processed. Mapping src/* scripts generates a lineage report and text-based diagram showing the flow to formatted model inputs.

Can I generate a CRISP-DM data preparation lineage report for my project?

Yes, you can generate a CRISP-DM lineage report. The tool maps transformations to pipeline stages and outputs a markdown file in docs/crisp-dm/3-data-preparation/ for auditable data preparation.

Does automated data lineage tracking work with custom feature engineering scripts?

Yes, automated data lineage tracking works with custom scripts by analyzing src/* to map transformations. It expects features in data/processed/*_features.* and formatted data in data/processed/*_formatted.*.

What is the best way to document data traceability for reproducibility?

The best way to document data traceability is generating a markdown lineage report alongside a text-based diagram. This maps raw, cleaned, featured, and formatted datasets to ensure reproducibility.