data-lineage

Track DataFrame transformation lineage across Python notebooks and pipelines.

Updated Feb 17, 2026
One-click install
npx skills add https://github.com/etoyama/insight-blueprint --skill data-lineage-etoyama
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-lineage
Source: https://github.com/etoyama/insight-blueprint/tree/main/skills/data-lineage
Command: npx skills add https://github.com/etoyama/insight-blueprint --skill data-lineage-etoyama

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Track data transformation lineage across notebooks and Python scripts, enabling transparent auditing of how data evolves in your pipelines.

Core Features & Use Cases

  • Lineage tracking: wrap DataFrame pipelines with tracked_pipe to record transformations and row-count changes.
  • Mermaid visualization: export diagrams that visualize lineage flows for quick review and documentation.
  • Use Case: add lineage to notebooks during data wrangling to produce an auditable record of data transformations for reproducibility.

Quick Start

Open a notebook and enable lineage tracking using the provided workflow to generate a Mermaid diagram.

Frequently Asked Questions about data-lineage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I track data lineage in Python notebooks and scripts?▼

You can track data lineage in Python notebooks by wrapping DataFrame pipelines with the tracked_pipe wrapper, which records transformations and row-count changes to create an auditable record of data evolution.

How do I visualize DataFrame transformation lineage for pipeline auditing?▼

You can visualize DataFrame transformation lineage by exporting Mermaid diagrams that map pipeline flows, providing a quick graphical review for auditing and documentation of data evolution.

Does data lineage tracking work with standard Python data wrangling pipelines?▼

Yes, data lineage tracking applies to standard Python notebooks and scripts during data wrangling to produce an auditable record of transformations for reproducibility.

Why do I need tracked_pipe to record row-count changes in my pipeline?▼

You need tracked_pipe to wrap DataFrame pipelines because it actively monitors and records row-count changes across transformations, ensuring transparent auditing of how data evolves.

Can I expose a lineage management API for custom pipeline tracking?▼

Yes, the Skill exposes a lineage management API that allows you to programmatically manage data transformation tracking across notebooks and pipeline workflows.

What is the best way to document data evolution across multiple notebooks?▼

The best way to document data evolution across notebooks is to wrap pipelines with tracked_pipe to record transformations and export Mermaid visualizations for transparent auditing.