data-integrate

Integrate multiple tabular data sources and verify consistency into analysis_table.csv.

Updated Mar 3, 2026
One-click install
npx skills add https://github.com/mutsumi-yamamoto/claude-data-analysis-marketplace --skill data-integrate
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-integrate
Source: https://github.com/mutsumi-yamamoto/claude-data-analysis-marketplace/tree/main/plugins/data-analysis/skills/data-integrate
Command: npx skills add https://github.com/mutsumi-yamamoto/claude-data-analysis-marketplace --skill data-integrate

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill resolves the common and risky task of joining multiple tabular sources without clear grain definition, preventing unintended duplicates, temporal mismatches, and undocumented transformations that break downstream analysis.

Core Features & Use Cases

  • Grain enforcement: Forces explicit definition of the analysis unit (record grain) before any join to avoid semantic inconsistencies.
  • Join planning & validation: Guides key null checks, cardinality inspection, and pre/post-join row-count comparisons to detect fan-out and other anomalies.
  • Temporal alignment & leakage prevention: Validates time ranges and prevents future information leakage when merging time-series data.
  • Integrity checks & lineage: Runs missing/duplicate/primary-key checks, records provenance into analysis_context.md, and documents data lineage for reproducibility.
  • Persistence: Outputs a canonical analysis_table.csv and records execution logs and lineage into the project documentation for auditability.
  • Use case: Combining customer, order, and event tables into a single analytics table while ensuring key uniqueness, time alignment, and traceable provenance.

Quick Start

Use data-integrate to merge your source tables into a single analysis_table.csv after confirming the analysis grain and recording lineage in analysis_context.md.

Frequently Asked Questions about data-integrate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I prevent row duplication and fan-out when joining multiple CSV files?

To prevent fan-out during data integration, you must enforce explicit record grain definition before joining multiple CSV files. This process guides key null checks, cardinality inspection, and pre/post-join row-count comparisons to detect unintended duplicates.

What is data lineage and how does it help with ETL reproducibility?

Data lineage records the provenance of your merged datasets into an analysis_context.md file during ETL preparation. It documents transformations and integrity checks to ensure downstream analysis remains reproducible and auditable.

How do I safely merge time-series data without future information leakage?

Safely merging time-series data requires temporal alignment validation to prevent future information leakage. This process checks time ranges across event and order tables before joining to ensure chronological correctness for analysis.

Can I integrate expanded ZIP archives and Excel files into a single analysis table?

Yes, you can integrate tabular datasets from expanded ZIP archives, Excel files, and CSV files. The process merges customer, order, and event tables into a single canonical analysis_table.csv while verifying key uniqueness.

Why does my joined dataset have mismatched rows after merging customer and order tables?

Mismatched rows often occur when joining customer and order tables without clear grain definition. Running missing key checks, duplicate inspections, and primary-key validations before merging resolves these semantic inconsistencies.

What is the best way to document data quality checks during ETL preparation?

The best way to document data quality checks during ETL preparation is by recording null checks, cardinality inspections, and provenance into project documentation. This creates an auditable lineage trail alongside your canonical analysis table.