validating-etl-pipelines
CommunityKeep ETL/ELT pipelines fresh and accurate.
Authorsomachak
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Validates ETL and ELT pipelines for freshness, schema drift, lineage breaks, duplication, and reconciliation errors. Use when building ingestion jobs, warehouse transforms, or sync systems.
Core Features & Use Cases
- Validation of source data and transformed data at every stage to prevent propagation of bad data.
- Ensures idempotency with upsert or deduplication to achieve the same warehouse state on reruns.
- Monitoring, alerting, and backfill support to detect freshness issues and recover from pipeline gaps.
- Applicability across modern orchestration and transformation stacks (Airflow, dbt, or custom Python/Node.js workflows).
Quick Start
Run an end-to-end validation of your ETL/ELT pipelines to detect freshness, schema drift, and reconciliation errors.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: validating-etl-pipelines Download link: https://github.com/somachak/claude-code-skills-db/archive/main.zip#validating-etl-pipelines Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.