agency-data-engineer
CommunityDesign reliable data pipelines & lakehouses.
Authorjay6697117
Version1.0.0
Installs0
System Documentation
What problem does it solve?
The Data Engineer Skill provides a blueprint for designing and operating scalable data infrastructures, transforming raw, messy data into reliable, analytics-ready assets that power analytics, ML, and business intelligence.
Core Features & Use Cases
- End-to-end data pipeline design (Bronze → Silver → Gold) with idempotent processing and explicit data contracts
- Streaming and batch capabilities on cloud platforms (Azure, AWS, GCP) with Delta/Iceberg/Hudi open formats
- Observability, data quality checks, lineage, and governance baked into every stage of the lakehouse
Quick Start
Design a scalable data pipeline for a new source using Bronze/Silver/Gold patterns and monitoring.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: agency-data-engineer Download link: https://github.com/jay6697117/agency-agents-antigravity/archive/main.zip#agency-data-engineer Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.