Skills
.Work. You
Rest

data-eng-pipeline-architect

Community

Design resilient production data pipelines.

Data & Analytics#dbt#etl#airflow#kafka#dataops#spark#data-pipeline
Authorscanady
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Design and build production-grade data pipelines and data infrastructure using modern tools and DataOps practices.

Core Features & Use Cases

  • Design architecture for batch and streaming workloads, including Bronze/Silver/Gold patterns and Medallion lakehouse concepts.
  • Model data and implement CI/CD for data pipelines with quality checks, tests, and observability.
  • Use cases include building end-to-end ETL/ELT, data quality enforcement, and data warehouse modeling across Snowflake, BigQuery, or Databricks.

Quick Start

Draft a production-grade data pipeline design for a batch and streaming workload using your current toolset.

Dependency Matrix

Required Modules

None required

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: data-eng-pipeline-architect
Download link: https://github.com/scanady/nexus-agents/archive/main.zip#data-eng-pipeline-architect

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.