data-engineer

Design and implement scalable ETL/ELT pipelines and dimensional data models for multi-tenant SaaS analytics.

Updated Feb 22, 2026

Search Tags:#dbt #data engineering #etl #data warehouse #data governance #cdc #saas analytics

Ready to run

npx skills add https://github.com/Muath2000/TradeStation --skill data-engineer-muath2000

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: data-engineer
Source: https://github.com/Muath2000/TradeStation/tree/main/.claude/skills/data-engineer
Command: npx skills add https://github.com/Muath2000/TradeStation --skill data-engineer-muath2000

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill addresses the complex challenges of designing, building, and maintaining scalable, reliable, and governed data infrastructure for multi-tenant SaaS platforms.

Core Features & Use Cases

ETL/ELT Pipeline Design: Architect efficient data pipelines for various sources.
Data Modeling: Create dimensional models (star/snowflake schemas) for analytics.
Data Governance & Quality: Implement frameworks for PII classification, lineage, and data quality checks.
Use Case: Design and implement a CDC pipeline from a PostgreSQL OLTP database to a ClickHouse data warehouse, ensuring tenant isolation and data quality for real-time SaaS analytics.

Quick Start

Design a dimensional data model for user activity events, including tenant and user dimensions.

Frequently Asked Questions about data-engineer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I build a CDC pipeline from PostgreSQL to ClickHouse for SaaS analytics?▼

You can build a CDC pipeline using Debezium to capture PostgreSQL changes and route them to ClickHouse via Kafka Streams. This architecture supports real-time SaaS analytics while maintaining tenant isolation and data quality checks.

What is the best way to model dimensional data for multi-tenant SaaS platforms?▼

Dimensional data modeling for multi-tenant SaaS platforms involves creating star or snowflake schemas that include dedicated tenant and user dimensions. This approach ensures proper tenant isolation and enables accurate SaaS metrics reporting across isolated data segments.

How does dbt fit into an ELT pipeline for data warehouse automation?▼

dbt automates ELT pipeline transformations within data warehouses like ClickHouse by defining dimensional models and data quality tests. It enables governed data flows by applying PII classification and lineage tracking directly in the transformation layer.

Can I use Kafka Streams for real-time ETL pipelines and data governance?▼

Yes, Kafka Streams processes real-time data pipelines while integrating with data governance frameworks to enforce PII classification and lineage tracking. This combination ensures data quality and tenant isolation are maintained during continuous streaming operations.

When do I need data governance frameworks in a multi-tenant data warehouse?▼

Data governance frameworks are needed in multi-tenant data warehouses when handling PII classification, tracking data lineage, and enforcing data quality checks. They are essential for maintaining strict tenant isolation and compliance in SaaS analytics environments.