skills.rest
jlaws
jlawsCOMMUNITY
Explore all skills by this author →
GitHub

agent-data-engineer

Design ETL/ELT pipelines, data models, and warehouse optimizations for analytics platforms.

2|Updated Jan 3, 2026
Search Tags:#schema#data#etl#query-optimization#pipelines#data-architecture
One-click install
npx skills add https://github.com/jlaws/dotfiles --skill agent-data-engineer-jlaws
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: agent-data-engineer
Source: https://github.com/jlaws/dotfiles/tree/main/.agents/skills/agent-data-engineer
Command: npx skills add https://github.com/jlaws/dotfiles --skill agent-data-engineer-jlaws

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Data teams struggle to design scalable data pipelines, reliable schemas, and analytics architectures that support growing data needs. This Skill provides a structured approach to building ETL/ELT pipelines, modeling data, and planning platform scalability.

Core Features & Use Cases

  • End-to-end data pipeline design and implementation for ETL/ELT processes.
  • Data modeling, schema design, and warehouse optimization to improve query performance.
  • Analytics architecture guidance and platform scalability planning.

Quick Start

Design an end-to-end data pipeline blueprint that ingests streaming events into a data warehouse and outputs analytics-ready tables.

Frequently Asked Questions about agent-data-engineer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design an end-to-end data pipeline for streaming events?▼

ETL and ELT pipelines extract raw data from sources, transform it through batch or streaming processing, and load it into a data warehouse. This Skill provides reference-based examples and code snippets to build, deploy, and optimize these workflows.

What's the best way to optimize database schemas for analytics platforms?▼

Schema design for data warehouses involves modeling analytics-ready tables to minimize compute costs and maximize query optimization. This Skill specifies end-to-end guidance using production-grade patterns to structure your analytics architecture.

Can I use this for both batch and streaming data workloads?▼

Yes, this Skill applies to both batch and streaming data workloads for ETL and ELT development. It provides end-to-end guidance and production-grade patterns for building reliable pipelines across diverse data processing needs.

How do I build scalable data architectures for growing data needs?▼

Building scalable data architectures requires reliable schemas, optimized query performance, and structured platform scalability planning. This Skill provides a structured approach to modeling data and planning analytics architectures that support growing data volumes.

Do I need additional dependencies to implement these data pipelines?▼

No additional dependencies are required to implement these data pipelines. This Skill operates independently, providing end-to-end guidance, production-grade patterns, and code snippets for real-world data engineering projects.

Related Skills

Explore More Data & Analytics Skills→
jshsakurajshsakura
22

data-engineer

Orchestrate end-to-end data ingestion, transformation, and loading with data contracts and lineage.

Community
Advanced
weirdgmeweirdgme
4

platform-engineering

Design and implement scalable platform engineering patterns for internal developer platforms.

Community
Advanced
AndyHsuTWAndyHsuTW

clickhouse-io

Provide ClickHouse patterns for query optimization, analytics, and data engineering.

Community
Intermediate
luokai25luokai25

data-engineer

Design data pipelines, ETL/ELT processes, and data platform architectures.

Community
Advanced