skills.rest
glincker
glinckerOFFICIAL
Explore all skills by this author →
WebsiteGitHub

data-engineer

Build and manage ETL pipelines and data warehouses with Apache Airflow and Snowflake.

35|5|Updated Nov 13, 2025
Search Tags:#analytics#sql#etl#pipelines#data-engineering#data-warehouse
One-click install
npx skills add https://github.com/glincker/claude-code-marketplace --skill data-engineer-glincker
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-engineer
Source: https://github.com/glincker/claude-code-marketplace/tree/main/skills/agents/data-engineer
Command: npx skills add https://github.com/glincker/claude-code-marketplace --skill data-engineer-glincker

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill streamlines the creation and management of data infrastructure, enabling efficient data processing and analysis.

Core Features & Use Cases

  • ETL Pipelines: Design and implement Extract, Transform, Load workflows for data integration.
  • Data Warehousing: Develop robust data warehouse schemas and structures.
  • Analytics Support: Facilitate data querying and reporting for business insights.
  • Use Case: Automate the daily ingestion and transformation of sales data from multiple sources into a central data warehouse for reporting.

Quick Start

Design an ETL pipeline for customer data using Apache Airflow.

Frequently Asked Questions about data-engineer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design an ETL pipeline for customer data using Apache Airflow?▼

To design an ETL pipeline, you define extraction, transformation, and loading workflows that ingest source data and route it into a central repository. This process automates daily data integration using Apache Airflow for scheduling.

What is the best way to build a data warehouse schema for business analytics?▼

Building a data warehouse schema involves structuring robust tables optimized for querying and reporting. This approach supports business analytics by facilitating efficient data consolidation and enabling fast insights from centralized data.

Can I use Snowflake for real-time stream processing in my data infrastructure?▼

Yes, Snowflake can serve as the target data warehouse for real-time stream processing. The infrastructure supports streaming data ingestion, allowing you to process continuous data feeds for immediate analytics and reporting.

How do I optimize SQL queries for reporting inside a data warehouse?▼

Optimizing SQL queries for reporting requires structuring your data warehouse schema to reduce scan volumes and improve join efficiency. This ensures fast data retrieval and facilitates smooth business intelligence reporting.

Do I need a data warehouse to automate daily ingestion and transformation of sales data?▼

You need a data warehouse to centralize automated daily ingestion and transformation of sales data. Developing robust warehouse structures allows you to consolidate multiple data sources for accurate and unified reporting.

When should I not use a centralized ETL pipeline for data integration?▼

You should not use a centralized ETL pipeline if your data integration requires highly unstructured data processing without clear transformation rules. ETL pipelines work best when you need structured, scheduled workflows for consistent data warehousing.

Related Skills

Explore More Data & Analytics Skills→
zjykzkzjykzk

data-ingest

Ingest raw text data into an Obsidian wiki as searchable knowledge.

Community
Intermediate
akillnessakillness
40

data-analysis

Analyze CSV, JSON, and SQL datasets with Python pandas workflows.

Community
Intermediate
truongnattruongnat

data-engineering-pro

Orchestrate ETL/ELT pipelines and data warehouse architectures with Kafka, Spark, and Flink.

Community
Advanced
Tony363Tony363
19

agent-data-engineer

Designs and implements scalable data pipelines and ETL/ELT processes for cloud platforms.

Community
Advanced