data-engineer

Automate scalable data pipelines with Spark, dbt, and Airflow.

Updated Feb 24, 2026
One-click install
npx skills add https://github.com/chicanoandres702/SentientAIBrowser --skill data-engineer-chicanoandres702
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-engineer
Source: https://github.com/chicanoandres702/SentientAIBrowser/tree/main/.agents/workflows/data-engineer
Command: npx skills add https://github.com/chicanoandres702/SentientAIBrowser --skill data-engineer-chicanoandres702

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Data engineers spend time designing, orchestrating, and maintaining scalable pipelines. This Skill provides a blueprint to automate data ingestion, transformation, orchestration, and deployment across modern data stacks.

Core Features & Use Cases

  • Scalable batch and streaming pipelines with Spark, dbt, and Airflow
  • Cloud-native data platforms integration for warehousing and lakehouse architectures
  • End-to-end data engineering orchestration, monitoring, and governance

Quick Start

Instruct the AI to design and deploy a data pipeline that ingests from S3, transforms with dbt, and loads into Snowflake.

Frequently Asked Questions about data-engineer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build scalable data pipelines for both batch and streaming workloads?

Build scalable data pipelines by applying orchestration and transformation frameworks to automate ingestion and deployment. This approach handles both batch and streaming workloads across cloud data platforms to generate real-time analytics infrastructure.

Can I orchestrate ingestion from S3, transformation with dbt, and loading into Snowflake?

Yes, you can orchestrate a data pipeline that ingests from S3, transforms with dbt, and loads into Snowflake. This automates end-to-end data engineering tasks including ingestion, transformation, and deployment across modern data stacks.

What is the best way to design lakehouse architectures using Spark and Airflow?

Design lakehouse architectures by integrating cloud-native data platforms with Spark and Airflow for orchestration. This combination provides a blueprint to automate data engineering tasks, enabling scalable warehousing and pipeline monitoring.

Does this approach support end-to-end data engineering governance and monitoring?

End-to-end data engineering governance and monitoring are supported through automated orchestration across cloud data platforms. This applies to both batch and streaming workloads, ensuring pipeline reliability and scalable analytics infrastructure.

When do I need cloud-native services for modern data stack design?

You need cloud-native services for modern data stack design when building scalable batch and streaming pipelines. This approach enables automated data ingestion, transformation, and deployment across cloud data platforms using Spark, dbt, and Airflow.