skills.rest
hmzainjamil
hmzainjamilCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

data-pipeline

Build automated ETL pipelines extracting, transforming, and loading data across systems.

1|Updated May 18, 2026
Search Tags:#automation#monitoring#analytics#data pipeline#transformation#etl#data integration
One-click install
npx skills add https://github.com/hmzainjamil/claude-office-skills --skill data-pipeline-hmzainjamil
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-pipeline
Source: https://github.com/hmzainjamil/claude-office-skills/tree/main/data-pipeline
Command: npx skills add https://github.com/hmzainjamil/claude-office-skills --skill data-pipeline-hmzainjamil

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you design and automate end-to-end data pipelines so information can move reliably from APIs, databases, files, and SaaS tools into analytics destinations with less manual work and fewer errors.

Core Features & Use Cases

  • Extraction: Pull data from REST APIs, GraphQL endpoints, databases, files, webhooks, and common SaaS systems like Shopify, Stripe, Salesforce, and HubSpot.
  • Transformation: Clean, normalize, deduplicate, enrich, filter, map, and aggregate records with reproducible ETL logic.
  • Loading and Ops: Deliver processed data into warehouses, databases, spreadsheets, files, or APIs while supporting scheduling, retries, monitoring, alerts, and quality checks.
  • Use Case: A team can run a daily sales pipeline that combines Shopify and Stripe data, transforms it into analytics-ready rows, loads it into BigQuery, and updates a reporting sheet automatically.

Quick Start

Ask the skill to build a daily ETL workflow that extracts data from your chosen sources, transforms it into a clean schema, and loads it into your preferred analytics destination.

Frequently Asked Questions about data-pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate ETL workflows from sources like REST APIs and SaaS platforms?▼

Automating ETL workflows involves extracting data from REST APIs, databases, and SaaS platforms like Shopify or Stripe, transforming it through cleaning and deduplication, and loading it into analytics destinations with automated scheduling and monitoring.

What is the best way to build a data pipeline that loads data into a warehouse?▼

Building a data pipeline requires extracting records from your sources, applying schema validation and data quality checks during transformation, and reliably loading the processed information into your target warehouse or database.

Can I extract and combine data from Shopify and Stripe for daily analytics?▼

Yes, you can extract data from Shopify and Stripe, transform the combined records into analytics-ready rows by normalizing and enriching them, and load the results into a destination like BigQuery for reporting.

How do you handle data quality checks and retries in an automated data pipeline?▼

Automated data pipelines handle data quality checks through schema validation and reliable destination loading, while production ETL logic manages operational reliability via automated retry handling and monitoring alerts.

Does this data pipeline approach support loading transformed data into spreadsheets and files?▼

Yes, this data pipeline approach supports loading processed data into various destinations including data warehouses, databases, spreadsheets, files, and APIs after the transformation logic is applied.

When do I need schema validation and deduplication in my ETL process?▼

Schema validation and deduplication are needed during the transformation phase of an ETL process to clean, normalize, and enrich records, ensuring the data loaded into analytics destinations is accurate and reproducible.

Related Skills

Explore More Data & Analytics Skills→
uphiagouphiago
1.1k

firebase-supabase-attack

Probe Firebase and Supabase backends for publicly exposed data.

Community
Advanced
ScientiaCapitalScientiaCapital
28

hubspot-revops-skill

Integrate HubSpot API with a SQL warehouse to analyze revenue analytics.

Community
Advanced
vasilyu1983vasilyu1983
73

ai-mlops

Automate production ML lifecycle with drift monitoring and automated retraining.

Community
Advanced
sandeepmvlsandeepmvl
21

data-warehouse-integration

Design ELT pipelines syncing Rails Postgres to cloud warehouses with dbt.

Community
Advanced