skills.rest
rose4320
rose4320COMMUNITY
Explore all skills by this author →
GitHub

gcp-data-pipelines

Guides selection of Google Cloud tools for building and orchestrating data pipelines.

Updated Aug 23, 2026
Search Tags:#data pipeline#orchestration#dbt#BigQuery#Google Cloud#Dataflow
One-click install
npx skills add https://github.com/rose4320/Eldonia-Nex --skill gcp-data-pipelines-rose4320
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: gcp-data-pipelines
Source: https://github.com/rose4320/Eldonia-Nex/tree/main/.cursor/skills/gcp-data-pipelines
Command: npx skills add https://github.com/rose4320/Eldonia-Nex --skill gcp-data-pipelines-rose4320

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill helps users build, manage, and orchestrate data pipelines on Google Cloud Platform (GCP) with ease, selecting the right tool for their specific needs.

Core Features & Use Cases

  • Skill Selection: Guides users to the appropriate skill for dbt, Dataflow, Dataform, Spark, BigQuery Data Transfer Service, or orchestration pipeline using Cloud Composer.
  • Requirement Clarification: Assists in clarifying requirements and resolving ambiguity for creating, updating, and running data pipelines.
  • Tool Recommendations: Recommends tools based on user requirements and context, such as BigQuery DTS, dbt, Dataflow, Dataform, Spark, or general GCP assistance.
  • Pipeline Orchestration: Offers options for orchestrating and deploying pipelines using Cloud Composer or other orchestration tools.

Quick Start

Use the gcp-data-pipelines skill to guide the selection and setup of a data pipeline for your specific needs on Google Cloud.

Frequently Asked Questions about gcp-data-pipelines

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I choose the right data pipeline tool on Google Cloud?▼

Building data pipelines on Google Cloud involves selecting the right tool for your requirements. This Skill clarifies ambiguity and recommends appropriate tools like BigQuery DTS, dbt, Dataflow, Dataform, or Spark for creating, updating, and running pipelines.

What is the best way to orchestrate data pipelines using Cloud Composer?▼

Orchestrating data pipelines using Cloud Composer is supported by this Skill through guided deployment and management options. It recommends orchestration tools based on your specific pipeline requirements and Google Cloud environment context.

When should I use Dataflow versus Dataform for pipeline management?▼

Using Dataflow versus Dataform depends on your specific pipeline requirements. This Skill clarifies your needs and recommends the appropriate tool for building, managing, and orchestrating data pipelines on Google Cloud Platform.

Do I need prior knowledge of Google Cloud services to manage data pipelines?▼

Prior knowledge of Google Cloud services and data pipeline management is required. This Skill assists by guiding skill selection, clarifying requirements, and providing tool recommendations for various pipeline tools and orchestration on Google Cloud Platform.

Can I use dbt with BigQuery Data Transfer Service for my pipeline?▼

Using dbt with BigQuery Data Transfer Service is supported through this Skill's tool recommendations. It guides the selection and setup of data pipelines by matching tools like dbt and BigQuery DTS to your specific requirements on Google Cloud.

How to resolve ambiguity when creating data pipelines on Google Cloud?▼

Resolving ambiguity when creating data pipelines on Google Cloud is handled by this Skill through requirement clarification. It assists in defining needs for creating, updating, and running pipelines, ensuring proper tool selection for tools like Dataflow, Spark, or dbt.

Related Skills

Explore More Data & Analytics Skills→
ironkid90ironkid90

gcp-data-pipelines

Guide building, managing, and orchestrating data pipelines on Google Cloud.

Community
Advanced
ironkid90ironkid90

gcp-pipeline-orchestration

Generate and update orchestration pipeline definitions for Google Cloud Composer.

Community
Advanced
2nth-ai2nth-ai
1

tech/google/cloud/data

Query BigQuery, publish to Pub/Sub, and run Dataflow pipelines.

Official
Advanced
distribucionesfayosmoreno-sysdistribucionesfayosmoreno-sys

ml-pipeline-workflow

Orchestrate end-to-end MLOps pipelines from data preparation to deployment.

Community
Advanced