skills.rest
ironkid90
ironkid90COMMUNITY
Explore all skills by this author →
GitHub

gcp-data-pipelines

Guide building, managing, and orchestrating data pipelines on Google Cloud.

Updated Jun 15, 2026
Search Tags:#gcp#orchestration#data pipelines#bigquery#dataflow
One-click install
npx skills add https://github.com/ironkid90/lucky5-v8 --skill gcp-data-pipelines-ironkid90
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: gcp-data-pipelines
Source: https://github.com/ironkid90/lucky5-v8/tree/main/plugins/skills/gcp-data-pipelines
Command: npx skills add https://github.com/ironkid90/lucky5-v8 --skill gcp-data-pipelines-ironkid90

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides expert guidance for building, managing, and orchestrating data pipelines on Google Cloud Platform (GCP), helping users select the appropriate tool for their needs and clarifying requirements for creating, updating, and running data pipelines.

Core Features & Use Cases

  • Guidance for Tool Selection: Offers a clear framework for choosing between tools like dbt, Dataflow, Dataform, Spark, BigQuery DTS, and Cloud Composer based on user requirements.
  • Pipeline Detection: Scans the workspace for existing pipeline indicators (e.g., .java, .py, workflow_settings.yaml) to provide targeted recommendations.
  • Task Execution Workflow: Outlines a structured approach for executing tasks such as detecting existing pipelines, presenting tool options, and confirming selections.
  • Run Request Clarification: Provides a systematic way to understand the user's intent when asking to "run the pipeline" by clarifying scope and method.

Quick Start

Use the gcp-data-pipelines skill to detect and manage your data pipelines on Google Cloud Platform.

Frequently Asked Questions about gcp-data-pipelines

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build and orchestrate data pipelines on Google Cloud Platform?▼

To build and orchestrate data pipelines on Google Cloud, this skill guides you through selecting appropriate ingestion, transformation, and orchestration tools while providing a structured workflow for executing and scheduling pipeline tasks.

What is the best way to choose between Dataflow, Dataform, and Cloud Composer for data transformation?▼

Choosing between Dataflow, Dataform, and Cloud Composer depends on your specific requirements. This skill offers a clear framework to help you select the right GCP tool for data ingestion, transformation, and orchestration based on your pipeline needs.

Can I detect existing data pipelines in my GCP workspace?▼

Yes, you can detect existing data pipelines in your GCP workspace. The skill scans your environment for pipeline indicators like Python scripts, Java files, or workflow settings to provide targeted management recommendations.

How do I clarify run requests when executing a BigQuery data pipeline?▼

To clarify run requests for a BigQuery data pipeline, the skill systematically interprets your intent by clarifying the scope and method of execution, ensuring accurate task completion when you ask to run the pipeline.

Does this GCP data pipeline skill support dbt for orchestration?▼

Yes, the skill supports dbt for orchestration. It includes dbt in its framework alongside Dataflow, Dataform, Spark, BigQuery Data Transfer Service, and Cloud Composer to help you select the best tool for your pipeline requirements.

Related Skills

Explore More Data & Analytics Skills→
ironkid90ironkid90

federate-lakehouse-catalog

Connect remote Iceberg REST Catalogs to GCP engines for cross-cloud querying.

Community
Advanced
MubasherMohammedMubasherMohammed

bigquery-public

Execute read-only SQL queries on BigQuery public datasets and save results locally.

Community
Intermediate
RxFitRxFit

gcp-spark

Develop, execute, and manage Spark applications on Google Cloud Platform.

Community
Advanced
JosiahSiegelJosiahSiegel
51

fabric-onelake-2025

...

Community
Advanced