skills.rest
RxFit
RxFitCOMMUNITY
Explore all skills by this author →
GitHub

gcp-data-pipelines

Detect existing Google Cloud data pipelines and recommend suitable tools.

Updated Jun 5, 2026
Search Tags:#data pipeline#dbt#BigQuery#Google Cloud#Dataflow
One-click install
npx skills add https://github.com/RxFit/hub-overlay --skill gcp-data-pipelines-rxfit
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: gcp-data-pipelines
Source: https://github.com/RxFit/hub-overlay/tree/main/hub/skills/gcp-data-pipelines
Command: npx skills add https://github.com/RxFit/hub-overlay --skill gcp-data-pipelines-rxfit

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill empowers users to quickly understand and build their Google Cloud data pipelines by suggesting the appropriate tools for each use case and managing pipeline configurations and operations.

Core Features & Use Cases

  • Pipeline Identification: Scans the workspace to detect existing data pipelines using specific indicator files.
  • Tool Recommendation: Based on user requirements and the type of pipeline, recommends the most suitable Google Cloud tool such as Dataflow, dbt, or Spark.
  • Deployment and Orchestration: Provides options for orchestrating and deploying pipelines with services like Cloud Composer or resource creation tools.
  • Task Execution Workflow: Outlines a step-by-step process to confirm tool selection, clarify execution scope, and define execution method.
  • Next Steps Activation: Upon confirmation, activates the selected tool's corresponding skill.

Quick Start

Run 'gcp-data-pipelines skill help' for assistance on navigating Google Cloud data pipelines and choosing the appropriate tool.

Frequently Asked Questions about gcp-data-pipelines

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I choose the right Google Cloud tool for my data pipeline?▼

Choosing the right Google Cloud data pipeline tool requires assessing your requirements. This Skill evaluates your use case and recommends the most suitable tool, such as Dataflow, dbt, or Spark, based on your specific data processing needs.

Can I detect existing data pipelines in my GCP workspace?▼

Yes, you can detect existing data pipelines in your GCP environment. The Skill scans your workspace for specific indicator files to identify and manage currently configured dbt, Dataflow, or BigQuery DTS pipelines.

What is the process for orchestrating pipeline execution on Google Cloud?▼

Orchestrating pipeline execution on Google Cloud involves confirming tool selection, clarifying execution scope, and defining the execution method. The Skill guides this workflow and supports deployment using services like Cloud Composer.

Do I need GCP environment access to manage data pipelines with this Skill?▼

Yes, you need GCP environment access to manage data pipelines with this Skill. It requires active connectivity to your Google Cloud environment to assess requirements, orchestrate execution, and handle deployment operations.

Does this Skill work with dbt and BigQuery for data transformations?▼

Yes, this Skill works with dbt and BigQuery for data transformations. It navigates and manages Google Cloud data pipeline tools, including dbt for SQL transformations and BigQuery DTS for scheduled data transfers.

Related Skills

Explore More Data & Analytics Skills→
minicooheiminicoohei
345

gcp-auth

Authenticate Google Cloud Platform using Application Default Credentials.

Community
Advanced
AubreyHanAubreyHan

gcp-data-pipelines

Route Google Cloud data pipeline requests to the correct build, deployment, or orchestration skill.

Community
Advanced
AubreyHanAubreyHan

gcp-composer-troubleshooting

Diagnose failed Cloud Composer and Airflow pipelines via Cloud Logging and DAG retrieval.

Community
Advanced
stephanjstephanj
9

spark-engineer

Optimize Apache Spark applications for performance and pipeline architecture.

Community
Advanced