gcp-pipeline-resource-provisioning

Provision GCP data pipeline resources from a deployment.yaml specification.

2|1|Updated May 25, 2026
One-click install
npx skills add https://github.com/interflownex/All-in-One --skill gcp-pipeline-resource-provisioning-interflownex
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: gcp-pipeline-resource-provisioning
Source: https://github.com/interflownex/All-in-One/tree/main/.gemini/skills/gcp-pipeline-resource-provisioning
Command: npx skills add https://github.com/interflownex/All-in-One --skill gcp-pipeline-resource-provisioning-interflownex

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This skill eliminates manual infrastructure configuration errors by providing a standardized, declarative approach to provisioning GCP data pipeline resources like BigQuery, Dataform, and Dataproc.

Core Features & Use Cases

  • Declarative Provisioning: Manage environment-specific infrastructure (dev, stage, prod) using a single deployment.yaml file.
  • Resource Lifecycle Management: Automate the creation and patching of BigQuery datasets, tables, and Dataform workflows.
  • Use Case: A data engineer needs to deploy a new BigQuery dataset and a corresponding Dataform workflow across multiple environments without manually clicking through the GCP console.

Quick Start

Use the gcp-pipeline-resource-provisioning skill to validate and deploy the infrastructure defined in your deployment.yaml file for the dev environment.

Frequently Asked Questions about gcp-pipeline-resource-provisioning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate BigQuery and Dataform provisioning across multiple GCP environments?

You can automate BigQuery and Dataform provisioning by defining environment-specific configurations in a centralized deployment.yaml file, which standardizes declarative resource creation across dev, stage, and prod.

What is declarative infrastructure provisioning for GCP data pipelines?

Declarative GCP infrastructure provisioning manages the resource lifecycle of BigQuery datasets, tables, and Dataproc workflows through a single specification, eliminating manual configuration errors.

Do I need gcloud CLI to deploy GCP data pipeline resources using a deployment.yaml file?

Yes, you need gcloud CLI integration to validate and apply infrastructure changes defined in your deployment.yaml file for your GCP data pipeline resources.

Can I manage strict labeling and secret management policies for Dataproc and BigQuery declaratively?

Yes, declarative provisioning enforces strict labeling and secret management policies automatically when applying infrastructure changes to BigQuery and Dataproc resources.

What's the best way to patch existing BigQuery datasets and Dataform workflows without using the GCP console?

The best way to patch existing BigQuery datasets and Dataform workflows is to update your deployment.yaml file and apply the changes via gcloud CLI to manage the resource lifecycle declaratively.