gcp-pipeline-resource-provisioning

Provision GCP pipeline resources from a deployment.yaml file.

Updated Jun 10, 2026
One-click install
npx skills add https://github.com/AubreyHan/SKILL_Repo --skill gcp-pipeline-resource-provisioning-aubreyhan
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: gcp-pipeline-resource-provisioning
Source: https://github.com/AubreyHan/SKILL_Repo/tree/main/gcp-pipeline-resource-provisioning
Command: npx skills add https://github.com/AubreyHan/SKILL_Repo --skill gcp-pipeline-resource-provisioning-aubreyhan

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill removes the manual overhead of provisioning environment-specific GCP pipeline resources by centralizing definitions in a single deployment.yaml file.

Core Features & Use Cases

  • Declarative Provisioning: Define BigQuery, Dataform, Dataproc, and DTS resources in a consistent YAML format.
  • Environment Management: Maintain separate dev, staging, and prod configurations while keeping shared configuration together.
  • Safe Resource Setup: Enforce required labels, secret references, and validation steps before deployment.
  • Use Case: A data platform engineer can update one deployment.yaml file to create a dataset, configure a DTS transfer, and deploy the full setup for a specific environment.

Quick Start

Use this skill to create or update deployment.yaml for the target environment and deploy the supported GCP resources.

Frequently Asked Questions about gcp-pipeline-resource-provisioning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate provisioning GCP pipeline resources across dev, staging, and prod?

Automate GCP pipeline resource provisioning by defining BigQuery, Dataform, Dataproc, and DTS resources in a single deployment.yaml file to deploy across dev, staging, and prod environments.

Can I deploy BigQuery datasets and Dataproc clusters from a single configuration file?

Yes, you can deploy BigQuery datasets and Dataproc clusters together by defining them declaratively in one deployment.yaml file, which centralizes environment-specific setup and shared configurations.

What is required to set up Dataform and BigQuery Data Transfer Service resources declaratively?

Setting up Dataform and DTS resources declaratively requires validated resource definitions, explicit datacloud labels, secret references, and orchestration-pipelines deployment support in your configuration.

Does declarative GCP provisioning enforce required labels and validation before deployment?

Yes, declarative GCP provisioning enforces safe resource setup by validating resource definitions, requiring explicit datacloud labels, and checking secret references before applying any environment-specific deployment.

What is the best way to manage environment-specific configurations for GCP data pipelines?

The best way to manage GCP pipeline configurations is using a single deployment.yaml file to maintain separate dev, staging, and prod environments while keeping shared configuration centralized.

Why do I need explicit datacloud labels and secret references in my deployment.yaml?

Explicit datacloud labels and secret references are required in deployment.yaml to enforce safe resource setup, ensure proper validation steps, and maintain consistent orchestration-pipelines deployment support across environments.