gcp-dataflow

Design, package, deploy, and diagnose Apache Beam pipelines on Google Cloud Dataflow.

161|37|Updated Apr 2, 2026
One-click install
npx skills add https://github.com/gemini-cli-extensions/data-agent-kit-starter-pack --skill gcp-dataflow
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: gcp-dataflow
Source: https://github.com/gemini-cli-extensions/data-agent-kit-starter-pack/tree/main/skills/gcp-dataflow
Command: npx skills add https://github.com/gemini-cli-extensions/data-agent-kit-starter-pack --skill gcp-dataflow

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Guides data engineers and teams in designing, packaging, deploying, and diagnosing Apache Beam pipelines on Google Cloud Dataflow, reducing setup guesswork and runtime toil.

Core Features & Use Cases

  • Design and packaging guidance for Apache Beam pipelines on Dataflow across Java, Python, and Go SDKs.
  • Troubleshooting and diagnostics with Dataflow metrics, logs, and best practices for performance tuning and error handling.
  • Real-world use cases including creating new pipelines, configuring Flex Templates, and optimizing end-to-end data processing.

Quick Start

Run a guided workflow to scaffold, deploy, and troubleshoot a Dataflow pipeline end-to-end.

Frequently Asked Questions about gcp-dataflow

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I troubleshoot Dataflow pipeline errors and diagnose job health?

Troubleshoot Dataflow pipeline errors by accessing comprehensive diagnostics with Dataflow metrics, logs, and best practices for performance tuning and error handling. This Skill helps diagnose job health across Java, Python, and Go SDKs.

How do I configure Flex Templates for Google Cloud Dataflow pipelines?

Configure Flex Templates for Google Cloud Dataflow by following guided packaging steps and integrating Cloud Build. This process enables you to create reusable and scalable Apache Beam pipeline templates.

Can I build Apache Beam pipelines on Dataflow using Python and Go SDKs?

Yes, you can build Apache Beam pipelines on Dataflow using Java, Python, and Go SDKs. The Skill provides design and packaging guidance for creating new pipelines across all three SDKs.

What is the best way to optimize Apache Beam pipeline performance on Dataflow?

Optimize Apache Beam pipeline performance on Dataflow by applying best practices for performance tuning and error handling. The Skill provides comprehensive diagnostics with linked Dataflow metrics to guide your optimizations.

Why does my Dataflow Flex Template fail during Cloud Build deployment?

Dataflow Flex Template deployment failures during Cloud Build can be diagnosed using the Skill's guided project setup and troubleshooting workflows. It helps identify configuration issues and resolve job health problems during end-to-end pipeline deployment.