dataform-bigquery

Automate Dataform pipeline creation, validation, and optimization for BigQuery ELT workflows.

161|37|Updated Apr 2, 2026
One-click install
npx skills add https://github.com/gemini-cli-extensions/data-agent-kit-starter-pack --skill dataform-bigquery
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: dataform-bigquery
Source: https://github.com/gemini-cli-extensions/data-agent-kit-starter-pack/tree/main/skills/dataform-bigquery
Command: npx skills add https://github.com/gemini-cli-extensions/data-agent-kit-starter-pack --skill dataform-bigquery

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Data engineers and analysts need to build, manage, and optimize ELT pipelines on BigQuery using Dataform, ensuring correctness, repeatability, and maintainability across transformations and deployments.

Core Features & Use Cases

  • Dataform-based pipeline generation for BigQuery ELT, including source declarations, transformations, and materializations.
  • Guidance on automatic data cleaning and SQL optimizations following established protocols.
  • End-to-end workflow planning, repository initialization, and validation steps for production-grade pipelines.

Quick Start

Initialize a new Dataform project configured for BigQuery ELT pipelines and run a dry-run to validate the setup.

Frequently Asked Questions about dataform-bigquery

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build BigQuery ELT pipelines with Dataform?

To build BigQuery ELT pipelines with Dataform, you can automate repository initialization, declare sources, develop SQLX transformations, and validate workflows via compile and dry-run. This ensures correctness and maintainability across deployments.

What is the best way to optimize SQLX transformations for BigQuery?

The best way to optimize SQLX transformations for BigQuery is applying established SQL optimization protocols and automatic data cleaning during pipeline generation. This ensures production-grade performance and strict safety constraints across your ELT workflows.

Do I need to handle specific credentials for Dataform BigQuery workflows?

Yes, you need to handle specific credentials for Dataform BigQuery workflows. The setup includes credential handling and environment verification to ensure secure access and strict safety constraints during pipeline execution and validation.

How do I validate Dataform pipelines before deploying to BigQuery?

You validate Dataform pipelines before deploying to BigQuery by running compile and dry-run operations. These end-to-end validation steps verify your environment setup and SQLX development to ensure production-grade pipeline correctness.

Can I use this to automate data cleaning in BigQuery ELT pipelines?

Yes, you can automate data cleaning in BigQuery ELT pipelines. The workflow applies automatic data cleaning and SQL optimization protocols following established guidelines to maintain data quality during transformations and materializations.