dataform-bigquery

Code and validate Dataform pipelines for BigQuery ELT workflows.

Updated Jun 5, 2026
One-click install
npx skills add https://github.com/RxFit/hub-overlay --skill dataform-bigquery-rxfit
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: dataform-bigquery
Source: https://github.com/RxFit/hub-overlay/tree/main/hub/skills/dataform-bigquery
Command: npx skills add https://github.com/RxFit/hub-overlay --skill dataform-bigquery-rxfit

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill solves complex Dataform pipeline issues for BigQuery ELT, ensuring accurate, efficient, and maintainable code, especially when dealing with intricate workflows, large datasets, or cross-project integrations.

Core Features & Use Cases

  • Advanced Dataform Pipeline Management: Code, optimize, and maintain Dataform pipelines for BigQuery, handling all aspects of ELT processes.
  • Environment Verification: Checks installation of dataform and bq CLI tools, and manages GCP project setup.
  • Code Validation and Compilation: Utilizes dataform compile and dataform run --dry-run to validate SQL logic and handle errors.

Quick Start

Run the skill by executing the following command to start a new pipeline for your BigQuery project: dataform init <PROJECT_DIR> <PROJECT_ID> <DEFAULT_LOCATION>

Frequently Asked Questions about dataform-bigquery

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build Dataform pipelines for BigQuery ELT workflows?

You can build Dataform pipelines for BigQuery ELT by coding and validating SQL logic within a Dataform project. Initialize your directory using the `dataform init` command with your project ID and default location to start managing the workflow.

What is the best way to validate Dataform SQL code before running it in BigQuery?

The best way to validate Dataform SQL code is by executing `dataform compile` and `dataform run --dry-run`. These commands validate SQL logic and handle errors to ensure pipeline accuracy before execution in BigQuery.

Do I need specific CLI tools installed to manage Dataform pipelines for BigQuery?

Yes, you need the `dataform` and `bq` CLI tools installed to manage Dataform pipelines for BigQuery. The environment verification process checks these installations and manages your GCP project setup to ensure accurate pipeline execution.

Can I use Dataform for cross-project integrations and large datasets in BigQuery?

Yes, you can use Dataform for cross-project integrations and large datasets in BigQuery. It addresses complex pipeline issues by ensuring accurate, efficient, and maintainable code tailored for intricate workflows and large-scale data processing.

How do I start a new Dataform pipeline for my BigQuery project?

To start a new Dataform pipeline for your BigQuery project, execute the `dataform init <PROJECT_DIR> <PROJECT_ID> <DEFAULT_LOCATION>` command. This initializes the required directory structure and environment for your ELT tasks.

Why does my Dataform pipeline fail during BigQuery environment setup?

Dataform pipeline environment setup may fail if the `dataform` or `bq` CLI tools are missing. The environment verification step checks for these dependencies and manages your GCP project setup to prevent execution errors.