bigquery

Query and manage Google BigQuery datasets via CLI and REST API.

2|1|Updated Jul 19, 2024

Search Tags:#sql #cloud #bigquery #export #rest-api #dataset-management #bq-cli

Ready to run

npx skills add https://github.com/TeamDay-AI/agents --skill bigquery-teamday-ai

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: bigquery
Source: https://github.com/TeamDay-AI/agents/tree/main/skills/teamday/bigquery
Command: npx skills add https://github.com/TeamDay-AI/agents --skill bigquery-teamday-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Efficiently query, export, and manage Google BigQuery datasets from the command line or REST API, reducing manual toil and speeding data workflows.

Core Features & Use Cases

Run standard SQL queries against datasets using the bq CLI or REST API.
List, create, and manage datasets and tables, export results to CSV/JSON, and monitor job status.
Use cases include ad-hoc analytics, data catalog maintenance, ETL automation, and data migration tasks.

Quick Start

Run a sample query against a dataset to verify access and outputs.

Frequently Asked Questions about bigquery

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I run SQL queries against BigQuery datasets from the command line?▼

Run SQL queries against BigQuery datasets using the bq CLI or REST API to execute standard SQL statements. This enables ad-hoc analytics and ETL pipeline automation directly from the command line.

What do I need to authenticate BigQuery REST API requests?▼

To authenticate BigQuery REST API requests, you need the bq CLI installed and credentials provided via GOOGLE_APPLICATION_CREDENTIALS_JSON and BIGQUERY_PROJECT_ID environment variables to authorize dataset and table operations.

Can I export BigQuery query results to CSV or JSON?▼

Yes, you can export BigQuery query results to CSV or JSON formats. The Skill supports exporting data outputs and monitoring job status for data migration tasks and analytics workflows.

How do I list and manage BigQuery datasets and tables?▼

List and manage BigQuery datasets and tables by executing dataset-management operations through the bq CLI. This supports data catalog maintenance and allows you to create, list, and organize tables across projects.

Is the bq CLI required for BigQuery dataset management and export operations?▼

Yes, the bq CLI is required for BigQuery dataset management and export operations. The Skill relies on the bq CLI installed locally alongside GOOGLE_APPLICATION_CREDENTIALS_JSON to authenticate and authorize operations.

What is the best way to automate ETL pipelines with BigQuery?▼

The best way to automate ETL pipelines with BigQuery is using the bq CLI and REST API to run standard SQL queries, manage datasets, and export results. This reduces manual toil and speeds up data workflows.