gcp-bq-data-loading

Name: gcp-bq-data-loading
Availability: InStock
Author: FunnelEnvy

Load CSV, JSON, Avro, and Parquet data into BigQuery.

1|Updated Dec 11, 2025

Search Tags:#JSON #BigQuery #Parquet #CSV #data-loading #schema-detection

Ready to run

npx skills add https://github.com/FunnelEnvy/agents_webinar_demos --skill gcp-bq-data-loading

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: gcp-bq-data-loading
Source: https://github.com/FunnelEnvy/agents_webinar_demos/tree/main/.claude/skills/gcp-bq-data-loading
Command: npx skills add https://github.com/FunnelEnvy/agents_webinar_demos --skill gcp-bq-data-loading

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

BigQuery data loading can be error-prone and time-consuming when dealing with multiple formats (CSV, JSON, Avro, Parquet) and sources (Cloud Storage, local files). This skill streamlines the end-to-end process, including schema detection and incremental loading, while handling common parsing errors.

Core Features & Use Cases

Multi-format loading: Load data from CSV, JSON, Avro, and Parquet into BigQuery.
Schema handling: Supports autodetect as well as explicit schemas; incremental loading with replacements or append.
Operational scenarios: Automate nightly data loads, ETL pipelines, or ad-hoc data migrations from Cloud Storage or local paths.

Quick Start

Use the gcp-bq-data-loading skill to import a sample CSV into BigQuery: bq load --source_format=CSV --autodetect my-project:my_dataset.my_table gs://bucket/path/data.csv

Frequently Asked Questions about gcp-bq-data-loading

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate loading CSV and JSON files into BigQuery?▼

Load CSV and JSON files into BigQuery automatically by using this skill to handle schema detection, incremental loading, and error handling. It supports both Cloud Storage paths and local file inputs for streamlined ingestion.

Can I load Parquet and Avro data into BigQuery with schema autodetect?▼

Yes, loading Parquet and Avro data into BigQuery supports schema autodetect. This skill handles multiple formats including CSV and JSON, utilizing both autodetect and explicit schema configurations for accurate table structures.

Do I need the bq CLI to load local files into BigQuery incrementally?▼

Yes, you need the bq CLI from Google Cloud SDK to load local files into BigQuery incrementally. This skill requires the bq CLI to execute loads with append or replace strategies for your operational data pipelines.

What is the best way to handle schema detection when loading JSON into BigQuery?▼

The best way to handle schema detection when loading JSON into BigQuery is using schema autodetect. This skill streamlines the process by supporting both autodetect and explicit schema configurations to prevent common parsing errors.

Why does my BigQuery data loading fail when importing multiple formats from Cloud Storage?▼

BigQuery data loading from multiple formats like CSV and Parquet often fails due to schema mismatches or parsing errors. This skill provides robust error handling and schema detection to streamline imports from Cloud Storage.