bigquery

Optimize BigQuery SQL, partitioning, clustering, and ML workflows for recommendation systems.

Updated Jan 14, 2026
One-click install
npx skills add https://github.com/ilorozco11/agent-skill --skill bigquery-ilorozco11
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: bigquery
Source: https://github.com/ilorozco11/agent-skill/tree/main/.github/skills/bigquery
Command: npx skills add https://github.com/ilorozco11/agent-skill --skill bigquery-ilorozco11

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

BigQuery workloads for recommendation systems can be slow and costly without proper patterns. This Skill provides proven patterns for writing efficient SQL, partitioning and clustering, and feature engineering to speed up analytics and model training.

Core Features & Use Cases

  • Optimized SQL templates for large-scale joins and aggregations
  • Partitioning, clustering, and materialized views to reduce cost and latency
  • Feature engineering patterns for user, product, and interaction signals
  • BigQuery ML matrix factorization models and end-to-end workflows
  • Cost monitoring and governance guidance for cloud analytics

Quick Start

Use the bigquery skill to generate an optimized user_features table from raw_events, using partitioning and clustering.

Frequently Asked Questions about bigquery

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize BigQuery SQL queries for recommendation systems?

To optimize BigQuery SQL for recommendation systems, use scalable SQL templates for large-scale joins and aggregations, apply partitioning and clustering, and use materialized views to reduce query cost and latency.

What is the best way to structure BigQuery feature engineering for user and product data?

The best way to structure BigQuery feature engineering is to apply modular patterns for user, product, and interaction signals, transforming raw events into optimized feature tables to speed up analytics and model training.

Can I train matrix factorization models directly in BigQuery ML?

Yes, you can train matrix factorization models directly in BigQuery ML using end-to-end workflows that integrate feature engineering with model training to build scalable recommendation systems.

When should I use partitioning and clustering in BigQuery?

You should use partitioning and clustering in BigQuery when processing large-scale recommendation workloads to minimize data scanned, reduce cost and latency, and improve query performance for streaming data.

Does this BigQuery workflow handle streaming data for real-time recommendations?

Yes, the BigQuery workflow handles streaming data by providing modular patterns and guidance for streaming data ingestion, ensuring your recommendation system features and models remain up-to-date.

Why are my BigQuery ML model training queries so slow and expensive?

BigQuery ML training queries are often slow and expensive due to unoptimized SQL, missing partitioning and clustering, or inefficient feature engineering, which can be fixed using scalable SQL templates and materialized views.