skills.rest
BAIZ1D
BAIZ1DCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

federate-lakehouse-catalog

Configure cross-cloud lakehouse catalog federation for GCP analytics engines.

Updated Jun 30, 2026
Search Tags:#bigquery#iceberg catalog#federated catalog#databricks unity catalog#aws glue data catalog#cross-cloud data#gcp analytics
One-click install
npx skills add https://github.com/BAIZ1D/macbookM1_rice --skill federate-lakehouse-catalog-baiz1d
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: federate-lakehouse-catalog
Source: https://github.com/BAIZ1D/macbookM1_rice/tree/main/agent/skills/federate-lakehouse-catalog
Command: npx skills add https://github.com/BAIZ1D/macbookM1_rice --skill federate-lakehouse-catalog-baiz1d

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill removes the need for manual data replication or custom integration work when you need to query data stored in remote cross-cloud lakehouse catalogs like Databricks Unity Catalog or AWS Glue Data Catalog directly from GCP analytics tools like BigQuery and Spark.

Core Features & Use Cases

  • Cross-Catalog Federation: Supports connecting GCP BigLake Iceberg federated catalogs to remote Databricks Unity Catalog and AWS Glue Data Catalog instances hosted on either GCP or AWS.
  • Native GCP Querying: Lets you run queries on remote catalog data directly from GCP services without moving or copying the underlying data to GCP.
  • Real-World Use Case: If your e-commerce team stores customer order data in a Databricks Unity Catalog on AWS and wants to run monthly sales performance reports in BigQuery without replicating the entire dataset to GCP, this skill automates the full end-to-end federation setup.

Quick Start

Use the federate-lakehouse-catalog skill to set up a secure federated connection between your GCP project and your AWS-hosted AWS Glue Data Catalog to query your inventory data from BigQuery.

Frequently Asked Questions about federate-lakehouse-catalog

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I query Databricks Unity Catalog data from BigQuery without replication?▼

Cross-cloud data federation connects BigLake Iceberg federated catalogs to remote Databricks Unity Catalog instances, enabling native BigQuery querying without manual data replication or migration to GCP.

Can I connect AWS Glue Data Catalog to GCP analytics engines directly?▼

Yes, you can connect AWS Glue Data Catalog to GCP analytics engines directly. The federation setup links your GCP project to AWS-hosted catalogs, allowing you to query inventory data from BigQuery or Spark without copying the data.

What is a BigLake Iceberg federated catalog and when do I need it?▼

A BigLake Iceberg federated catalog is a connection mechanism that lets GCP analytics services query remote cross-cloud lakehouse data. You need it when accessing Databricks or AWS Glue catalogs from BigQuery without moving the underlying datasets.

Does setting up cross-cloud catalog federation handle IAM permissions automatically?▼

Yes, setting up cross-cloud catalog federation handles IAM permissions automatically. The configuration includes automated setup of IAM permissions, secret management, and catalog synchronization to ensure secure, low-latency access to remote data.

What's the best way to run Spark queries on AWS-hosted lakehouse data from GCP?▼

The best way to run Spark queries on AWS-hosted lakehouse data from GCP is through cross-cloud data federation. This approach uses BigLake federated catalogs to connect GCP services to remote Databricks or Glue catalogs without data migration.

Related Skills

Explore More Data & Analytics Skills→
interflownexinterflownex
2

federate-lakehouse-catalog

Federate remote Iceberg REST catalogs into Google Cloud BigLake for cross-cloud querying.

Community
Advanced
ironkid90ironkid90

federate-lakehouse-catalog

Connect remote Iceberg REST Catalogs to GCP engines for cross-cloud querying.

Community
Advanced
gemini-cli-extensionsgemini-cli-extensions
161

federate-lakehouse-catalog

Federate Google Cloud Lakehouse catalogs to remote Iceberg catalogs.

Official
Advanced
databricks-solutionsdatabricks-solutions
1.8k

lakebase-provisioned

Deploy and manage Lakebase Provisioned PostgreSQL instances on Databricks with Unity Catalog integration.

Official
Intermediate