skills.rest
itsadijmbt
itsadijmbtCOMMUNITY
Explore all skills by this author →
GitHub

databricks-iceberg

Configure Apache Iceberg on Databricks with Unity Catalog for external engine access.

1|Updated Apr 24, 2026
Search Tags:#iceberg#snowflake#databricks#unity-catalog#uniform#pyiceberg#rest-catalog
One-click install
npx skills add https://github.com/itsadijmbt/SecureMCP-Servers --skill databricks-iceberg-itsadijmbt
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-iceberg
Source: https://github.com/itsadijmbt/SecureMCP-Servers/tree/main/TEST_SERVERS/PORTED_TO_SECUREMCP/databrickslab-mcp/ai-dev-kit/databricks-skills/databricks-iceberg
Command: npx skills add https://github.com/itsadijmbt/SecureMCP-Servers --skill databricks-iceberg-itsadijmbt

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps you operationalize Apache Iceberg on Databricks across multiple interoperability paths—creating native managed Iceberg tables, exposing Delta tables as Iceberg-readable data, and integrating external engines through the Unity Catalog Iceberg REST Catalog (IRC), including Snowflake catalog connectivity.

Core Features & Use Cases

  • Create and operate managed Iceberg tables: Define DDL/DML patterns, manage Liquid Clustering, run time travel queries, enable Predictive Optimization, and handle Iceberg v3 specifics and limitations.
  • Make Delta data readable as Iceberg without converting: Use UniForm for regular Delta tables and Compatibility Mode for streaming tables and materialized views (SDP pipelines), including refresh mechanics.
  • Enable external engine access via IRC: Configure authentication, network prerequisites (IP allowlists), grants (EXTERNAL USE SCHEMA), and understand credential vending and read/write capability boundaries.
  • Integrate with Snowflake: Set up Snowflake catalog integrations to read Databricks-managed Iceberg data and federate Databricks to Snowflake-managed Iceberg tables using foreign catalogs and authorized storage paths.
  • Guide external engine connection configurations: Provide per-engine setup patterns for reading (and where supported, writing) Databricks-managed Iceberg tables using IRC (e.g., PyIceberg and OSS Spark).

Quick Start

Enable Unity Catalog and create a managed Iceberg table using USING ICEBERG with PARTITIONED BY (or CLUSTER BY with the correct v2/v3 requirements) so external engines can access it through the IRC endpoint.

Frequently Asked Questions about databricks-iceberg

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I configure Apache Iceberg on Databricks for external engines?▼

To configure Apache Iceberg on Databricks, use Unity Catalog to create managed tables with USING ICEBERG or enable UniForm for Delta tables, then set up the Iceberg REST Catalog (IRC) with proper authentication and EXTERNAL USE SCHEMA grants for external engine access.

Can I read Delta tables as Iceberg without converting the data format?▼

Yes, you can read Delta tables as Iceberg without converting by enabling UniForm for regular Delta tables and using Compatibility Mode for streaming tables and materialized views, which generates Iceberg metadata for external query engines.

How do I connect Snowflake to Databricks Iceberg tables?▼

To connect Snowflake to Databricks Iceberg tables, configure a Snowflake catalog integration to read Databricks-managed data through the Unity Catalog Iceberg REST Catalog, ensuring network IP allowlists and credential vending requirements are met.

Do I need to install PyIceberg libraries in Databricks Runtime to use Iceberg?▼

No, you do not need to install PyIceberg or other Iceberg libraries in Databricks Runtime because Databricks provides native managed Iceberg table support and relies on the Unity Catalog Iceberg REST Catalog for external connectivity.

What are the limitations of using Liquid Clustering with Iceberg tables on Databricks?▼

Liquid Clustering with Iceberg tables on Databricks requires choosing the correct partitioning approach and adhering to Iceberg v2 and v3 specifics, as certain clustering configurations may have limitations when accessed by external engines.

Why does my external engine fail to access Databricks Iceberg tables via the REST Catalog?▼

External engine access failures usually occur when IRC prerequisites are unmet, specifically missing EXTERNAL USE SCHEMA grants, incorrect authentication, or network IP allowlists blocking connections to the Unity Catalog Iceberg REST Catalog endpoint.

Related Skills

Explore More Data & Analytics Skills→
mkgs-databricks-demosmkgs-databricks-demos

databricks-iceberg

Manage and access Apache Iceberg tables within Databricks.

Official
Advanced
aaronachermannaaronachermann

databricks-iceberg

Create Databricks Iceberg tables with UniForm and IRC for external engine reads.

Community
Advanced
lucaslessachaveslucaslessachaves
1

databricks-iceberg

Configure Iceberg tables on Databricks with Unity Catalog and REST Catalog access.

Community
Advanced
BlackkadderBlackkadder

databricks-iceberg

Enable Iceberg data access on Databricks via managed Iceberg, UniForm, and REST Catalog.

Community
Advanced