What problem does it solve?
This Skill provides comprehensive guidance and tools for working with Apache Iceberg tables within the Databricks ecosystem, enabling efficient data management and interoperability across various platforms.
Core Features & Use Cases
- Managed Iceberg Tables: Create, manage, and query native Iceberg tables with full read/write capabilities.
- Delta-to-Iceberg Interoperability: Use UniForm to make existing Delta tables readable as Iceberg externally, and Compatibility Mode for streaming tables and materialized views.
- External Engine Access: Configure external tools like PyIceberg, OSS Spark, Snowflake, and others to access Databricks Iceberg data via the Iceberg REST Catalog (IRC).
- Use Case: A data engineering team needs to expose their Databricks-managed Iceberg tables to a Snowflake data warehouse for BI reporting, ensuring seamless data sharing and consistent access.
Quick Start
Use the databricks-iceberg skill to create a managed Iceberg table named 'events' in the 'my_catalog.my_schema' schema, partitioned by 'event_date'.