Dremio Iceberg Operations

What problem does it solve?

This Skill removes uncertainty and manual complexity when creating, modifying, querying, and maintaining Apache Iceberg tables in Dremio, enabling reliable ACID DML, snapshot time travel, and schema/partition evolution without accidental data loss.

Core Features & Use Cases

• DML and Upserts: Execute INSERT, UPDATE, DELETE, and MERGE operations for transactional upserts and change data workflows.
• Schema & Partition Evolution: Add, drop, or rename columns and change partitioning strategies without rewriting historic data.
• Time Travel & Versioned Catalogs: Query past snapshots, branch and tag catalogs (Nessie/Arctic), and rollback to prior table states for safe experimentation.
• Maintenance & Performance: Run OPTIMIZE to compact small files and VACUUM to remove expired snapshots and orphan files.
• Use Case: Implement an incremental ingestion pipeline that COPY INTO a staging table, MERGEs into the production Iceberg table, then OPTIMIZE and VACUUM on a schedule to maintain performance and storage hygiene.

Quick Start

Ask the skill to create an Iceberg table, load data from object storage, perform a MERGE upsert from a staging table, and then run OPTIMIZE and VACUUM to compact files and reclaim storage.