starrocks-lakehouse-integration
CommunityFederate Iceberg/Hive/Delta with StarRocks
Software Engineering#iceberg#partition pruning#starrocks#delta lake#hive metastore#data federation#external catalog
Authorivanshamaev
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill solves the problem of integrating StarRocks with lakehouse table formats so you can query and write data across Iceberg, Hive, and Delta without unnecessary data copying.
Core Features & Use Cases
- External catalog setup (Iceberg/Hive/Delta): Create and manage StarRocks external catalogs backed by HMS, Glue, or REST so StarRocks can access lakehouse tables.
- Cross-catalog querying and ETL: Run single-SQL federation joins between StarRocks internal tables and external Iceberg/Hive tables, and load data via INSERT INTO / INSERT OVERWRITE.
- Performance and correctness controls: Verify partition filter pushdown with EXPLAIN, collect external-table statistics using ANALYZE on Iceberg, and keep metadata consistent using REFRESH EXTERNAL TABLE.
- Write-back to Iceberg (StarRocks 3.1+): Create Iceberg tables through StarRocks and insert query results back into Iceberg.
- Use Case: You maintain raw customer events in Iceberg and clean/aggregate them in StarRocks, then write the daily gold-layer aggregates back to Iceberg for downstream consumers.
Quick Start
Use the starrocks-lakehouse-integration skill to configure an Iceberg external catalog, run a cross-catalog join query with partition predicates, and refresh external table metadata after lakehouse updates.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: starrocks-lakehouse-integration Download link: https://github.com/ivanshamaev/de-agent-skills/archive/main.zip#starrocks-lakehouse-integration Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.