starrocks-lakehouse-integration

Community

Federate Iceberg/Hive/Delta with StarRocks

Authorivanshamaev
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill solves the problem of integrating StarRocks with lakehouse table formats so you can query and write data across Iceberg, Hive, and Delta without unnecessary data copying.

Core Features & Use Cases

  • External catalog setup (Iceberg/Hive/Delta): Create and manage StarRocks external catalogs backed by HMS, Glue, or REST so StarRocks can access lakehouse tables.
  • Cross-catalog querying and ETL: Run single-SQL federation joins between StarRocks internal tables and external Iceberg/Hive tables, and load data via INSERT INTO / INSERT OVERWRITE.
  • Performance and correctness controls: Verify partition filter pushdown with EXPLAIN, collect external-table statistics using ANALYZE on Iceberg, and keep metadata consistent using REFRESH EXTERNAL TABLE.
  • Write-back to Iceberg (StarRocks 3.1+): Create Iceberg tables through StarRocks and insert query results back into Iceberg.
  • Use Case: You maintain raw customer events in Iceberg and clean/aggregate them in StarRocks, then write the daily gold-layer aggregates back to Iceberg for downstream consumers.

Quick Start

Use the starrocks-lakehouse-integration skill to configure an Iceberg external catalog, run a cross-catalog join query with partition predicates, and refresh external table metadata after lakehouse updates.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: starrocks-lakehouse-integration
Download link: https://github.com/ivanshamaev/de-agent-skills/archive/main.zip#starrocks-lakehouse-integration

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.