Skills
.Work. You
Rest

starrocks-medallion-architecture

Community

Design Bronze→Silver→Gold pipelines in StarRocks

Software Engineering#deduplication#medallion architecture#cdc#upsert#starrocks#materialized view#insert overwrite
Authorivanshamaev
Version1.0.0
Installs0

System Documentation

What problem does it solve?

It helps you design a reliable StarRocks data platform where raw CDC ingestion stays immutable in Bronze, deduplicated business state is maintained in Silver, and analytics-ready aggregates are produced in Gold.

Core Features & Use Cases

  • Bronze raw landing for CDC: ingest event streams into Duplicate Key tables to preserve all versions of records.
  • Silver cleansed upsert + dedup: transform and deduplicate Bronze into Primary Key tables using latest-op-per-key logic and explicit delete propagation.
  • Gold analytics aggregates: build daily business metrics with Aggregate Key tables or Materialized Views, using INSERT OVERWRITE patterns for re-runs.
  • Incremental pipeline patterns: implement partitioned loads using watermarks/time windows and orchestrate Bronze → Silver → Gold flows (e.g., Airflow).

Quick Start

Use the starrocks-medallion-architecture Skill to generate a Bronze→Silver→Gold StarRocks schema and incremental loading SQL for your CDC stream, including deduplication, upserts, delete handling, and Gold daily aggregation.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: starrocks-medallion-architecture
Download link: https://github.com/ivanshamaev/de-agent-skills/archive/main.zip#starrocks-medallion-architecture

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.