Skills
.Work. You
Rest

starrocks-cdc-pipeline

Community

Replicate transactional changes into StarRocks

Software Engineering#kafka#cdc#debezium#flink#starrocks#exactly-once#routine load
Authorivanshamaev
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill solves the challenge of continuously replicating INSERT/UPDATE/DELETE changes from transactional sources into StarRocks with correct upsert semantics and production-grade reliability.

Core Features & Use Cases

  • CDC ingestion patterns: Debezium + Kafka into StarRocks via Routine Load, or Flink CDC into StarRocks with exactly-once and delete support.
  • Mutable StarRocks landing with primary keys: Uses StarRocks PK tables with persistent index to merge changes efficiently.
  • Operational hardening: Handles schema evolution propagation, builds multi-table CDC fan-out, routes failed events to a DLQ, and provides CDC lag monitoring guidance.
  • Use Case: Stream real-time operational analytics for an e-commerce system by replicating order and customer changes from PostgreSQL/MySQL into StarRocks for near-instant dashboards.

Quick Start

Use the starrocks-cdc-pipeline skill to design a Debezium/Kafka (Routine Load) or Flink CDC (exactly-once) pipeline that applies CDC events to a StarRocks primary-key table with upsert behavior and delete handling as required.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: starrocks-cdc-pipeline
Download link: https://github.com/ivanshamaev/de-agent-skills/archive/main.zip#starrocks-cdc-pipeline

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.