skills.rest
redpanda-data
redpanda-dataOFFICIAL
Explore all skills by this author →
Website𝕏@redpandadataGitHub

connect-cdc-mysql

Stream MySQL and MariaDB CDC changes into Redpanda/Kafka via mysql_cdc input.

6|3|Updated May 31, 2026
Search Tags:#mysql#iceberg#cdc#mariadb#binlog#tiered-storage#redpanda-connect
One-click install
npx skills add https://github.com/redpanda-data/skills --skill connect-cdc-mysql
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: connect-cdc-mysql
Source: https://github.com/redpanda-data/skills/tree/main/skills/connect-cdc-mysql
Command: npx skills add https://github.com/redpanda-data/skills --skill connect-cdc-mysql

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Streams change data capture (CDC) from MySQL and MariaDB into Redpanda/Kafka using the mysql_cdc input in Redpanda Connect. It covers binlog (row) replication, initial snapshots, checkpoint caching, and operational tuning to keep data in sync with minimal downtime.

Core Features & Use Cases

  • CDC from MySQL/MariaDB via mysql_cdc input, including binlog replication and continuous streaming to Redpanda/Kafka
  • Snapshot support with consistent reads and checkpoint-based resume for reliable restarts
  • Checkpoint caching, per-table routing, and IAM auth for AWS RDS/Aurora
  • Enterprise features like Iceberg/Tiered Storage integration and Schema ID Validation for lakehouse pipelines

Quick Start

Configure a mysql_cdc pipeline in Redpanda Connect and run it to stream binlog changes into Redpanda.

Frequently Asked Questions about connect-cdc-mysql

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I stream MySQL binlog changes to Redpanda with minimal downtime?▼

You can stream MySQL binlog changes to Redpanda using the mysql_cdc input in Redpanda Connect. It handles continuous row-level replication, ensuring your target system stays in sync with minimal operational disruption.

Does MySQL CDC support initial snapshots before streaming binlog updates?▼

Yes, MySQL CDC supports initial snapshots alongside binlog streaming. It performs consistent reads of your current database state and uses checkpoint caching to allow reliable resume during pipeline restarts.

Can I capture CDC changes from MariaDB and route them to specific Kafka topics per table?▼

Yes, the mysql_cdc input captures changes from both MySQL and MariaDB. It provides per-table routing capabilities, allowing you to direct specific table updates into distinct Redpanda or Kafka topics.

How does MySQL CDC handle AWS RDS or Aurora authentication for binlog replication?▼

MySQL CDC supports IAM authentication specifically for AWS RDS and Aurora environments. This allows you to securely manage binlog replication access without relying on static database credentials.

What is the best way to integrate MySQL CDC data into an Iceberg lakehouse with Tiered Storage?▼

You can integrate MySQL CDC data into an Iceberg lakehouse using enterprise features in Redpanda Connect. It supports Schema ID Validation and Tiered Storage to build reliable lakehouse pipelines directly from your database changes.

Related Skills

Explore More Data & Analytics Skills→
jeremylongshorejeremylongshore
2.6k

managing-database-replication

Configure master-slave replication and automatic failover for PostgreSQL and MySQL deployments.

Community
Advanced
redpanda-dataredpanda-data
6

connect-cdc-salesforce

Streams Salesforce CDC events and Platform Events into Redpanda or Kafka.

Official
Advanced
redpanda-dataredpanda-data
6

connect-cdc-spanner

Stream Google Cloud Spanner CDC mutations into Redpanda or Kafka.

Official
Advanced
hammadurrehman2006hammadurrehman2006

kafka-data-engineer

Design Kafka event-driven pipelines with topics, schemas, and processing logic.

Community
Advanced