skills.rest
redpanda-data
redpanda-dataOFFICIAL
Explore all skills by this author →
Website𝕏@redpandadataGitHub

connect-cdc-dynamodb

Stream DynamoDB changes into Redpanda or Kafka via aws_dynamodb_cdc.

6|3|Updated May 31, 2026
Search Tags:#discovery#checkpointing#kafka#dynamodb#cdc#data-streaming#redpanda-connect
One-click install
npx skills add https://github.com/redpanda-data/skills --skill connect-cdc-dynamodb
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: connect-cdc-dynamodb
Source: https://github.com/redpanda-data/skills/tree/main/skills/connect-cdc-dynamodb
Command: npx skills add https://github.com/redpanda-data/skills --skill connect-cdc-dynamodb

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Guides setup and operation of the aws_dynamodb_cdc Redpanda Connect input for streaming change data capture from AWS DynamoDB into Redpanda or Kafka using DynamoDB Streams. Covers enabling DynamoDB Streams, IAM policy setup, checkpointing, snapshot modes, multi-table discovery, and the full pipeline YAML. Use when: capturing INSERT/MODIFY/REMOVE changes from DynamoDB into Redpanda or Kafka, configuring aws_dynamodb_cdc, enabling DynamoDB Streams, setting up the checkpoint table, using snapshot_and_cdc or snapshot_only, auto-discovering tables by tag, routing DynamoDB CDC events per table, troubleshooting DynamoDB stream retention or shard handling. Also covers the Redpanda Enterprise features the CDC destination topic and cluster can use: Iceberg Topics (redpanda.iceberg.mode/delete/partition.spec/target.lag.ms/ invalid.record.action), Tiered Storage (redpanda.remote.read/write) to outlive the 24h stream window, Remote Read Replicas, Shadow Linking (rpk shadow cross-cluster DR), server-side Schema ID Validation, RBAC, Audit Logging, and OIDC/Kerberos auth on the landed topic.

Core Features & Use Cases

  • Comprehensive DynamoDB CDC integration: enables streaming of INSERT/MODIFY/REMOVE events into Redpanda or Kafka with per-table routing and multi-table discovery.
  • Snapshot and CDC workflows: supports none, snapshot_only, and snapshot_and_cdc modes with tag-based and explicit-table discovery.
  • Enterprise-friendly destination options: Iceberg topics, Tiered Storage, Remote Read Replicas, Shadow Linking, and security features (RBAC, Audit Logging, OIDC/Kerberos).

Quick Start

Create a pipeline YAML with input aws_dynamodb_cdc and an output to a Kafka/Redpanda topic, then run rpk connect using that configuration.

Frequently Asked Questions about connect-cdc-dynamodb

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I stream DynamoDB CDC changes into Kafka or Redpanda?▼

To stream DynamoDB CDC changes into Kafka or Redpanda, you configure the aws_dynamodb_cdc input in a Redpanda Connect pipeline YAML, which captures INSERT, MODIFY, and REMOVE events from DynamoDB Streams and routes them per table.

How does DynamoDB CDC snapshot mode work with Redpanda Connect?▼

DynamoDB CDC snapshot mode in Redpanda Connect works by supporting none, snapshot_only, and snapshot_and_cdc modes, allowing you to capture initial table states before continuously streaming live DynamoDB changes.

Can I auto-discover multiple DynamoDB tables for CDC streaming?▼

Yes, you can auto-discover multiple DynamoDB tables for CDC streaming by using the table_discovery_mode and table_tag_filter fields, enabling dynamic multi-table discovery based on specific AWS tags.

Do I need a checkpoint table for DynamoDB CDC in Redpanda Connect?▼

Yes, you need a checkpoint table for DynamoDB CDC in Redpanda Connect to track stream shard progress, ensuring durable consumption and preventing data loss during connector restarts.

How do I handle the 24-hour DynamoDB Stream retention limit for CDC?▼

To handle the 24-hour DynamoDB Stream retention limit for CDC, you can leverage Redpanda Tiered Storage with remote read and write capabilities, outliving the stream window by retaining data long-term.

What enterprise security features are available for landed DynamoDB CDC topics?▼

Available enterprise security features for landed DynamoDB CDC topics include Role-Based Access Control, Audit Logging, Schema ID Validation, and OIDC or Kerberos authentication to secure your data streams.

Related Skills

Explore More Software Engineering Skills→
redpanda-dataredpanda-data
6

connect-cdc-mysql

Stream MySQL and MariaDB CDC changes into Redpanda/Kafka via mysql_cdc input.

Official
Advanced
redpanda-dataredpanda-data
6

connect-cdc-oracle

Stream Oracle CDC changes into Redpanda or Kafka via oracledb_cdc input.

Official
Advanced
redpanda-dataredpanda-data
6

connect-cdc-sqlserver

Stream SQL Server CDC events into Redpanda or Kafka with per-table routing.

Official
Advanced
redpanda-dataredpanda-data
6

connect-cdc-spanner

Stream Google Cloud Spanner CDC mutations into Redpanda or Kafka.

Official
Advanced