Skills
.Work. You
Rest

custom-kafka-consumer

Official

Stream Kafka data into Snowflake with a Consumer.

Software Engineering#monitoring#streaming#kafka#offset#snowflake#consumer#snowpipe
Authorsnowflakedb
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Implements a robust, end-to-end Kafka-to-Snowflake streaming ingestion workflow using Snowpipe Streaming SDK v2, addressing the complexities of coordinating Kafka consumers with Snowflake channels and ensuring data persistence before committing offsets.

Core Features & Use Cases

  • 1:1 partition-to-channel mapping with automatic channel open/close on rebalance
  • Offset management: commit only after Snowflake confirms persistence
  • Debug & troubleshooting guidance for CDR demo scenarios
  • Ready-to-run producer/consumer workflow with configuration steps and monitoring options

Quick Start

Configure and run the custom Kafka consumer to stream CDR events into Snowflake using Snowpipe Streaming SDK v2.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: custom-kafka-consumer
Download link: https://github.com/snowflakedb/snowpipe-streaming-sdk-examples/archive/main.zip#custom-kafka-consumer

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.