confluent-kafka-developer

Designs, implements, and reviews Kafka producers, consumers, Streams, Connect, ksqlDB, and Flink applications.

1|Updated Jul 22, 2026
One-click install
npx skills add https://github.com/thititongumpun/skills --skill confluent-kafka-developer-thititongumpun
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: confluent-kafka-developer
Source: https://github.com/thititongumpun/skills/tree/main/skills/confluent-kafka-developer
Command: npx skills add https://github.com/thititongumpun/skills --skill confluent-kafka-developer-thititongumpun

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Kafka application work fails at runtime when config keys, SQL syntax, or API surfaces are written from stale memory, and subtle pitfalls like non-co-partitioned joins or missing DLQs silently corrupt data pipelines. This Skill grounds every answer in official Confluent and Apache documentation and applies a checklist of known pitfalls to design, implementation, and review tasks. ## Core Features & Use Cases - Docs-grounded research workflow: Retrieves from docs.confluent.io, kafka.apache.org, Apache Flink docs, and context7 with deliberate version pinning, refusing unofficial sources. - Multi-surface implementation: Writes producer, consumer, Kafka Streams, Connect, ksqlDB, and Flink code/config with delivery semantics, schema compatibility, and error handling matched to the stated guarantee. - Design and diagramming: Covers topic naming, partitioning, key design, and retention choices, and produces data-flow diagrams via the archify skill or Mermaid fallback. - Use Case: Ask it to write an exactly-once producer in Java and it will verify current config keys against the docs, set acks/idempotence correctly, and leave a Testcontainers round-trip check proving it runs. ## Quick Start Ask the agent to design a Kafka consumer with a dead-letter queue for poison messages and verify the offset-commit strategy against the official docs.

Frequently Asked Questions about confluent-kafka-developer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I write a Kafka producer with exactly-once semantics?

Set enable.idempotence=true with acks=all and matching min.insync.replicas, configure the serializer and Schema Registry, and choose a deliberate partition key. The skill verifies current config keys against official docs before writing the code.

How do I handle poison messages in a Kafka consumer?

Add a dead-letter-queue path so one bad record does not block the whole partition, and match your offset-commit strategy to the processing guarantee, committing after processing for at-least-once. The skill checks these in every consumer implementation and review.

Why does my ksqlDB or Kafka Streams join return no results?

Joins on mismatched keys or partition counts are not co-partitioned, so the join silently returns nothing instead of erroring. Verify both sides share the same key and partition count before joining.

Does this skill cover Confluent Cloud cluster provisioning and RBAC?

No, provisioning, RBAC, and networking belong to the confluent-kafka-admin skill. This skill covers the application side: client connection config, Schema Registry credentials, and Cloud Flink or ksqlDB usage.

What sources does the skill use for Kafka configuration answers?

Only official documentation: docs.confluent.io, kafka.apache.org, docs.ksqldb.io, Apache Flink docs, and official client library docs, including context7 with deliberate version pinning. Forums, blogs, and Stack Overflow are explicitly excluded.

When should I use Flink versus ksqlDB versus Kafka Streams?

ksqlDB suits SQL-declared streaming with CTAS-materialized tables for pull queries, Flink fits event-time processing needing watermarks and state control, and Streams fits JVM application code. The skill weighs trade-offs and commits to a recommendation with rationale.