kafka

Name: kafka
Availability: InStock
Author: RepairYourTech

Design Apache Kafka topics, producers, consumers, and stream processing pipelines.

6|1|Updated Feb 27, 2026

Search Tags:#messaging #streaming #distributed systems #event-driven #kafka #pub/sub

Ready to run

npx skills add https://github.com/RepairYourTech/cfsa-antigravity --skill kafka-repairyourtech

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: kafka
Source: https://github.com/RepairYourTech/cfsa-antigravity/tree/main/.agent/skill-library/stack/messaging/kafka
Command: npx skills add https://github.com/RepairYourTech/cfsa-antigravity --skill kafka-repairyourtech

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill provides expert guidance on designing, implementing, and operating Apache Kafka for robust event-driven systems, streaming pipelines, and pub/sub messaging.

Core Features & Use Cases

Topic Design: Best practices for partitioning, retention, and naming conventions.
Producer/Consumer Patterns: Idempotency, batching, offset management, and rebalancing strategies.
Schema Management: Guidance on Schema Registry and Avro schema evolution.
Advanced Features: Kafka Streams for stateful processing and Kafka Connect for data integration.
Use Case: Implement a scalable, fault-tolerant order processing system using Kafka, ensuring exactly-once semantics for critical financial transactions.

Quick Start

Use the kafka skill to design a topic for user sign-ups with appropriate partitioning and retention policies.

Frequently Asked Questions about kafka

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I design Kafka topics for high-throughput event-driven architectures?▼

Design Kafka topics by applying best practices for partitioning to scale throughput, setting retention policies for data boundaries, and using naming conventions to ensure event-driven architectures remain organized and maintainable.

What's the best way to manage Kafka consumer offset and rebalancing strategies?▼

Manage Kafka consumer patterns by implementing offset management to track message consumption and configuring rebalancing strategies to handle consumer group changes, ensuring reliable processing in distributed systems.

How do I handle schema evolution in streaming pipelines with Schema Registry and Avro?▼

Handle schema management in streaming pipelines by using Schema Registry with Avro to enforce compatibility rules, allowing schemas to evolve safely without breaking existing producers and consumers.

Can I achieve exactly-once semantics for financial transactions using Kafka?▼

Achieve exactly-once semantics in Kafka by configuring idempotent producers and transactional APIs, ensuring critical financial transactions are processed reliably without duplication in distributed systems.

When do I use Kafka Streams for stateful processing versus Kafka Connect for data integration?▼

Use Kafka Streams for stateful processing to transform and aggregate event streams in real time, and use Kafka Connect to integrate external data systems by streaming data reliably into and out of Kafka topics.

Do I need to configure batching and idempotency for reliable pub/sub messaging?▼

Configure producer batching to improve pub/sub messaging throughput and enable idempotency to prevent duplicate messages, ensuring reliable event delivery across distributed systems.