skills.rest
RepairYourTech
RepairYourTechCOMMUNITY
Explore all skills by this author →
GitHub

kafka

Design Apache Kafka topics, producers, consumers, and stream processing pipelines.

6|1|Updated Feb 27, 2026
Search Tags:#messaging#streaming#distributed systems#event-driven#kafka#pub/sub
One-click install
npx skills add https://github.com/RepairYourTech/cfsa-antigravity --skill kafka-repairyourtech
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: kafka
Source: https://github.com/RepairYourTech/cfsa-antigravity/tree/main/.agent/skill-library/stack/messaging/kafka
Command: npx skills add https://github.com/RepairYourTech/cfsa-antigravity --skill kafka-repairyourtech

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill provides expert guidance on designing, implementing, and operating Apache Kafka for robust event-driven systems, streaming pipelines, and pub/sub messaging.

Core Features & Use Cases

  • Topic Design: Best practices for partitioning, retention, and naming conventions.
  • Producer/Consumer Patterns: Idempotency, batching, offset management, and rebalancing strategies.
  • Schema Management: Guidance on Schema Registry and Avro schema evolution.
  • Advanced Features: Kafka Streams for stateful processing and Kafka Connect for data integration.
  • Use Case: Implement a scalable, fault-tolerant order processing system using Kafka, ensuring exactly-once semantics for critical financial transactions.

Quick Start

Use the kafka skill to design a topic for user sign-ups with appropriate partitioning and retention policies.

Frequently Asked Questions about kafka

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design Kafka topics for high-throughput event-driven architectures?▼

Design Kafka topics by applying best practices for partitioning to scale throughput, setting retention policies for data boundaries, and using naming conventions to ensure event-driven architectures remain organized and maintainable.

What's the best way to manage Kafka consumer offset and rebalancing strategies?▼

Manage Kafka consumer patterns by implementing offset management to track message consumption and configuring rebalancing strategies to handle consumer group changes, ensuring reliable processing in distributed systems.

How do I handle schema evolution in streaming pipelines with Schema Registry and Avro?▼

Handle schema management in streaming pipelines by using Schema Registry with Avro to enforce compatibility rules, allowing schemas to evolve safely without breaking existing producers and consumers.

Can I achieve exactly-once semantics for financial transactions using Kafka?▼

Achieve exactly-once semantics in Kafka by configuring idempotent producers and transactional APIs, ensuring critical financial transactions are processed reliably without duplication in distributed systems.

When do I use Kafka Streams for stateful processing versus Kafka Connect for data integration?▼

Use Kafka Streams for stateful processing to transform and aggregate event streams in real time, and use Kafka Connect to integrate external data systems by streaming data reliably into and out of Kafka topics.

Do I need to configure batching and idempotency for reliable pub/sub messaging?▼

Configure producer batching to improve pub/sub messaging throughput and enable idempotency to prevent duplicate messages, ensuring reliable event delivery across distributed systems.

Related Skills

Explore More Software Engineering Skills→
AGIBuildAGIBuild
10

dotnet-integration-testing

Integrate WebApplicationFactory, Testcontainers, and .NET Aspire for .NET integration testing.

Community
Advanced
belokonmbelokonm
8

kafka-engineer

Design Kafka architectures and configure Connect pipelines for real-time data streaming.

Community
Advanced
anton-abyzovanton-abyzov
156

confluent-schema-registry

Manage Avro, Protobuf, and JSON Schema compatibility and evolution via Confluent Schema Registry.

Community
Advanced
roanbrasilroanbrasil
5

nats-jetstream

Implement NATS Core and JetStream messaging with durable streams and consumers.

Community
Advanced