skill-queue-kafka

Kafka exactly-once processing requires configuring transactional producers with idempotent settings to ensure messages are delivered without duplication. This Skill guides setting up transactional producers and consumer groups to guarantee ordering and reliable delivery in event-driven architectures.

Designing Kafka topics requires balancing throughput and ordering through strategic partitioning and retention configuration. This Skill provides topic design guidance to optimize consumer groups and maintain scalable event streams across distributed microservices.

A DLQ pattern in kafkajs routes failed messages to a separate topic for inspection, preventing pipeline blockage. This Skill outlines robust error handling and DLQ strategies to maintain reliable event streams during message processing failures.

Kafka consumer lag occurs when consumers cannot process messages at the producer's rate, creating a backlog. This Skill addresses consumer lag monitoring and error handling to ensure scalable, observable event-driven services that withstand failures.

Event-driven microservices require explicit Kafka topic creation with proper retention and compression configs for reliable operation. This Skill provides admin tooling guidance for topic creation to ensure maintainable architectures and predictable streaming data pipelines.