Implement Kafka producers and consumers in Go services with error handling.
npx skills add https://github.com/matlockx/track-work --skill kafka-matlockx
Please help me install this Agent Skill. Skill: kafka Source: https://github.com/matlockx/track-work/tree/main/.agent/skills/kafka Command: npx skills add https://github.com/matlockx/track-work --skill kafka-matlockx
Go backend services often need reliable, scalable messaging with Kafka; this skill provides a reference of producers, consumers, error handling, and operational patterns for integrating Kafka into Go applications.
Instantiate a basic Kafka producer and consumer in a Go service using the recommended libraries and configuration examples.
High-intent search queries and answers about installing and using this skill.
To implement a reliable Kafka producer and consumer in Go, you can use established patterns for high-throughput delivery, group consumption, and manual commits provided by libraries like confluent-kafka-go, sarama, or kafka-go.
The best way to handle Kafka consumer errors and retries in Go involves implementing backoff strategies, routing failed messages to a Dead Letter Queue (DLQ), and integrating metrics to monitor processing failures across topics.
Yes, this Kafka Go integration guidance supports batch processing and manual commits, providing tested configuration examples and consumer patterns tailored for production environments requiring strict message delivery control.
Choosing between confluent-kafka-go, sarama, and kafka-go for Kafka messaging depends on your specific throughput needs and operational requirements, with each library offering distinct configuration patterns for Go services.
To test Kafka producers and consumers in Go applications, you should utilize tested examples with mocks that validate end-to-end messaging behavior, error handling, and backoff retry logic without needing a live broker.
You need observability and metrics for Kafka consumers in production to track message processing health, monitor retry mechanisms, and ensure reliable end-to-end messaging across distributed Go backend services.
OmniNode-aiCheck connectivity and health of Kafka, PostgreSQL, and Qdrant infrastructure.
ivanshamaevDetect and recover from Airflow, Kafka, Kubernetes, and data quality failures.
hyukudanImplement structured logging, metrics, and distributed tracing with OpenTelemetry.
victorzhukGuide Go messaging implementations across Kafka, RabbitMQ, and NATS.
