kafka-rails

What problem does it solve?

This Skill solves the problem of AI coding agents generating incorrect, non-production-ready Kafka implementations for Rails apps, which often skip critical patterns like the outbox, schema registry, and idempotent consumers, leading to data loss, ordering issues, and runtime failures during event streaming.

Core Features & Use Cases

• Production-grade karafka setup: Guidance for configuring karafka 2.x, the maintained Ruby Kafka client, with proper Rails environment settings and admin UI integration.
• Transactional event publishing: Implements the outbox pattern to ensure business database transactions and Kafka event publishing are atomic, even if the Kafka broker is temporarily unavailable.
• Schema-managed event payloads: Integrates with Confluent Schema Registry using Avro or Protobuf to validate payloads and catch breaking schema changes at deploy time, avoiding runtime errors.
• Reliable consumption patterns: Provides guidance for idempotent consumers, dead-letter queue configuration, consumer group scaling, and offset management to handle at-least-once delivery semantics safely.
• Use Case: For example, if you need to publish order events from your Rails app to Kafka with guaranteed delivery and per-account ordering, this Skill ensures you use the correct outbox pattern, schema validation, and partition key selection instead of ad-hoc, error-prone implementations.

Quick Start

Use the kafka-rails skill to implement a production-ready outbox pattern for publishing order events from your Rails app to Kafka with Avro schema validation and per-account partition keys.