event-streaming

Design and implement distributed event-driven systems with stream processing pipelines.

5|1|Updated Jun 17, 2026
One-click install
npx skills add https://github.com/roanbrasil/engineer-grade-agent-skills --skill event-streaming-roanbrasil
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: event-streaming
Source: https://github.com/roanbrasil/engineer-grade-agent-skills/tree/main/skills/event-streaming
Command: npx skills add https://github.com/roanbrasil/engineer-grade-agent-skills --skill event-streaming-roanbrasil

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill eliminates the steep learning curve and common pitfalls of building production-grade event streaming systems, which often suffer from unbounded state, schema incompatibility, inconsistent processing guarantees, and poor resilience to failures and out-of-order events.

Core Features & Use Cases

  • Event-Driven Architecture Pattern Selection: Choose the right EDA style (event notification, event-carried state transfer, event sourcing) to balance service coupling and autonomy for your use case.
  • Production Stream Processing Implementation: Apply proven patterns for filtering, transformation, windowed aggregation, stream-table joins, and watermarking to build accurate, low-latency data pipelines.
  • Resilience and Governance: Enforce schema compatibility, handle poison pills with dead letter topics, configure multi-DC replication, and implement event catalog governance for cross-team alignment. For example, use this Skill to design a Kafka-based order processing pipeline that guarantees exactly-once processing, handles late-arriving events, and supports seamless schema evolution without breaking downstream consumers.

Quick Start

Use the event-streaming skill to design a resilient order processing event pipeline with exactly-once guarantees and schema evolution support for your e-commerce platform.

Frequently Asked Questions about event-streaming

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I implement exactly-once processing guarantees in a Kafka stream processing pipeline?

Exactly-once processing guarantees in a Kafka stream processing pipeline are implemented by configuring transactional producers and consumer read isolation to prevent duplicate records during failures. This Skill provides patterns for configuring exactly-once semantics, handling backpressure, and managing unbounded state.

What is the best way to handle late-arriving events and out-of-order data in event streaming?

Handling late-arriving events in event streaming requires applying watermarking and event time handling to track data progress accurately. This Skill provides proven patterns for windowed aggregation, stream-table joins, and watermarking to build low-latency data pipelines resilient to failures.

How do I manage schema evolution without breaking downstream consumers in an event-driven architecture?

Schema evolution in an event-driven architecture is managed by enforcing schema compatibility rules and implementing an event catalog for cross-team governance. This Skill helps configure schema evolution management and handle poison pills using dead letter topics to prevent consumer breakages.

When should I use Flink vs Kafka Streams for stateful aggregation and real-time data workloads?

Choosing Flink vs Kafka Streams for stateful aggregation depends on your specific real-time data workload requirements for stream-table duality and processing guarantees. This Skill guides technology selection between Kafka Streams, Flink, and Spark Structured Streaming to match your architecture needs.

How do I choose the right event-driven architecture pattern to balance service coupling and autonomy?

Choosing the right event-driven architecture pattern involves evaluating event notification, event-carried state transfer, and event sourcing styles. This Skill helps you select the appropriate EDA style to balance service coupling and autonomy specifically for your distributed system use case.

Does this Skill support multi-DC replication configuration for distributed event-driven systems?

Yes, this Skill supports multi-DC replication configuration for distributed event-driven systems to ensure high availability and disaster recovery. It also addresses backpressure handling, dead letter topic implementation, and event catalog governance for production-grade resilience.