dual-stream-architecture

Publishes events to both Kafka and Redis for durable and real-time delivery.

Updated Mar 1, 2026
One-click install
npx skills add https://github.com/zangxin75/openclaw-skills --skill dual-stream-architecture
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: dual-stream-architecture
Source: https://github.com/zangxin75/openclaw-skills/tree/main/dual-stream-architecture
Command: npx skills add https://github.com/zangxin75/openclaw-skills --skill dual-stream-architecture

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the challenge of ensuring event data is both durably stored and instantly accessible, catering to systems that require both guaranteed delivery and low-latency updates.

Core Features & Use Cases

  • Dual Publishing: Simultaneously publishes events to Kafka for durability and Redis Pub/Sub for real-time delivery.
  • Scalable Architecture: Supports batch publishing for high-throughput scenarios and defines clear channel naming conventions for efficient routing.
  • Use Case: Ideal for building real-time dashboards or WebSocket backends where users expect immediate updates, while also ensuring no critical events are lost due to system failures.

Quick Start

Use the dual-stream-architecture skill to publish an event to both Kafka and Redis.

Frequently Asked Questions about dual-stream-architecture

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I publish events to Kafka and Redis Pub/Sub simultaneously for real-time and durable delivery?

To publish events to Kafka and Redis Pub/Sub simultaneously, use a dual-stream architecture pattern where an ingester feeds a dual-publisher, sending data to Kafka for durable storage and Redis for low-latency real-time notifications.

What is a dual-stream event publishing pattern and when do I need it?

A dual-stream event publishing pattern routes data to both Kafka and Redis Pub/Sub concurrently. You need this dual-stream approach when building event-driven systems like live dashboards that require guaranteed durable delivery alongside immediate low-latency updates.

Can I use Redis Pub/Sub and Kafka together for a WebSocket backend without losing events?

Yes, you can use Redis Pub/Sub and Kafka together for a WebSocket backend. The dual-stream architecture ensures critical events are durably stored in Kafka so they are not lost during system failures, while Redis handles the instant notifications.

Does the dual-stream architecture pattern support high-throughput batch publishing?

Yes, the dual-stream architecture pattern supports high-throughput batch publishing. It defines clear channel naming conventions for efficient event routing and scales to handle scenarios requiring both guaranteed delivery and high-volume real-time updates.

Why use both Kafka and Redis Pub/Sub instead of just one for event-driven systems?

Using both Kafka and Redis Pub/Sub instead of just one ensures event data is both durably stored and instantly accessible. Kafka provides guaranteed delivery and durability, while Redis Pub/Sub provides the low-latency updates required for real-time applications.