aws-messaging-and-streaming

Recommend AWS messaging or streaming services for event-driven and continuous data workloads.

Updated May 12, 2026
One-click install
npx skills add https://github.com/mreferre/aws-agent-toolkit-skills --skill aws-messaging-and-streaming-mreferre
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: aws-messaging-and-streaming
Source: https://github.com/mreferre/aws-agent-toolkit-skills/tree/main/.kiro/skills/aws-messaging-and-streaming
Command: npx skills add https://github.com/mreferre/aws-agent-toolkit-skills --skill aws-messaging-and-streaming-mreferre

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

AWS developers need a clear way to select between messaging and streaming services and avoid misconfigurations when building event-driven or continuous data pipelines.

Core Features & Use Cases

  • Messaging vs. Streaming decision support: Explains how message consumption semantics differ from durable, replayable streaming records, including ordering and replay behavior.
  • Service mapping for common architectures: Covers Amazon SQS, Amazon SNS, Amazon EventBridge, Amazon MQ, Amazon Kinesis Data Streams, Amazon Data Firehose, Amazon Managed Service for Apache Flink, and Amazon MSK, with guidance on what each is best for.
  • Integration gotchas and production guardrails: Highlights recurring pitfalls like SQS system vs. user attributes, SNS-to-Firehose newline handling, DLQ queue policy requirements, and resource-policy confused-deputy scoping with aws:SourceArn/Account.

Quick Start

Use the aws-messaging-and-streaming skill to determine whether your workload needs decoupled task/event messaging or durable replayable streaming data, and which AWS service best matches your requirements.

Frequently Asked Questions about aws-messaging-and-streaming

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I choose the right AWS messaging or streaming service for my workload?

To choose the right AWS messaging or streaming service, determine whether your workload needs decoupled task/event messaging or durable, replayable streaming data. Map your requirements for message deletion versus retention, replay behavior, and ordering to the appropriate service semantics.

What is the difference between AWS messaging and streaming for event-driven architectures?

AWS messaging and streaming differ primarily in consumption semantics. Messaging services like SQS delete messages after consumption, while streaming services like Kinesis Data Streams retain records for durable, replayable access, impacting how you handle event replay and ordering.

When should I use Amazon EventBridge instead of SNS for pub/sub fan-out?

Use Amazon EventBridge instead of SNS when your pub/sub fan-out requires advanced event routing based on content matching. EventBridge provides structured event routing capabilities, whereas SNS is optimized for high-throughput message delivery to broad sets of subscribers.

How do I configure a DLQ policy and avoid confused-deputy issues in AWS messaging?

To configure a DLQ policy and avoid confused-deputy issues, apply least-privilege resource policy scoping using aws:SourceArn and aws:SourceAccount conditions. This ensures only authorized services can write to your dead-letter queues and prevents security misconfigurations.

Does SNS to Data Firehose delivery require specific newline handling?

SNS to Data Firehose delivery requires specific newline handling to avoid data parsing issues. Firehose expects properly delimited records, so you must ensure SNS messages include appropriate newline characters for successful downstream processing.

Can I use Amazon MQ for JMS migration to AWS event-driven architectures?

You can use Amazon MQ for JMS migration to AWS event-driven architectures. Amazon MQ supports standard messaging protocols and APIs, making it a suitable bridge for migrating existing JMS-based applications to the cloud without immediate re-architecture.