aws-messaging-and-streaming

Guides selection and configuration of AWS messaging and streaming services.

Updated Jul 1, 2026
One-click install
npx skills add https://github.com/sakicodes/BuildFestHackathon26 --skill aws-messaging-and-streaming-sakicodes
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: aws-messaging-and-streaming
Source: https://github.com/sakicodes/BuildFestHackathon26/tree/main/.agents/skills/aws-messaging-and-streaming
Command: npx skills add https://github.com/sakicodes/BuildFestHackathon26 --skill aws-messaging-and-streaming-sakicodes

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Choosing between AWS messaging and streaming services is confusing, and misconfiguring integrations like DLQs, credentials, or resource policies leads to silent message loss and security gaps. This Skill provides decision guidance and hard-won configuration gotchas for SQS, SNS, EventBridge, Amazon MQ, Kinesis, Firehose, Managed Flink, and MSK. ## Core Features & Use Cases - Pattern Selection: Explains the difference between messaging (consume-once, decoupled) and streaming (retained, replayable, ordered) so you pick the right pattern for your workload. - Service Comparison Tables: Maps each AWS service to its best-fit use case and key differentiator, from SQS task queues to MSK Kafka workloads. - Integration Gotchas: Documents real pitfalls such as SQS system vs. user attributes, SNS-to-Firehose newline handling, DLQ queue policies, Secrets Manager credential requirements, and confused-deputy protections with aws:SourceArn. - Use Case: When designing an event-driven architecture, ask which service fits a fan-out notification pattern and get a grounded recommendation plus the exact DLQ and IAM policy configuration needed. ## Quick Start Ask which AWS service to use for decoupling microservices with a task queue and how to configure its dead-letter queue securely.

Frequently Asked Questions about aws-messaging-and-streaming

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I choose between SQS, SNS, and EventBridge?

Use SQS for task queues and decoupling with competing consumers, SNS for fan-out push notifications to multiple subscribers, and EventBridge for content-based event routing with schema registry and 200+ AWS source integrations.

What is the difference between messaging and streaming on AWS?

Messaging deletes messages after consumption and distributes work among competing consumers, while streaming retains records for replay with strict per-partition ordering and independent readers. Choose messaging for commands and tasks, streaming for event sourcing and real-time analytics.

When should I use Amazon MSK instead of Kinesis Data Streams?

Use MSK when you need Apache Kafka API compatibility, the Kafka connector ecosystem, or are migrating existing Kafka workloads. Choose Kinesis Data Streams for AWS-native consumers with on-demand scaling and no shard management.

Why is my EventBridge dead-letter queue not receiving messages?

Attaching a DLQ alone is not enough; the DLQ needs a queue policy allowing sqs:SendMessage for the events.amazonaws.com service principal scoped with aws:SourceArn to the rule ARN. Without this policy the DLQ silently drops messages.

Does MSK require Secrets Manager for SASL/SCRAM credentials?

Yes, MSK SASL/SCRAM secrets must use the AmazonMSK_ prefix and be encrypted with a customer-managed KMS key, then attached via BatchAssociateScramSecret. Secrets encrypted with the default aws/secretsmanager key cannot be associated with a cluster.