What problem does it solve?
Provides a production-ready blueprint for designing, operating, and recovering message queues and background job systems so applications can reliably run asynchronous work without losing tasks, overloading downstream services, or producing duplicate side effects.
Core Features & Use Cases
- Technology guidance: compares and recommends SQS, BullMQ, Celery, Kafka, RabbitMQ, Redis Streams and Postgres SKIP LOCKED based on throughput and operational needs.
- Operational patterns: includes architecture for priority routing, worker pools, rate limiting, backpressure, graceful shutdown, scheduling, monitoring and DLQ handling.
- Resilience & correctness: prescribes exponential backoff with jitter, idempotency keys, delivery guarantees (at-most/at-least/exactly-once), retry classification, and error recovery procedures for stuck jobs and memory exhaustion.
- Use case: implement scalable email delivery, background processing for image pipelines, order processing with strict ordering, or high-throughput event streaming.
Quick Start
Use the queue skill to design and deploy a worker pool with retries, DLQ, idempotency keys, and monitoring tuned to your application's throughput and latency targets.