Enforce idempotency, retry policies, and dead-lettering for background job queues.
npx skills add https://github.com/Corvalis-LLC/Crow-Stack --skill auto-job-queue
Please help me install this Agent Skill. Skill: auto-job-queue Source: https://github.com/Corvalis-LLC/Crow-Stack/tree/main/skills/auto-job-queue Command: npx skills add https://github.com/Corvalis-LLC/Crow-Stack --skill auto-job-queue
Production job processing often suffers from duplicates, unbounded retries, failed jobs escaping visibility, and unsafe dequeue patterns. This Skill prescribes disciplined patterns to make background processing dependable, observable, and recoverable.
Use this skill to implement reliable background processing by enforcing idempotency, retry policies, and dead-lettering.
High-intent search queries and answers about installing and using this skill.
Idempotent job processing ensures reprocessing a job does not cause duplicate effects. You enforce this by implementing idempotency checks during job execution, preventing duplicate side effects even if a worker dequeues the same message multiple times.
Poison-pill protection handles malformed payloads by quarantining problematic jobs into a dead-letter queue. This prevents endless retry loops while routing failed jobs away from the main worker queue for manual inspection and alerting on DLQ growth.
Bounded retries with exponential backoff limit retry attempts using a defined retry budget. You apply exponential delays between retry attempts and respect queue depth backpressure to prevent overwhelming downstream systems during transient failures.
Graceful shutdown for worker queues finishes currently executing in-flight work before terminating the process. This bounded shutdown window prevents data loss and partial processing states when a job consumer receives a termination signal.
Dead-letter routing and queue depth awareness provide observability and recovery for production job queues. Monitoring DLQ growth and job state enables rapid incident response, preventing unbounded retries and failed jobs from escaping visibility.
mepukaCoordinate TypeScript/Effect producers and consumers with bounded queues and backpressure.
myapihqCreate durable queues and enqueue background jobs for HTTP consumers.
machenjieDesign message queue consumers with idempotency, retry, DLQ, and backpressure rules.
oalansilvaImplement queue consumers with idempotency, retry limits, and dead-letter routing.
