effect-queues-background

Backpressure-aware queues in Effect coordinate producers and consumers by bounding queue capacity and blocking producers when full, preventing memory overflow. Create a bounded queue, enqueue events from producers, and fork workers as consumers that dequeue and process items while respecting capacity limits.

Queues distribute work to a single consumer per item, ensuring load balancing across workers. PubSub broadcasts each event to all subscribers simultaneously. Use Queue for work distribution and PubSub when multiple independent workers need the same event.

Graceful shutdown interrupts long-running fibers cleanly by signaling cancellation, allowing workers to complete or flush in-flight tasks. Use explicit interrupt handling and observable logging to track shutdown progress across worker pools.

Yes, fork multiple workers from a bounded queue to parallelize consumption. Each worker processes dequeued items independently while backpressure automatically blocks producers if the queue reaches capacity, coordinating load across the pool.

Observable logging and metrics are essential for production queues and background fibers to track throughput, latency, errors, and shutdown completion. Effect supports instrumentation to monitor backpressure, worker health, and task outcomes.