effect-uai-mid-stream-abort

Cancel an in-flight model turn safely using Effect's Stream.interruptWhen and Deferred-based signaling to interrupt the active stream and tear down the underlying fetch request. This pattern provides safe teardown and preserves partial deltas for downstream handling.

When a mid-stream abort occurs, partial deltas already emitted stay with the consumer. Upstream HTTP connections drop via Effect's structured concurrency, ensuring finalizers run end-to-end to abort the underlying fetch request.

Stop a running generation gracefully by integrating the mid-stream abort pattern in your turn processing. It uses Deferred signaling to interrupt the active stream when a new prompt arrives, stopping the in-flight model turn safely.

Yes, Effect's structured concurrency supports safe teardown of an underlying fetch request during streaming. Stream.interruptWhen triggers finalizers end-to-end, aborting the upstream HTTP connection when canceling an in-flight model turn.

Mid-stream cancellation is needed for interactive chat interfaces when a user clicks stop, a new prompt arrives mid-generation, or a deadline elapses. It allows you to cancel an in-flight model turn safely without losing partial deltas.