Handling Edge functions streaming connection reset/abort

[dqunbp]

Summary

Hi! I used Edge functions Streaming functionality.
When I abort the stream on the client side, I have a such error in the edge function logs:

error - uncaughtException: Error: aborted
    at connResetException (node:internal/errors:711:14)
    at abortIncoming (node:_http_server:743:17)
    at socketOnClose (node:_http_server:737:3)
    at Socket.emit (node:events:525:35)
    at TCP.<anonymous> (node:net:298:12) {
  code: 'ECONNRESET'
}

How can I handle this on the server side?

As a server-side example, I used the edge function from this repo
https://github.com/Nutlope/twitterbio/blob/main/pages/api/generate.ts

Then I send the query from the Postman, and canceled the response before it finished

[enricoros]

+1 Very important in this day and age of LLMs trickling down bytes.

[siddarthvader]

any update on this ? @dqunbp

[flosrn]

did you find a solution?

[railty]

Same problem 13.5.6

[laflechaenelaire]

Same, 14.0

[brycedbjork]

Same problem

[shredEngineer]

Any solution? This is absolutely crucial! I need to bill my customers for LLM tokens used, even when aborting the stream. This needs to be handled.

[mortezamehrabi]

same problem too!
is there any solution?