mirror of
https://github.com/ollama/ollama.git
synced 2026-03-09 07:16:38 -05:00
Currently, a canceled request can result in computation continuing in the background to completion. It can also trigger a deadlock when there is nobody to read the output tokens and the pipeline cannot continue to the next request.