mirror of
https://github.com/open-webui/open-webui.git
synced 2026-03-12 10:04:14 -05:00
Support timeout or cancel the request #478
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @yeasy on GitHub (Mar 14, 2024).
Is your feature request related to a problem? Please describe.
When calling some model such as gemma, it happens to get stuck for quite a while, and the console can do nothing. Even close the web-ui, the calculation is still going in the background.
Describe the solution you'd like
Add timeout in the configuration, or allow cancel the request.
Describe alternatives you've considered
Maybe the timeout can be supported at ollama side, too.
Additional context
N/A
@tjbck commented on GitHub (Mar 14, 2024):
Our webui supports cancelling the request when you press the stop button in the input textarea, if you had other implementation in mind feel free to make a PR!