Originally created by @yeasy on GitHub (Mar 14, 2024).
Is your feature request related to a problem? Please describe.
When calling some model such as gemma, it happens to get stuck for quite a while, and the console can do nothing. Even close the web-ui, the calculation is still going in the background.
Describe the solution you'd like
Add timeout in the configuration, or allow cancel the request.
Describe alternatives you've considered
Maybe the timeout can be supported at ollama side, too.
Additional context
N/A
Originally created by @yeasy on GitHub (Mar 14, 2024).
**Is your feature request related to a problem? Please describe.**
When calling some model such as gemma, it happens to get stuck for quite a while, and the console can do nothing. Even close the web-ui, the calculation is still going in the background.
**Describe the solution you'd like**
Add timeout in the configuration, or allow cancel the request.
**Describe alternatives you've considered**
Maybe the timeout can be supported at ollama side, too.
**Additional context**
N/A
Our webui supports cancelling the request when you press the stop button in the input textarea, if you had other implementation in mind feel free to make a PR!
@tjbck commented on GitHub (Mar 14, 2024):
Our webui supports cancelling the request when you press the stop button in the input textarea, if you had other implementation in mind feel free to make a PR!
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @yeasy on GitHub (Mar 14, 2024).
Is your feature request related to a problem? Please describe.
When calling some model such as gemma, it happens to get stuck for quite a while, and the console can do nothing. Even close the web-ui, the calculation is still going in the background.
Describe the solution you'd like
Add timeout in the configuration, or allow cancel the request.
Describe alternatives you've considered
Maybe the timeout can be supported at ollama side, too.
Additional context
N/A
@tjbck commented on GitHub (Mar 14, 2024):
Our webui supports cancelling the request when you press the stop button in the input textarea, if you had other implementation in mind feel free to make a PR!