mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 19:08:59 -05:00
[GH-ISSUE #4414] Title auto-generation does not respect keep_alive setting #29128
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @amirhossein-ka on GitHub (Aug 7, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/4414
Bug Report
Description
Bug Summary:
When using keep alive setting to change time that models is loaded on gpu (in my case -1), on the new chats on the first prompt the model reloads and its keep alive time resets to 5 min, leading to performance issues.
Steps to Reproduce:
watch -n 0.1 ollama psornvtopto check gpu memory usage.Expected Behavior:
Title auto-generation should respect keep-alive setting and do not cause to models get reloaded.
Actual Behavior:
This feature ignores keep alive setting.
Environment
Open WebUI Version: v0.3.10
Ollama (if applicable): 0.3.0
Operating System: Ubuntu 24.04
Reproduction Details
Confirmation:
Logs and Screenshots
Screenshots (if applicable):

Installation Method
open-webui installed using docker and ollama is installed directly on host machine.
Additional Information
[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]