mirror of
https://github.com/open-webui/open-webui.git
synced 2026-11-14 05:02:01 -06:00
[GH-ISSUE #19319] feat: Add option for OpenWebui to use the context length of a currently loaded model in Ollama to keep the model from being reloaded. #34368
Reference in New Issue
Block a user
Originally created by @hainesk on GitHub (Nov 20, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/19319
Check Existing Issues
Verify Feature Scope
Problem Description
When using a model that is already loaded in Ollama, OpenWebUI sees that it's already loaded and highlights it green. However if the model was loaded with a non-standard context window, OpenWebui will apply the default context, causing the model to reload for a chat session, delaying the response. The model will then have to be reloaded again when used at the custom context length.
Desired Solution you'd like
An option in settings for chats without pre-defined context lengths to use the currently loaded model context length to keep the model from being reloaded. This will allow for immediate processing of requests for quick chats with pre-loaded models. This option won't apply to custom models created in the workspace with customized context lengths.
Alternatives Considered
No response
Additional Context
No response