[GH-ISSUE #8720] [Feature Request/Bug] Consistent context length in UI. #102223

Closed
opened 2026-05-17 23:38:34 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @wbste on GitHub (Jan 21, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/8720

Feature Request/Bug

Is your feature request related to a problem? Please describe.
Loving Open WebUI, so thanks for making such a great solution!

Pretty minor issue, hoping it's an easy fix. If you go to Admin Panel > Settings > Models > [click the pencil on any model] > Advanced Params > Context Length, you can set a custom default context length (i.e. 8192). Handy since Ollama defaults to 2048 by default.

Now, if you create a new chat with that model, under Chat Controls it shows "Default" for Context Length, and if you expand it it's the default 2048. I assume that should read 8192 following my example? Or does opening it up override the Admin Panel value is goes back to 2048?

Ideally the numbers are in sync. I'm okay with keeping it "Default", but at least if you expand it it would show the Admin-set value. Alternatively having is expanded by default (like in the Admin Panel) with the context length defined,

Describe the solution you'd like
Context length is aligned everywhere.

Describe alternatives you've considered
None.

Additional context
Running via Docker, v0.5.4.

Related Idea
Would be nice if there was some sort of faint divider in the chat, so you know where approximately the chat history has been dropped. I find during longer chat sessions the model loses some history (as expected), but I don't know what specifically was lost and what to copy to "remind" it.

Originally created by @wbste on GitHub (Jan 21, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/8720 # Feature Request/Bug **Is your feature request related to a problem? Please describe.** Loving Open WebUI, so thanks for making such a great solution! Pretty minor issue, hoping it's an easy fix. If you go to *Admin Panel > Settings > Models > [click the pencil on any model] > Advanced Params > Context Length*, you can set a custom default context length (i.e. `8192`). Handy since Ollama defaults to `2048` by default. Now, if you create a new chat with that model, under *Chat Controls* it shows "Default" for `Context Length`, and if you expand it it's the default `2048`. I assume that should read `8192` following my example? Or does opening it up override the Admin Panel value is goes back to `2048`? Ideally the numbers are in sync. I'm okay with keeping it "Default", but at least if you expand it it would show the Admin-set value. Alternatively having is expanded by default (like in the Admin Panel) with the context length defined, **Describe the solution you'd like** Context length is aligned everywhere. **Describe alternatives you've considered** None. **Additional context** Running via Docker, v0.5.4. **Related Idea** Would be nice if there was some sort of faint divider in the chat, so you know where approximately the chat history has been dropped. I find during longer chat sessions the model loses some history (as expected), but I don't know what specifically was lost and what to copy to "remind" it.
Author
Owner

@tjbck commented on GitHub (Jan 21, 2025):

Intended behaviour here, model params are applied from the backend.

<!-- gh-comment-id:2605576503 --> @tjbck commented on GitHub (Jan 21, 2025): Intended behaviour here, model params are applied from the backend.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#102223