mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 06:03:26 -05:00
[GH-ISSUE #8720] [Feature Request/Bug] Consistent context length in UI. #134955
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @wbste on GitHub (Jan 21, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/8720
Feature Request/Bug
Is your feature request related to a problem? Please describe.
Loving Open WebUI, so thanks for making such a great solution!
Pretty minor issue, hoping it's an easy fix. If you go to Admin Panel > Settings > Models > [click the pencil on any model] > Advanced Params > Context Length, you can set a custom default context length (i.e.
8192). Handy since Ollama defaults to2048by default.Now, if you create a new chat with that model, under Chat Controls it shows "Default" for
Context Length, and if you expand it it's the default2048. I assume that should read8192following my example? Or does opening it up override the Admin Panel value is goes back to2048?Ideally the numbers are in sync. I'm okay with keeping it "Default", but at least if you expand it it would show the Admin-set value. Alternatively having is expanded by default (like in the Admin Panel) with the context length defined,
Describe the solution you'd like
Context length is aligned everywhere.
Describe alternatives you've considered
None.
Additional context
Running via Docker, v0.5.4.
Related Idea
Would be nice if there was some sort of faint divider in the chat, so you know where approximately the chat history has been dropped. I find during longer chat sessions the model loses some history (as expected), but I don't know what specifically was lost and what to copy to "remind" it.
@tjbck commented on GitHub (Jan 21, 2025):
Intended behaviour here, model params are applied from the backend.