mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 02:48:13 -05:00
Context Length setting is completely ineffective #1914
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @CookSleep on GitHub (Aug 28, 2024).
Bug Report
Installation Method
Docker
Environment
Confirmation:
Expected Behavior:
After modifying the Context Length to a specific value in the account settings or conversation settings, the sent requests will follow the settings.
No matter where or how the Context Length is set, it seems that the setting does not take effect. The tokens consumed by the requests, the balance, and the model's ability to remember information far exceeding the Context Length limit all reflect this.
Actual Behavior:
Description
Bug Summary:
Context Length setting is completely ineffective
Reproduction Details
Steps to Reproduce:
Logs
Browser Console Logs:
OpenWebUI-1724846765350.log
Additional Information
I have also found that many people on some popular forums are encountering this issue, and it is not just in these few versions. The Context Length are ineffective, causing people to spend far more on API costs than expected. I hope it can be fixed as soon as possible!
@CookSleep commented on GitHub (Aug 28, 2024):
Even if the Context Length is set to 50 tokens in the account settings, the problem still exists!