mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 06:03:26 -05:00
bug: Settings>Advanced Parameters>Context Length #874
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#874
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @edwardochoaphd on GitHub (May 9, 2024).
Bug Report
Description
Bug Summary:
OpenWebUI settings appear to be adding an extra zero to Context Length
may be related related to feature request?...
Steps to Reproduce:
Set context length then read logfile
Expected Behavior:
No change to user's context length setting
Actual Behavior:
an extra zero appears to be added to context length
Environment
Open WebUI Version: 0.1.123
Ollama (if applicable): 0.1.34
Operating System: RHEL8
**Browser (if applicable):**Chrome
Reproduction Details
Set context length then read logfile. these are 2 logs examples showing my context length had an extra zero added
Confirmation:
Logs and Screenshots
see attached potentially related issue snapshot with extra zero highlighted
Browser Console Logs:
[Include relevant browser console logs, if applicable]
Docker Container Logs:
[Include relevant Docker container logs, if applicable]
Screenshots (if applicable):
see attached
Installation Method
docker
Additional Information
see above
Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
@edwardochoaphd commented on GitHub (May 9, 2024):
appears there may be a 2nd (related?) issue/bug with Settings>Advanced Parameters>Max Tokens
when set to 2048... in a conversation, getting an extra zero getting added here too?... see below two examples of 20480 which should have been 2048
...
time=2024-05-09T14:33:27.120Z level=WARN source=server.go:77 msg="requested context length is greater than the model's training context window size" requested=20480 "training size"=4096
...
.................................................................................................
llama_new_context_with_model: n_ctx = 20480