mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 14:39:31 -05:00
[GH-ISSUE #11620] issue: The model returned the following errors: too many total text bytes #70902
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @hongbo-miao on GitHub (Mar 13, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/11620
Check Existing Issues
Installation Method
Docker
Open WebUI Version
v0.5.19
Ollama Version (if applicable)
No response
Operating System
Ubuntu 22.04
Browser (if applicable)
No response
Confirmation
README.md.Expected Behavior
The model can do Q&A for any knowledge collection.
Actual Behavior
When the knowledge collection is large, when full context mode enabled, it will fail as it is over model input limitation.
Steps to Reproduce
Add a lot of markdown files in a knowledge collection and do Q&A.
Full context mode in Documents settings is enabled
This is my deployment code
Logs & Screenshots
It is stuck there with no response:
Browser log:
Open WebUI log:
LiteLLM log:
Additional Information
I checked LiteLLM log, I can see Open WebUI accessed LiteLLM's
/modelsendpoint which returnsHowever, Open WebUI never tried to access LiteLLM
/model/infoendpoint which include token limitation info which may be related with this issue.@Classic298 commented on GitHub (Mar 13, 2025):
Well ok this makes sense and is expected, isn't it?
I don't see how this is a bug
@hongbo-miao commented on GitHub (Mar 13, 2025):
I agree from an engineering standpoint, the failure is expected.
However, from a user’s perspective, the Q&A should never fail or stuck under any circumstances.
Just brainstorm: