mirror of
https://github.com/open-webui/open-webui.git
synced 2026-08-30 17:25:30 -05:00
context size exceed and chat reply failed with error #1741
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#1741
Reference in New Issue
Block a user
Originally created by @meetzuber on GitHub (Aug 9, 2024).
Bug Report
When using one chat session with RAG and ask multiple questions context size keep on increasing and after some time context size exceed above the limit of model max context size and I get error
Installation Method
using docker compose for installation.
Environment
Expected Behavior:
there should be an option to choose how many chat history will be passed with user message and older chat history should not be send with user message.
Actual Behavior:
It is sending all user histry which is exceeding context size and getting error.
Description
Reproduction Details
Steps to Reproduce:
try to use RAG with large documents and generate long answers. and keep on asking question. user models with is having limited context size like 4096 to get this error quickly.