mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 23:21:44 -05:00
Text Generation Stops / Hangs and Stop Button Doesn't Work #1152
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @gibru on GitHub (Jun 6, 2024).
Bug Report
Text Generation Hangs
Bug Summary:
Using Open WebUI, when prompting a model (e.g. Llama 70B), text generation stops after a while and the stop button is also unresponsive. Context length both tested default and 8K. Reloading the page allows to chat again, but the unfinished answer isn't saved. Using ollama directly doesn't have this issue (screenshots provided for comparison).
Steps to Reproduce:
Prompt the model for longer answers.
Expected Behavior:
The LLM is supposed to complete the answer and/or the stop button should allow for ending the text generation.
Environment
Logs and Screenshots
Screenshots attached
Open WebUI example:

ollama (CLI) example:
