mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 19:08:59 -05:00
[GH-ISSUE #3135] bug: Resubmission for chat response freezes but resources still in use with a locked up UI #13145
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @silentoplayz on GitHub (Jun 13, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3135
Discussed in https://github.com/open-webui/open-webui/discussions/3080
Originally posted by Kingbadger3d June 12, 2024
Bug Report
Description
Bug Summary:
Frozen LLM responses with CLI error
Steps to Reproduce:
[Outline the steps to reproduce the bug. Be as detailed as possible.]
Expected Behavior:
The response should continue as normal.
Actual Behavior:
After 4-5 lines of response text, the response stops, but the CPU, GPU, and memory are still being utilized. The CLI outputs an error. Additionally, the following error is displayed in the CLI:
Environment
Also I might add, I also have older versions of Openwebui 0.1.X version e.g that works as expected, doesn't do this and is using the very latest Ollama.
Reproduction Details
Confirmation:
Logs and Screenshots
Terminal console Logs:
Installation Method
pipon Windows 11Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
@silentoplayz commented on GitHub (Jun 13, 2024):
Dev note from Llama 3 70B 🤖:
The error log indicates that an
asyncio.TimeoutErrorwas raised, which suggests that a timeout occurred while waiting for a response or a read operation. This timeout error is likely causing the response text to stop after 4-5 lines, and the CPU and GPU/memory usage to remain high.The error log points to the
aiohttplibrary, specifically thereaduntilmethod, which is used to read data from a stream until a delimiter is encountered. It seems that this method is timing out, causing the error to propagate up the call stack.@tjbck commented on GitHub (Jun 13, 2024):
Related https://github.com/open-webui/open-webui/pull/3107
@tjbck commented on GitHub (Jun 14, 2024):
@Kingbadger3d should be fixed on latest dev, please let us know if the issue persists!
@Kingbadger3d commented on GitHub (Jun 17, 2024):
@tjbck Cheers Bud. Keep up the great work.