mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-07 03:18:23 -05:00
[GH-ISSUE #3189] Open Webui 0.3.4 timesout with long Ollama responses #51831
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#51831
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @joequant on GitHub (Jun 15, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3189
Bug Report
openwebui fails with a timeout if ollama is sending back a long running ollama chat
Description
Bug Summary:
openwebui fails with a timeout if ollama is sending back a long running ollama chat
Steps to Reproduce:
Run a chat with a response that takes more than a minute to respond
Expected Behavior:
It should continue to respond
Actual Behavior:
After a few minutes it fails with
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in call
open-webui | await self.middleware_stack(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
open-webui | await route.handle(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
open-webui | await self.app(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
open-webui | await super().call(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
open-webui | await self.middleware_stack(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
open-webui | await self.app(scope, receive, _send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
open-webui | with collapse_excgroups():
open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
open-webui | self.gen.throw(typ, value, traceback)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
open-webui | await func()
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
open-webui | async for chunk in self.body_iterator:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 50, in anext
open-webui | rv = await self.read_func()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 317, in readline
open-webui | return await self.readuntil()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 351, in readuntil
open-webui | await self._wait("readuntil")
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 311, in _wait
open-webui | with self._timer:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/helpers.py", line 735, in exit
open-webui | raise asyncio.TimeoutError from None
open-webui | TimeoutError
Environment
Open WebUI Version: [e.g., 0.1.120] 0.3.4
Operating System: linux
Browser (if applicable): [e.g., Chrome 100.0, Firefox 98.0]
Reproduction Details
Confirmation:
Logs and Screenshots
Browser Console Logs:
[Include relevant browser console logs, if applicable]
Docker Container Logs:
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
open-webui | await self.app(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
open-webui | await super().call(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
open-webui | await self.middleware_stack(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
open-webui | await self.app(scope, receive, _send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
open-webui | with collapse_excgroups():
open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
open-webui | self.gen.throw(typ, value, traceback)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
open-webui | await func()
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
open-webui | async for chunk in self.body_iterator:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 50, in anext
open-webui | rv = await self.read_func()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 317, in readline
open-webui | return await self.readuntil()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 351, in readuntil
open-webui | await self._wait("readuntil")
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 311, in _wait
open-webui | with self._timer:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/helpers.py", line 735, in exit
open-webui | raise asyncio.TimeoutError from None
open-webui | TimeoutError
Screenshots (if applicable):
[Attach any relevant screenshots to help illustrate the issue]
Installation Method
docker compose
Additional Information
[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]
Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
@joequant commented on GitHub (Jun 15, 2024):
its a problem in 0.2.3
@joequant commented on GitHub (Jun 15, 2024):
This seems to have been fixed in
dfa2cf9e6d@silentoplayz commented on GitHub (Jun 15, 2024):
Related - #3135
This issue should also be fixed via
dfa2cf9e6das well.@TheTerrasque commented on GitHub (Jun 15, 2024):
Well, not fixed per se, but it can then be adjustable via environment variable.
When I submitted the PR I changed the default to 15 minutes, but I see it's been set back to 5 minutes as default.
@wsargent commented on GitHub (Feb 17, 2025):
What environment variable, though?