[ X] I have read and followed all the instructions provided in the README.md.
[ X] I am on the latest version of both Open WebUI and Ollama.
[ X] I have included the browser console logs.
[ X] I have included the Docker container logs.
Logs and Screenshots
Browser Console Logs:
[Include relevant browser console logs, if applicable]
Docker Container Logs:
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
open-webui | await self.app(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
open-webui | await super().call(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
open-webui | await self.middleware_stack(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
open-webui | await self.app(scope, receive, _send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
open-webui | with collapse_excgroups():
open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
open-webui | self.gen.throw(typ, value, traceback)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
open-webui | await func()
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
open-webui | async for chunk in self.body_iterator:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 50, in anext
open-webui | rv = await self.read_func()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 317, in readline
open-webui | return await self.readuntil()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 351, in readuntil
open-webui | await self._wait("readuntil")
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 311, in _wait
open-webui | with self._timer:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/helpers.py", line 735, in exit
open-webui | raise asyncio.TimeoutError from None
open-webui | TimeoutError
Screenshots (if applicable):
[Attach any relevant screenshots to help illustrate the issue]
Installation Method
docker compose
Additional Information
[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]
Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
Originally created by @joequant on GitHub (Jun 15, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3189
# Bug Report
openwebui fails with a timeout if ollama is sending back a long running ollama chat
## Description
**Bug Summary:**
openwebui fails with a timeout if ollama is sending back a long running ollama chat
**Steps to Reproduce:**
Run a chat with a response that takes more than a minute to respond
**Expected Behavior:**
It should continue to respond
**Actual Behavior:**
After a few minutes it fails with
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in __call__
open-webui | await self.middleware_stack(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
open-webui | await route.handle(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
open-webui | await self.app(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in __call__
open-webui | await super().__call__(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in __call__
open-webui | await self.middleware_stack(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in __call__
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in __call__
open-webui | await self.app(scope, receive, _send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__
open-webui | with collapse_excgroups():
open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__
open-webui | self.gen.throw(typ, value, traceback)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
open-webui | await func()
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
open-webui | async for chunk in self.body_iterator:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 50, in __anext__
open-webui | rv = await self.read_func()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 317, in readline
open-webui | return await self.readuntil()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 351, in readuntil
open-webui | await self._wait("readuntil")
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 311, in _wait
open-webui | with self._timer:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/helpers.py", line 735, in __exit__
open-webui | raise asyncio.TimeoutError from None
open-webui | TimeoutError
## Environment
- **Open WebUI Version:** [e.g., 0.1.120] 0.3.4
- **Operating System:** linux
- **Browser (if applicable):** [e.g., Chrome 100.0, Firefox 98.0]
## Reproduction Details
**Confirmation:**
- [ X] I have read and followed all the instructions provided in the README.md.
- [ X] I am on the latest version of both Open WebUI and Ollama.
- [ X] I have included the browser console logs.
- [ X] I have included the Docker container logs.
## Logs and Screenshots
**Browser Console Logs:**
[Include relevant browser console logs, if applicable]
**Docker Container Logs:**
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
open-webui | await self.app(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in __call__
open-webui | await super().__call__(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in __call__
open-webui | await self.middleware_stack(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in __call__
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in __call__
open-webui | await self.app(scope, receive, _send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__
open-webui | with collapse_excgroups():
open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__
open-webui | self.gen.throw(typ, value, traceback)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
open-webui | await func()
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
open-webui | async for chunk in self.body_iterator:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 50, in __anext__
open-webui | rv = await self.read_func()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 317, in readline
open-webui | return await self.readuntil()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 351, in readuntil
open-webui | await self._wait("readuntil")
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 311, in _wait
open-webui | with self._timer:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/helpers.py", line 735, in __exit__
open-webui | raise asyncio.TimeoutError from None
open-webui | TimeoutError
**Screenshots (if applicable):**
[Attach any relevant screenshots to help illustrate the issue]
## Installation Method
docker compose
## Additional Information
[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]
## Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
<!-- gh-comment-id:2169848869 -->
@joequant commented on GitHub (Jun 15, 2024):
This seems to have been fixed in dfa2cf9e6d784ac5b1458911ef8364258dc54cba
<!-- gh-comment-id:2169924393 -->
@silentoplayz commented on GitHub (Jun 15, 2024):
Related - #3135
This issue *should* also be fixed via https://github.com/open-webui/open-webui/commit/dfa2cf9e6d784ac5b1458911ef8364258dc54cba as well.
Well, not fixed per se, but it can then be adjustable via environment variable.
When I submitted the PR I changed the default to 15 minutes, but I see it's been set back to 5 minutes as default.
<!-- gh-comment-id:2170475332 -->
@TheTerrasque commented on GitHub (Jun 15, 2024):
Well, not *fixed* per se, but it can then be adjustable via environment variable.
When I submitted the PR I changed the default to 15 minutes, but I see it's been set back to 5 minutes as default.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @joequant on GitHub (Jun 15, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3189
Bug Report
openwebui fails with a timeout if ollama is sending back a long running ollama chat
Description
Bug Summary:
openwebui fails with a timeout if ollama is sending back a long running ollama chat
Steps to Reproduce:
Run a chat with a response that takes more than a minute to respond
Expected Behavior:
It should continue to respond
Actual Behavior:
After a few minutes it fails with
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in call
open-webui | await self.middleware_stack(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
open-webui | await route.handle(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
open-webui | await self.app(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
open-webui | await super().call(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
open-webui | await self.middleware_stack(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
open-webui | await self.app(scope, receive, _send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
open-webui | with collapse_excgroups():
open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
open-webui | self.gen.throw(typ, value, traceback)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
open-webui | await func()
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
open-webui | async for chunk in self.body_iterator:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 50, in anext
open-webui | rv = await self.read_func()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 317, in readline
open-webui | return await self.readuntil()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 351, in readuntil
open-webui | await self._wait("readuntil")
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 311, in _wait
open-webui | with self._timer:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/helpers.py", line 735, in exit
open-webui | raise asyncio.TimeoutError from None
open-webui | TimeoutError
Environment
Open WebUI Version: [e.g., 0.1.120] 0.3.4
Operating System: linux
Browser (if applicable): [e.g., Chrome 100.0, Firefox 98.0]
Reproduction Details
Confirmation:
Logs and Screenshots
Browser Console Logs:
[Include relevant browser console logs, if applicable]
Docker Container Logs:
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
open-webui | await self.app(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
open-webui | await super().call(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
open-webui | await self.middleware_stack(scope, receive, send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
open-webui | await self.app(scope, receive, _send)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
open-webui | with collapse_excgroups():
open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
open-webui | self.gen.throw(typ, value, traceback)
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui | raise exc
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 261, in wrap
open-webui | await func()
open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 250, in stream_response
open-webui | async for chunk in self.body_iterator:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 50, in anext
open-webui | rv = await self.read_func()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 317, in readline
open-webui | return await self.readuntil()
open-webui | ^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 351, in readuntil
open-webui | await self._wait("readuntil")
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/streams.py", line 311, in _wait
open-webui | with self._timer:
open-webui | File "/usr/local/lib/python3.11/site-packages/aiohttp/helpers.py", line 735, in exit
open-webui | raise asyncio.TimeoutError from None
open-webui | TimeoutError
Screenshots (if applicable):
[Attach any relevant screenshots to help illustrate the issue]
Installation Method
docker compose
Additional Information
[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]
Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
@joequant commented on GitHub (Jun 15, 2024):
its a problem in 0.2.3
@joequant commented on GitHub (Jun 15, 2024):
This seems to have been fixed in
dfa2cf9e6d@silentoplayz commented on GitHub (Jun 15, 2024):
Related - #3135
This issue should also be fixed via https://github.com/open-webui/open-webui/commit/dfa2cf9e6d784ac5b1458911ef8364258dc54cba as well.
@TheTerrasque commented on GitHub (Jun 15, 2024):
Well, not fixed per se, but it can then be adjustable via environment variable.
When I submitted the PR I changed the default to 15 minutes, but I see it's been set back to 5 minutes as default.
@wsargent commented on GitHub (Feb 17, 2025):
What environment variable, though?