github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-05-07 11:28:35 -05:00
Code Issues 1.3k Packages Projects Releases 126 Wiki Activity

[GH-ISSUE #11440] issue: Couldn't connect with OpenAI Compatible VLLM Server running in localhost #31760

New Issue
Closed
opened 2026-04-25 05:40:01 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-04-25 05:40:01 -05:00
Owner
Copy Link

Originally created by @ThiruRJST on GitHub (Mar 9, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/11440

Check Existing Issues

  • I have searched the existing issues and discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Other

Open WebUI Version

0.5.20

Ollama Version (if applicable)

No response

Operating System

Ubuntu-22.04

Browser (if applicable)

Chrome

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have listed steps to reproduce the bug in detail.

Expected Behavior

User: What is an Apple?
Bot: Apple is a fruit.

Actual Behavior

User: What is an Apple?
500: Open WebUI: Server Connection

Steps to Reproduce

  1. Install and start serving the OpenAI Compatible inference server using vLLM
    vllm serve Qwen/Qwen2.5-1.5B-instruct --dtype=half
  2. Run the OpenWebUI using docker
    docker run -d -p 3000:8080 -v open-webui:/app/backend/data --name open-webui ghcr.io/open-webui/open-webui:main
  3. Setup the connections in OpenWebUI Admin panel.
    OpenAI Endpoint:
    BaseURL: http://localhost:8000/v1 (Tried assigning the address directly instead of localhost too)
  4. Verify the connection, The network error pops up

Logs & Screenshots

StackTrace

2025-03-09 08:43:35.810 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /api/v1/users/ HTTP/1.1" 200 - {}
2025-03-09 08:43:38.423 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34070 - "GET /api/webhook HTTP/1.1" 200 - {}
2025-03-09 08:43:38.425 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48126 - "GET /api/v1/auths/admin/config HTTP/1.1" 200 - {}
2025-03-09 08:43:38.425 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /api/v1/auths/admin/config/ldap/server HTTP/1.1" 200 - {}
2025-03-09 08:43:38.446 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /api/v1/auths/admin/config/ldap HTTP/1.1" 200 - {}
2025-03-09 08:43:38.806 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /api/version/updates HTTP/1.1" 200 - {}
2025-03-09 08:43:39.706 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /ollama/config HTTP/1.1" 200 - {}
2025-03-09 08:43:39.706 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34070 - "GET /api/v1/configs/direct_connections HTTP/1.1" 200 - {}
2025-03-09 08:43:39.706 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /openai/config HTTP/1.1" 200 - {}
2025-03-09 08:43:39.715 | ERROR    | open_webui.routers.openai:get_models:503 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {}
Traceback (most recent call last):

  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection
    sock = await aiohappyeyeballs.start_connection(
                 │                └ <function start_connection at 0x764e1d13f600>
                 └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection
    raise first_exception
          └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)")
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection
    sock = await _connect_sock(
                 └ <function _connect_sock at 0x764e1d151d00>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock
    await loop.sock_connect(sock, address)
          │    │            │     └ ('127.0.0.1', 8000)
          │    │            └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6>
          │    └ <cyfunction Loop.sock_connect at 0x764e1f225490>
          └ <uvloop.Loop running=True closed=False debug=False>
  File "uvloop/loop.pyx", line 2633, in sock_connect
    await fut
  File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb
    raise OSError(err, 'Connect call failed %s' % (address,))

ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000)


The above exception was the direct cause of the following exception:


Traceback (most recent call last):

  File "/usr/local/bin/uvicorn", line 10, in <module>
    sys.exit(main())
    │   │    └ <Command main>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__
    return self.main(*args, **kwargs)
           │    │     │       └ {}
           │    │     └ ()
           │    └ <function BaseCommand.main at 0x764e1f619da0>
           └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main
    rv = self.invoke(ctx)
         │    │      └ <click.core.Context object at 0x764e202e4290>
         │    └ <function Command.invoke at 0x764e1f61a980>
         └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           │   │      │    │           │   └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
           │   │      │    │           └ <click.core.Context object at 0x764e202e4290>
           │   │      │    └ <function main at 0x764e1f1e2f20>
           │   │      └ <Command main>
           │   └ <function Context.invoke at 0x764e1f619300>
           └ <click.core.Context object at 0x764e202e4290>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke
    return __callback(*args, **kwargs)
                       │       └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
                       └ ()
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main
    run(
    └ <function run at 0x764e1f627e20>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run
    server.run()
    │      └ <function Server.run at 0x764e1f485260>
    └ <uvicorn.server.Server object at 0x764e1f6281d0>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run
    return asyncio.run(self.serve(sockets=sockets))
           │       │   │    │             └ None
           │       │   │    └ <function Server.serve at 0x764e1f485300>
           │       │   └ <uvicorn.server.Server object at 0x764e1f6281d0>
           │       └ <function run at 0x764e1f990b80>
           └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           │      │   └ <coroutine object Server.serve at 0x764e1f3b1d50>
           │      └ <function Runner.run at 0x764e1f800720>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           │    │     │                  └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai...
           │    │     └ <cyfunction Loop.run_until_complete at 0x764e1f224380>
           │    └ <uvloop.Loop running=True closed=False debug=False>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro
    await self.app(scope, receive_or_disconnect, send_no_error)
          │    │   │      │                      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df9fec0>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
          │                            │    │    │     │      │        └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df9fec0>
          │                            │    │    │     │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │                            │    │    │     └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    │    └ <starlette.requests.Request object at 0x764d9df7e590>
          │                            │    └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
          │                            └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__
    await self.middleware_stack(scope, receive, send)
          │    │                │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20>
          │    │                │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │    │                └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>>
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
    await route.handle(scope, receive, send)
          │     │      │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20>
          │     │      │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │     │      └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │     └ <function Route.handle at 0x764e1c94c5e0>
          └ APIRoute(path='/openai/models/{url_idx}', name='get_models', methods=['GET'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
          │    │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <function request_response.<locals>.app at 0x764d9f0d36a0>
          └ APIRoute(path='/openai/models/{url_idx}', name='get_models', methods=['GET'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
          │                            │    │        │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20>
          │                            │    │        │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │                            │    │        └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    └ <starlette.requests.Request object at 0x764d9df7ca50>
          │                            └ <function request_response.<locals>.app.<locals>.app at 0x764d9df9ec00>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9c900>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <function request_response.<locals>.app.<locals>.app at 0x764d9df9ec00>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
                     │ └ <starlette.requests.Request object at 0x764d9df7ca50>
                     └ <function get_request_handler.<locals>.app at 0x764d9f0d2d40>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
                         └ <function run_endpoint_function at 0x764e1c94e3e0>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
    return await dependant.call(**values)
                 │         │      └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm...
                 │         └ <function get_models at 0x764ddfb28400>
                 └ Dependant(path_params=[ModelField(field_info=Path(PydanticUndefined), name='url_idx', mode='validation')], query_params=[], h...

> File "/app/backend/open_webui/routers/openai.py", line 454, in get_models
    async with session.get(
               │       └ <function ClientSession.get at 0x764e1d1c2200>
               └ <aiohttp.client.ClientSession object at 0x764d9e9a6b10>

  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__
    self._resp: _RetType = await self._coro
    │    │                       │    └ <member '_coro' of '_BaseRequestContextManager' objects>
    │    │                       └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97700>
    │    └ <member '_resp' of '_BaseRequestContextManager' objects>
    └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97700>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request
    conn = await self._connector.connect(
                 │    │          └ <function BaseConnector.connect at 0x764e1d1689a0>
                 │    └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90>
                 └ <aiohttp.client.ClientSession object at 0x764d9e9a6b10>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect
    proto = await self._create_connection(req, traces, timeout)
                  │    │                  │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                  │    │                  │    └ []
                  │    │                  └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910>
                  │    └ <function TCPConnector._create_connection at 0x764e1d1696c0>
                  └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
                     │    │                         │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                     │    │                         │    └ []
                     │    │                         └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910>
                     │    └ <function TCPConnector._create_direct_connection at 0x764e1d169e40>
                     └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection
    raise last_exc
          └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he...
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection
    transp, proto = await self._wrap_create_connection(
                          │    └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0>
                          └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection
    raise client_error(req.connection_key, exc) from exc
          │            │   └ <property object at 0x764e1d135670>
          │            └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910>
          └ <class 'aiohttp.client_exceptions.ClientConnectorError'>

aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)]
2025-03-09 08:43:39.718 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /openai/models/0 HTTP/1.1" 500 - {}
2025-03-09 08:43:43.422 | ERROR    | open_webui.routers.openai:verify_connection:564 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {}
Traceback (most recent call last):

  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection
    sock = await aiohappyeyeballs.start_connection(
                 │                └ <function start_connection at 0x764e1d13f600>
                 └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection
    raise first_exception
          └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)")
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection
    sock = await _connect_sock(
                 └ <function _connect_sock at 0x764e1d151d00>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock
    await loop.sock_connect(sock, address)
          │    │            │     └ ('127.0.0.1', 8000)
          │    │            └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6>
          │    └ <cyfunction Loop.sock_connect at 0x764e1f225490>
          └ <uvloop.Loop running=True closed=False debug=False>
  File "uvloop/loop.pyx", line 2633, in sock_connect
    await fut
  File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb
    raise OSError(err, 'Connect call failed %s' % (address,))

ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000)


The above exception was the direct cause of the following exception:


Traceback (most recent call last):

  File "/usr/local/bin/uvicorn", line 10, in <module>
    sys.exit(main())
    │   │    └ <Command main>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__
    return self.main(*args, **kwargs)
           │    │     │       └ {}
           │    │     └ ()
           │    └ <function BaseCommand.main at 0x764e1f619da0>
           └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main
    rv = self.invoke(ctx)
         │    │      └ <click.core.Context object at 0x764e202e4290>
         │    └ <function Command.invoke at 0x764e1f61a980>
         └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           │   │      │    │           │   └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
           │   │      │    │           └ <click.core.Context object at 0x764e202e4290>
           │   │      │    └ <function main at 0x764e1f1e2f20>
           │   │      └ <Command main>
           │   └ <function Context.invoke at 0x764e1f619300>
           └ <click.core.Context object at 0x764e202e4290>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke
    return __callback(*args, **kwargs)
                       │       └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
                       └ ()
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main
    run(
    └ <function run at 0x764e1f627e20>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run
    server.run()
    │      └ <function Server.run at 0x764e1f485260>
    └ <uvicorn.server.Server object at 0x764e1f6281d0>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run
    return asyncio.run(self.serve(sockets=sockets))
           │       │   │    │             └ None
           │       │   │    └ <function Server.serve at 0x764e1f485300>
           │       │   └ <uvicorn.server.Server object at 0x764e1f6281d0>
           │       └ <function run at 0x764e1f990b80>
           └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           │      │   └ <coroutine object Server.serve at 0x764e1f3b1d50>
           │      └ <function Runner.run at 0x764e1f800720>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           │    │     │                  └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai...
           │    │     └ <cyfunction Loop.run_until_complete at 0x764e1f224380>
           │    └ <uvloop.Loop running=True closed=False debug=False>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro
    await self.app(scope, receive_or_disconnect, send_no_error)
          │    │   │      │                      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df53ce0>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
          │                            │    │    │     │      │        └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df53ce0>
          │                            │    │    │     │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │                            │    │    │     └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    │    └ <starlette.requests.Request object at 0x764d9e997f10>
          │                            │    └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
          │                            └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__
    await self.middleware_stack(scope, receive, send)
          │    │                │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0>
          │    │                │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │    │                └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>>
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
    await route.handle(scope, receive, send)
          │     │      │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0>
          │     │      │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │     │      └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │     └ <function Route.handle at 0x764e1c94c5e0>
          └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
          │    │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <function request_response.<locals>.app at 0x764de41ed120>
          └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
          │                            │    │        │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0>
          │                            │    │        │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │                            │    │        └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    └ <starlette.requests.Request object at 0x764d9e997810>
          │                            └ <function request_response.<locals>.app.<locals>.app at 0x764d9df50040>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df53e20>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <function request_response.<locals>.app.<locals>.app at 0x764d9df50040>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
                     │ └ <starlette.requests.Request object at 0x764d9e997810>
                     └ <function get_request_handler.<locals>.app at 0x764de41ed080>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
                         └ <function run_endpoint_function at 0x764e1c94e3e0>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
    return await dependant.call(**values)
                 │         │      └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm...
                 │         └ <function verify_connection at 0x764ddfb2bba0>
                 └ Dependant(path_params=[], query_params=[], header_params=[], cookie_params=[], body_params=[ModelField(field_info=Body(Pydant...

> File "/app/backend/open_webui/routers/openai.py", line 534, in verify_connection
    async with session.get(
               │       └ <function ClientSession.get at 0x764e1d1c2200>
               └ <aiohttp.client.ClientSession object at 0x764ddff123d0>

  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__
    self._resp: _RetType = await self._coro
    │    │                       │    └ <member '_coro' of '_BaseRequestContextManager' objects>
    │    │                       └ <aiohttp.client._BaseRequestContextManager object at 0x764d9e943460>
    │    └ <member '_resp' of '_BaseRequestContextManager' objects>
    └ <aiohttp.client._BaseRequestContextManager object at 0x764d9e943460>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request
    conn = await self._connector.connect(
                 │    │          └ <function BaseConnector.connect at 0x764e1d1689a0>
                 │    └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0>
                 └ <aiohttp.client.ClientSession object at 0x764ddff123d0>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect
    proto = await self._create_connection(req, traces, timeout)
                  │    │                  │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                  │    │                  │    └ []
                  │    │                  └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90>
                  │    └ <function TCPConnector._create_connection at 0x764e1d1696c0>
                  └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
                     │    │                         │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                     │    │                         │    └ []
                     │    │                         └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90>
                     │    └ <function TCPConnector._create_direct_connection at 0x764e1d169e40>
                     └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection
    raise last_exc
          └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he...
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection
    transp, proto = await self._wrap_create_connection(
                          │    └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0>
                          └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection
    raise client_error(req.connection_key, exc) from exc
          │            │   └ <property object at 0x764e1d135670>
          │            └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90>
          └ <class 'aiohttp.client_exceptions.ClientConnectorError'>

aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)]
2025-03-09 08:43:43.426 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "POST /openai/verify HTTP/1.1" 500 - {}
2025-03-09 08:43:54.828 | ERROR    | open_webui.routers.openai:verify_connection:564 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {}
Traceback (most recent call last):

  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection
    sock = await aiohappyeyeballs.start_connection(
                 │                └ <function start_connection at 0x764e1d13f600>
                 └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection
    raise first_exception
          └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)")
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection
    sock = await _connect_sock(
                 └ <function _connect_sock at 0x764e1d151d00>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock
    await loop.sock_connect(sock, address)
          │    │            │     └ ('127.0.0.1', 8000)
          │    │            └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6>
          │    └ <cyfunction Loop.sock_connect at 0x764e1f225490>
          └ <uvloop.Loop running=True closed=False debug=False>
  File "uvloop/loop.pyx", line 2633, in sock_connect
    await fut
  File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb
    raise OSError(err, 'Connect call failed %s' % (address,))

ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000)


The above exception was the direct cause of the following exception:


Traceback (most recent call last):

  File "/usr/local/bin/uvicorn", line 10, in <module>
    sys.exit(main())
    │   │    └ <Command main>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__
    return self.main(*args, **kwargs)
           │    │     │       └ {}
           │    │     └ ()
           │    └ <function BaseCommand.main at 0x764e1f619da0>
           └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main
    rv = self.invoke(ctx)
         │    │      └ <click.core.Context object at 0x764e202e4290>
         │    └ <function Command.invoke at 0x764e1f61a980>
         └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           │   │      │    │           │   └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
           │   │      │    │           └ <click.core.Context object at 0x764e202e4290>
           │   │      │    └ <function main at 0x764e1f1e2f20>
           │   │      └ <Command main>
           │   └ <function Context.invoke at 0x764e1f619300>
           └ <click.core.Context object at 0x764e202e4290>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke
    return __callback(*args, **kwargs)
                       │       └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
                       └ ()
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main
    run(
    └ <function run at 0x764e1f627e20>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run
    server.run()
    │      └ <function Server.run at 0x764e1f485260>
    └ <uvicorn.server.Server object at 0x764e1f6281d0>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run
    return asyncio.run(self.serve(sockets=sockets))
           │       │   │    │             └ None
           │       │   │    └ <function Server.serve at 0x764e1f485300>
           │       │   └ <uvicorn.server.Server object at 0x764e1f6281d0>
           │       └ <function run at 0x764e1f990b80>
           └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           │      │   └ <coroutine object Server.serve at 0x764e1f3b1d50>
           │      └ <function Runner.run at 0x764e1f800720>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           │    │     │                  └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai...
           │    │     └ <cyfunction Loop.run_until_complete at 0x764e1f224380>
           │    └ <uvloop.Loop running=True closed=False debug=False>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro
    await self.app(scope, receive_or_disconnect, send_no_error)
          │    │   │      │                      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9e9bac00>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
          │                            │    │    │     │      │        └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9e9bac00>
          │                            │    │    │     │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │                            │    │    │     └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    │    └ <starlette.requests.Request object at 0x764d9dfd7ed0>
          │                            │    └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
          │                            └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__
    await self.middleware_stack(scope, receive, send)
          │    │                │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0>
          │    │                │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │    │                └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>>
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
    await route.handle(scope, receive, send)
          │     │      │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0>
          │     │      │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │     │      └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │     └ <function Route.handle at 0x764e1c94c5e0>
          └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
          │    │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <function request_response.<locals>.app at 0x764de41ed120>
          └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
          │                            │    │        │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0>
          │                            │    │        │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │                            │    │        └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    └ <starlette.requests.Request object at 0x764d9dfd7dd0>
          │                            └ <function request_response.<locals>.app.<locals>.app at 0x764d9e9b8a40>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9bba60>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <function request_response.<locals>.app.<locals>.app at 0x764d9e9b8a40>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
                     │ └ <starlette.requests.Request object at 0x764d9dfd7dd0>
                     └ <function get_request_handler.<locals>.app at 0x764de41ed080>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
                         └ <function run_endpoint_function at 0x764e1c94e3e0>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
    return await dependant.call(**values)
                 │         │      └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm...
                 │         └ <function verify_connection at 0x764ddfb2bba0>
                 └ Dependant(path_params=[], query_params=[], header_params=[], cookie_params=[], body_params=[ModelField(field_info=Body(Pydant...

> File "/app/backend/open_webui/routers/openai.py", line 534, in verify_connection
    async with session.get(
               │       └ <function ClientSession.get at 0x764e1d1c2200>
               └ <aiohttp.client.ClientSession object at 0x764d9e84abd0>

  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__
    self._resp: _RetType = await self._coro
    │    │                       │    └ <member '_coro' of '_BaseRequestContextManager' objects>
    │    │                       └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97580>
    │    └ <member '_resp' of '_BaseRequestContextManager' objects>
    └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97580>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request
    conn = await self._connector.connect(
                 │    │          └ <function BaseConnector.connect at 0x764e1d1689a0>
                 │    └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510>
                 └ <aiohttp.client.ClientSession object at 0x764d9e84abd0>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect
    proto = await self._create_connection(req, traces, timeout)
                  │    │                  │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                  │    │                  │    └ []
                  │    │                  └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90>
                  │    └ <function TCPConnector._create_connection at 0x764e1d1696c0>
                  └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
                     │    │                         │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                     │    │                         │    └ []
                     │    │                         └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90>
                     │    └ <function TCPConnector._create_direct_connection at 0x764e1d169e40>
                     └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection
    raise last_exc
          └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he...
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection
    transp, proto = await self._wrap_create_connection(
                          │    └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0>
                          └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection
    raise client_error(req.connection_key, exc) from exc
          │            │   └ <property object at 0x764e1d135670>
          │            └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90>
          └ <class 'aiohttp.client_exceptions.ClientConnectorError'>

aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)]
2025-03-09 08:43:54.832 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:55918 - "POST /openai/verify HTTP/1.1" 500 - {}

Additional Information

No response

Originally created by @ThiruRJST on GitHub (Mar 9, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/11440 ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Other ### Open WebUI Version 0.5.20 ### Ollama Version (if applicable) _No response_ ### Operating System Ubuntu-22.04 ### Browser (if applicable) Chrome ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have listed steps to reproduce the bug in detail. ### Expected Behavior User: What is an Apple? Bot: Apple is a fruit. ### Actual Behavior User: What is an Apple? 500: Open WebUI: Server Connection ### Steps to Reproduce 1. Install and start serving the OpenAI Compatible inference server using vLLM ```vllm serve Qwen/Qwen2.5-1.5B-instruct --dtype=half ``` 2. Run the OpenWebUI using docker ```docker run -d -p 3000:8080 -v open-webui:/app/backend/data --name open-webui ghcr.io/open-webui/open-webui:main``` 3. Setup the connections in OpenWebUI Admin panel. OpenAI Endpoint: BaseURL: http://localhost:8000/v1 (Tried assigning the address directly instead of localhost too) 4. Verify the connection, The network error pops up ### Logs & Screenshots ### StackTrace ``` 2025-03-09 08:43:35.810 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /api/v1/users/ HTTP/1.1" 200 - {} 2025-03-09 08:43:38.423 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34070 - "GET /api/webhook HTTP/1.1" 200 - {} 2025-03-09 08:43:38.425 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48126 - "GET /api/v1/auths/admin/config HTTP/1.1" 200 - {} 2025-03-09 08:43:38.425 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /api/v1/auths/admin/config/ldap/server HTTP/1.1" 200 - {} 2025-03-09 08:43:38.446 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /api/v1/auths/admin/config/ldap HTTP/1.1" 200 - {} 2025-03-09 08:43:38.806 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /api/version/updates HTTP/1.1" 200 - {} 2025-03-09 08:43:39.706 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /ollama/config HTTP/1.1" 200 - {} 2025-03-09 08:43:39.706 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34070 - "GET /api/v1/configs/direct_connections HTTP/1.1" 200 - {} 2025-03-09 08:43:39.706 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /openai/config HTTP/1.1" 200 - {} 2025-03-09 08:43:39.715 | ERROR | open_webui.routers.openai:get_models:503 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {} Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection sock = await aiohappyeyeballs.start_connection( │ └ <function start_connection at 0x764e1d13f600> └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection raise first_exception └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)") File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection sock = await _connect_sock( └ <function _connect_sock at 0x764e1d151d00> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock await loop.sock_connect(sock, address) │ │ │ └ ('127.0.0.1', 8000) │ │ └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6> │ └ <cyfunction Loop.sock_connect at 0x764e1f225490> └ <uvloop.Loop running=True closed=False debug=False> File "uvloop/loop.pyx", line 2633, in sock_connect await fut File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb raise OSError(err, 'Connect call failed %s' % (address,)) ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000) The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/bin/uvicorn", line 10, in <module> sys.exit(main()) │ │ └ <Command main> │ └ <built-in function exit> └ <module 'sys' (built-in)> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__ return self.main(*args, **kwargs) │ │ │ └ {} │ │ └ () │ └ <function BaseCommand.main at 0x764e1f619da0> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main rv = self.invoke(ctx) │ │ └ <click.core.Context object at 0x764e202e4290> │ └ <function Command.invoke at 0x764e1f61a980> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke return ctx.invoke(self.callback, **ctx.params) │ │ │ │ │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... │ │ │ │ └ <click.core.Context object at 0x764e202e4290> │ │ │ └ <function main at 0x764e1f1e2f20> │ │ └ <Command main> │ └ <function Context.invoke at 0x764e1f619300> └ <click.core.Context object at 0x764e202e4290> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke return __callback(*args, **kwargs) │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... └ () File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main run( └ <function run at 0x764e1f627e20> File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run server.run() │ └ <function Server.run at 0x764e1f485260> └ <uvicorn.server.Server object at 0x764e1f6281d0> File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run return asyncio.run(self.serve(sockets=sockets)) │ │ │ │ └ None │ │ │ └ <function Server.serve at 0x764e1f485300> │ │ └ <uvicorn.server.Server object at 0x764e1f6281d0> │ └ <function run at 0x764e1f990b80> └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'> File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run return runner.run(main) │ │ └ <coroutine object Server.serve at 0x764e1f3b1d50> │ └ <function Runner.run at 0x764e1f800720> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run return self._loop.run_until_complete(task) │ │ │ └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai... │ │ └ <cyfunction Loop.run_until_complete at 0x764e1f224380> │ └ <uvloop.Loop running=True closed=False debug=False> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro await self.app(scope, receive_or_disconnect, send_no_error) │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df9fec0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__ await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) │ │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df9fec0> │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ │ └ <starlette.requests.Request object at 0x764d9df7e590> │ │ └ <fastapi.routing.APIRouter object at 0x764dddbc0610> │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__ await self.middleware_stack(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>> └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app await route.handle(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function Route.handle at 0x764e1c94c5e0> └ APIRoute(path='/openai/models/{url_idx}', name='get_models', methods=['GET']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle await self.app(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function request_response.<locals>.app at 0x764d9f0d36a0> └ APIRoute(path='/openai/models/{url_idx}', name='get_models', methods=['GET']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app await wrap_app_handling_exceptions(app, request)(scope, receive, send) │ │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20> │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ └ <starlette.requests.Request object at 0x764d9df7ca50> │ └ <function request_response.<locals>.app.<locals>.app at 0x764d9df9ec00> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9c900> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <function request_response.<locals>.app.<locals>.app at 0x764d9df9ec00> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app response = await f(request) │ └ <starlette.requests.Request object at 0x764d9df7ca50> └ <function get_request_handler.<locals>.app at 0x764d9f0d2d40> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app raw_response = await run_endpoint_function( └ <function run_endpoint_function at 0x764e1c94e3e0> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function return await dependant.call(**values) │ │ └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm... │ └ <function get_models at 0x764ddfb28400> └ Dependant(path_params=[ModelField(field_info=Path(PydanticUndefined), name='url_idx', mode='validation')], query_params=[], h... > File "/app/backend/open_webui/routers/openai.py", line 454, in get_models async with session.get( │ └ <function ClientSession.get at 0x764e1d1c2200> └ <aiohttp.client.ClientSession object at 0x764d9e9a6b10> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__ self._resp: _RetType = await self._coro │ │ │ └ <member '_coro' of '_BaseRequestContextManager' objects> │ │ └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97700> │ └ <member '_resp' of '_BaseRequestContextManager' objects> └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97700> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request conn = await self._connector.connect( │ │ └ <function BaseConnector.connect at 0x764e1d1689a0> │ └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90> └ <aiohttp.client.ClientSession object at 0x764d9e9a6b10> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect proto = await self._create_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910> │ └ <function TCPConnector._create_connection at 0x764e1d1696c0> └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection _, proto = await self._create_direct_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910> │ └ <function TCPConnector._create_direct_connection at 0x764e1d169e40> └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection raise last_exc └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he... File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection transp, proto = await self._wrap_create_connection( │ └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0> └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection raise client_error(req.connection_key, exc) from exc │ │ └ <property object at 0x764e1d135670> │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910> └ <class 'aiohttp.client_exceptions.ClientConnectorError'> aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] 2025-03-09 08:43:39.718 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /openai/models/0 HTTP/1.1" 500 - {} 2025-03-09 08:43:43.422 | ERROR | open_webui.routers.openai:verify_connection:564 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {} Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection sock = await aiohappyeyeballs.start_connection( │ └ <function start_connection at 0x764e1d13f600> └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection raise first_exception └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)") File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection sock = await _connect_sock( └ <function _connect_sock at 0x764e1d151d00> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock await loop.sock_connect(sock, address) │ │ │ └ ('127.0.0.1', 8000) │ │ └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6> │ └ <cyfunction Loop.sock_connect at 0x764e1f225490> └ <uvloop.Loop running=True closed=False debug=False> File "uvloop/loop.pyx", line 2633, in sock_connect await fut File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb raise OSError(err, 'Connect call failed %s' % (address,)) ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000) The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/bin/uvicorn", line 10, in <module> sys.exit(main()) │ │ └ <Command main> │ └ <built-in function exit> └ <module 'sys' (built-in)> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__ return self.main(*args, **kwargs) │ │ │ └ {} │ │ └ () │ └ <function BaseCommand.main at 0x764e1f619da0> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main rv = self.invoke(ctx) │ │ └ <click.core.Context object at 0x764e202e4290> │ └ <function Command.invoke at 0x764e1f61a980> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke return ctx.invoke(self.callback, **ctx.params) │ │ │ │ │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... │ │ │ │ └ <click.core.Context object at 0x764e202e4290> │ │ │ └ <function main at 0x764e1f1e2f20> │ │ └ <Command main> │ └ <function Context.invoke at 0x764e1f619300> └ <click.core.Context object at 0x764e202e4290> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke return __callback(*args, **kwargs) │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... └ () File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main run( └ <function run at 0x764e1f627e20> File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run server.run() │ └ <function Server.run at 0x764e1f485260> └ <uvicorn.server.Server object at 0x764e1f6281d0> File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run return asyncio.run(self.serve(sockets=sockets)) │ │ │ │ └ None │ │ │ └ <function Server.serve at 0x764e1f485300> │ │ └ <uvicorn.server.Server object at 0x764e1f6281d0> │ └ <function run at 0x764e1f990b80> └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'> File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run return runner.run(main) │ │ └ <coroutine object Server.serve at 0x764e1f3b1d50> │ └ <function Runner.run at 0x764e1f800720> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run return self._loop.run_until_complete(task) │ │ │ └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai... │ │ └ <cyfunction Loop.run_until_complete at 0x764e1f224380> │ └ <uvloop.Loop running=True closed=False debug=False> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro await self.app(scope, receive_or_disconnect, send_no_error) │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df53ce0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__ await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) │ │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df53ce0> │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ │ └ <starlette.requests.Request object at 0x764d9e997f10> │ │ └ <fastapi.routing.APIRouter object at 0x764dddbc0610> │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__ await self.middleware_stack(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>> └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app await route.handle(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function Route.handle at 0x764e1c94c5e0> └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle await self.app(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function request_response.<locals>.app at 0x764de41ed120> └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app await wrap_app_handling_exceptions(app, request)(scope, receive, send) │ │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0> │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ └ <starlette.requests.Request object at 0x764d9e997810> │ └ <function request_response.<locals>.app.<locals>.app at 0x764d9df50040> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df53e20> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <function request_response.<locals>.app.<locals>.app at 0x764d9df50040> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app response = await f(request) │ └ <starlette.requests.Request object at 0x764d9e997810> └ <function get_request_handler.<locals>.app at 0x764de41ed080> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app raw_response = await run_endpoint_function( └ <function run_endpoint_function at 0x764e1c94e3e0> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function return await dependant.call(**values) │ │ └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm... │ └ <function verify_connection at 0x764ddfb2bba0> └ Dependant(path_params=[], query_params=[], header_params=[], cookie_params=[], body_params=[ModelField(field_info=Body(Pydant... > File "/app/backend/open_webui/routers/openai.py", line 534, in verify_connection async with session.get( │ └ <function ClientSession.get at 0x764e1d1c2200> └ <aiohttp.client.ClientSession object at 0x764ddff123d0> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__ self._resp: _RetType = await self._coro │ │ │ └ <member '_coro' of '_BaseRequestContextManager' objects> │ │ └ <aiohttp.client._BaseRequestContextManager object at 0x764d9e943460> │ └ <member '_resp' of '_BaseRequestContextManager' objects> └ <aiohttp.client._BaseRequestContextManager object at 0x764d9e943460> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request conn = await self._connector.connect( │ │ └ <function BaseConnector.connect at 0x764e1d1689a0> │ └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0> └ <aiohttp.client.ClientSession object at 0x764ddff123d0> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect proto = await self._create_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90> │ └ <function TCPConnector._create_connection at 0x764e1d1696c0> └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection _, proto = await self._create_direct_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90> │ └ <function TCPConnector._create_direct_connection at 0x764e1d169e40> └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection raise last_exc └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he... File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection transp, proto = await self._wrap_create_connection( │ └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0> └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection raise client_error(req.connection_key, exc) from exc │ │ └ <property object at 0x764e1d135670> │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90> └ <class 'aiohttp.client_exceptions.ClientConnectorError'> aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] 2025-03-09 08:43:43.426 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "POST /openai/verify HTTP/1.1" 500 - {} 2025-03-09 08:43:54.828 | ERROR | open_webui.routers.openai:verify_connection:564 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {} Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection sock = await aiohappyeyeballs.start_connection( │ └ <function start_connection at 0x764e1d13f600> └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection raise first_exception └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)") File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection sock = await _connect_sock( └ <function _connect_sock at 0x764e1d151d00> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock await loop.sock_connect(sock, address) │ │ │ └ ('127.0.0.1', 8000) │ │ └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6> │ └ <cyfunction Loop.sock_connect at 0x764e1f225490> └ <uvloop.Loop running=True closed=False debug=False> File "uvloop/loop.pyx", line 2633, in sock_connect await fut File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb raise OSError(err, 'Connect call failed %s' % (address,)) ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000) The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/bin/uvicorn", line 10, in <module> sys.exit(main()) │ │ └ <Command main> │ └ <built-in function exit> └ <module 'sys' (built-in)> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__ return self.main(*args, **kwargs) │ │ │ └ {} │ │ └ () │ └ <function BaseCommand.main at 0x764e1f619da0> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main rv = self.invoke(ctx) │ │ └ <click.core.Context object at 0x764e202e4290> │ └ <function Command.invoke at 0x764e1f61a980> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke return ctx.invoke(self.callback, **ctx.params) │ │ │ │ │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... │ │ │ │ └ <click.core.Context object at 0x764e202e4290> │ │ │ └ <function main at 0x764e1f1e2f20> │ │ └ <Command main> │ └ <function Context.invoke at 0x764e1f619300> └ <click.core.Context object at 0x764e202e4290> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke return __callback(*args, **kwargs) │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... └ () File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main run( └ <function run at 0x764e1f627e20> File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run server.run() │ └ <function Server.run at 0x764e1f485260> └ <uvicorn.server.Server object at 0x764e1f6281d0> File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run return asyncio.run(self.serve(sockets=sockets)) │ │ │ │ └ None │ │ │ └ <function Server.serve at 0x764e1f485300> │ │ └ <uvicorn.server.Server object at 0x764e1f6281d0> │ └ <function run at 0x764e1f990b80> └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'> File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run return runner.run(main) │ │ └ <coroutine object Server.serve at 0x764e1f3b1d50> │ └ <function Runner.run at 0x764e1f800720> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run return self._loop.run_until_complete(task) │ │ │ └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai... │ │ └ <cyfunction Loop.run_until_complete at 0x764e1f224380> │ └ <uvloop.Loop running=True closed=False debug=False> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro await self.app(scope, receive_or_disconnect, send_no_error) │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9e9bac00> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__ await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) │ │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9e9bac00> │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ │ └ <starlette.requests.Request object at 0x764d9dfd7ed0> │ │ └ <fastapi.routing.APIRouter object at 0x764dddbc0610> │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__ await self.middleware_stack(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>> └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app await route.handle(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function Route.handle at 0x764e1c94c5e0> └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle await self.app(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function request_response.<locals>.app at 0x764de41ed120> └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app await wrap_app_handling_exceptions(app, request)(scope, receive, send) │ │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0> │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ └ <starlette.requests.Request object at 0x764d9dfd7dd0> │ └ <function request_response.<locals>.app.<locals>.app at 0x764d9e9b8a40> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9bba60> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <function request_response.<locals>.app.<locals>.app at 0x764d9e9b8a40> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app response = await f(request) │ └ <starlette.requests.Request object at 0x764d9dfd7dd0> └ <function get_request_handler.<locals>.app at 0x764de41ed080> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app raw_response = await run_endpoint_function( └ <function run_endpoint_function at 0x764e1c94e3e0> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function return await dependant.call(**values) │ │ └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm... │ └ <function verify_connection at 0x764ddfb2bba0> └ Dependant(path_params=[], query_params=[], header_params=[], cookie_params=[], body_params=[ModelField(field_info=Body(Pydant... > File "/app/backend/open_webui/routers/openai.py", line 534, in verify_connection async with session.get( │ └ <function ClientSession.get at 0x764e1d1c2200> └ <aiohttp.client.ClientSession object at 0x764d9e84abd0> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__ self._resp: _RetType = await self._coro │ │ │ └ <member '_coro' of '_BaseRequestContextManager' objects> │ │ └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97580> │ └ <member '_resp' of '_BaseRequestContextManager' objects> └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97580> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request conn = await self._connector.connect( │ │ └ <function BaseConnector.connect at 0x764e1d1689a0> │ └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510> └ <aiohttp.client.ClientSession object at 0x764d9e84abd0> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect proto = await self._create_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90> │ └ <function TCPConnector._create_connection at 0x764e1d1696c0> └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection _, proto = await self._create_direct_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90> │ └ <function TCPConnector._create_direct_connection at 0x764e1d169e40> └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection raise last_exc └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he... File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection transp, proto = await self._wrap_create_connection( │ └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0> └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection raise client_error(req.connection_key, exc) from exc │ │ └ <property object at 0x764e1d135670> │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90> └ <class 'aiohttp.client_exceptions.ClientConnectorError'> aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] 2025-03-09 08:43:54.832 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:55918 - "POST /openai/verify HTTP/1.1" 500 - {} ``` ### Additional Information _No response_
GiteaMirror added the bug label 2026-04-25 05:40:01 -05:00
GiteaMirror commented 2026-04-25 05:40:04 -05:00
Author
Owner
Copy Link

@rgaricano commented on GitHub (Mar 9, 2025):

are you tried with ssl: https://localhost:8000/v1 ?
(it's an ssl error related)

<!-- gh-comment-id:2708756865 --> @rgaricano commented on GitHub (Mar 9, 2025): are you tried with ssl: `https://localhost:8000/v1` ? (it's an ssl error related)
GiteaMirror commented 2026-04-25 05:40:04 -05:00
Author
Owner
Copy Link

@ThiruRJST commented on GitHub (Mar 9, 2025):

are you tried with ssl: https://localhost:8000/v1 ? (it's an ssl error related)

But I dont have any ssl setup in local, Well I tried as you said

Image

<!-- gh-comment-id:2708770318 --> @ThiruRJST commented on GitHub (Mar 9, 2025): > are you tried with ssl: `https://localhost:8000/v1` ? (it's an ssl error related) But I dont have any ssl setup in local, Well I tried as you said ![Image](https://github.com/user-attachments/assets/f701d0f4-b9dd-4cd2-8025-207906519bc8)
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#31760
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?