github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-07-31 10:36:16 -05:00
Code Issues 2.4k Packages Projects Releases 129 Wiki Activity

issue: Couldn't connect with OpenAI Compatible VLLM Server running in localhost #4340

New Issue
Closed
opened 2025-11-11 15:51:51 -06:00 by GiteaMirror · 2 comments
GiteaMirror commented 2025-11-11 15:51:51 -06:00
Owner
Copy Link
Copy Source

Originally created by @ThiruRJST on GitHub (Mar 9, 2025).

Check Existing Issues

  • I have searched the existing issues and discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Other

Open WebUI Version

0.5.20

Ollama Version (if applicable)

No response

Operating System

Ubuntu-22.04

Browser (if applicable)

Chrome

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have listed steps to reproduce the bug in detail.

Expected Behavior

User: What is an Apple?
Bot: Apple is a fruit.

Actual Behavior

User: What is an Apple?
500: Open WebUI: Server Connection

Steps to Reproduce

  1. Install and start serving the OpenAI Compatible inference server using vLLM
    vllm serve Qwen/Qwen2.5-1.5B-instruct --dtype=half
  2. Run the OpenWebUI using docker
    docker run -d -p 3000:8080 -v open-webui:/app/backend/data --name open-webui ghcr.io/open-webui/open-webui:main
  3. Setup the connections in OpenWebUI Admin panel.
    OpenAI Endpoint:
    BaseURL: http://localhost:8000/v1 (Tried assigning the address directly instead of localhost too)
  4. Verify the connection, The network error pops up

Logs & Screenshots

StackTrace

2025-03-09 08:43:35.810 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /api/v1/users/ HTTP/1.1" 200 - {}
2025-03-09 08:43:38.423 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34070 - "GET /api/webhook HTTP/1.1" 200 - {}
2025-03-09 08:43:38.425 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48126 - "GET /api/v1/auths/admin/config HTTP/1.1" 200 - {}
2025-03-09 08:43:38.425 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /api/v1/auths/admin/config/ldap/server HTTP/1.1" 200 - {}
2025-03-09 08:43:38.446 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /api/v1/auths/admin/config/ldap HTTP/1.1" 200 - {}
2025-03-09 08:43:38.806 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /api/version/updates HTTP/1.1" 200 - {}
2025-03-09 08:43:39.706 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /ollama/config HTTP/1.1" 200 - {}
2025-03-09 08:43:39.706 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34070 - "GET /api/v1/configs/direct_connections HTTP/1.1" 200 - {}
2025-03-09 08:43:39.706 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /openai/config HTTP/1.1" 200 - {}
2025-03-09 08:43:39.715 | ERROR    | open_webui.routers.openai:get_models:503 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {}
Traceback (most recent call last):

  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection
    sock = await aiohappyeyeballs.start_connection(
                 │                └ <function start_connection at 0x764e1d13f600>
                 └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection
    raise first_exception
          └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)")
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection
    sock = await _connect_sock(
                 └ <function _connect_sock at 0x764e1d151d00>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock
    await loop.sock_connect(sock, address)
          │    │            │     └ ('127.0.0.1', 8000)
          │    │            └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6>
          │    └ <cyfunction Loop.sock_connect at 0x764e1f225490>
          └ <uvloop.Loop running=True closed=False debug=False>
  File "uvloop/loop.pyx", line 2633, in sock_connect
    await fut
  File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb
    raise OSError(err, 'Connect call failed %s' % (address,))

ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000)


The above exception was the direct cause of the following exception:


Traceback (most recent call last):

  File "/usr/local/bin/uvicorn", line 10, in <module>
    sys.exit(main())
    │   │    └ <Command main>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__
    return self.main(*args, **kwargs)
           │    │     │       └ {}
           │    │     └ ()
           │    └ <function BaseCommand.main at 0x764e1f619da0>
           └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main
    rv = self.invoke(ctx)
         │    │      └ <click.core.Context object at 0x764e202e4290>
         │    └ <function Command.invoke at 0x764e1f61a980>
         └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           │   │      │    │           │   └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
           │   │      │    │           └ <click.core.Context object at 0x764e202e4290>
           │   │      │    └ <function main at 0x764e1f1e2f20>
           │   │      └ <Command main>
           │   └ <function Context.invoke at 0x764e1f619300>
           └ <click.core.Context object at 0x764e202e4290>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke
    return __callback(*args, **kwargs)
                       │       └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
                       └ ()
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main
    run(
    └ <function run at 0x764e1f627e20>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run
    server.run()
    │      └ <function Server.run at 0x764e1f485260>
    └ <uvicorn.server.Server object at 0x764e1f6281d0>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run
    return asyncio.run(self.serve(sockets=sockets))
           │       │   │    │             └ None
           │       │   │    └ <function Server.serve at 0x764e1f485300>
           │       │   └ <uvicorn.server.Server object at 0x764e1f6281d0>
           │       └ <function run at 0x764e1f990b80>
           └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           │      │   └ <coroutine object Server.serve at 0x764e1f3b1d50>
           │      └ <function Runner.run at 0x764e1f800720>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           │    │     │                  └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai...
           │    │     └ <cyfunction Loop.run_until_complete at 0x764e1f224380>
           │    └ <uvloop.Loop running=True closed=False debug=False>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro
    await self.app(scope, receive_or_disconnect, send_no_error)
          │    │   │      │                      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df9fec0>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
          │                            │    │    │     │      │        └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df9fec0>
          │                            │    │    │     │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │                            │    │    │     └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    │    └ <starlette.requests.Request object at 0x764d9df7e590>
          │                            │    └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
          │                            └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__
    await self.middleware_stack(scope, receive, send)
          │    │                │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20>
          │    │                │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │    │                └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>>
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
    await route.handle(scope, receive, send)
          │     │      │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20>
          │     │      │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │     │      └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │     └ <function Route.handle at 0x764e1c94c5e0>
          └ APIRoute(path='/openai/models/{url_idx}', name='get_models', methods=['GET'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
          │    │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <function request_response.<locals>.app at 0x764d9f0d36a0>
          └ APIRoute(path='/openai/models/{url_idx}', name='get_models', methods=['GET'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
          │                            │    │        │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20>
          │                            │    │        │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │                            │    │        └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    └ <starlette.requests.Request object at 0x764d9df7ca50>
          │                            └ <function request_response.<locals>.app.<locals>.app at 0x764d9df9ec00>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9c900>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <function request_response.<locals>.app.<locals>.app at 0x764d9df9ec00>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
                     │ └ <starlette.requests.Request object at 0x764d9df7ca50>
                     └ <function get_request_handler.<locals>.app at 0x764d9f0d2d40>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
                         └ <function run_endpoint_function at 0x764e1c94e3e0>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
    return await dependant.call(**values)
                 │         │      └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm...
                 │         └ <function get_models at 0x764ddfb28400>
                 └ Dependant(path_params=[ModelField(field_info=Path(PydanticUndefined), name='url_idx', mode='validation')], query_params=[], h...

> File "/app/backend/open_webui/routers/openai.py", line 454, in get_models
    async with session.get(
               │       └ <function ClientSession.get at 0x764e1d1c2200>
               └ <aiohttp.client.ClientSession object at 0x764d9e9a6b10>

  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__
    self._resp: _RetType = await self._coro
    │    │                       │    └ <member '_coro' of '_BaseRequestContextManager' objects>
    │    │                       └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97700>
    │    └ <member '_resp' of '_BaseRequestContextManager' objects>
    └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97700>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request
    conn = await self._connector.connect(
                 │    │          └ <function BaseConnector.connect at 0x764e1d1689a0>
                 │    └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90>
                 └ <aiohttp.client.ClientSession object at 0x764d9e9a6b10>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect
    proto = await self._create_connection(req, traces, timeout)
                  │    │                  │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                  │    │                  │    └ []
                  │    │                  └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910>
                  │    └ <function TCPConnector._create_connection at 0x764e1d1696c0>
                  └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
                     │    │                         │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                     │    │                         │    └ []
                     │    │                         └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910>
                     │    └ <function TCPConnector._create_direct_connection at 0x764e1d169e40>
                     └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection
    raise last_exc
          └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he...
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection
    transp, proto = await self._wrap_create_connection(
                          │    └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0>
                          └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection
    raise client_error(req.connection_key, exc) from exc
          │            │   └ <property object at 0x764e1d135670>
          │            └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910>
          └ <class 'aiohttp.client_exceptions.ClientConnectorError'>

aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)]
2025-03-09 08:43:39.718 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /openai/models/0 HTTP/1.1" 500 - {}
2025-03-09 08:43:43.422 | ERROR    | open_webui.routers.openai:verify_connection:564 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {}
Traceback (most recent call last):

  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection
    sock = await aiohappyeyeballs.start_connection(
                 │                └ <function start_connection at 0x764e1d13f600>
                 └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection
    raise first_exception
          └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)")
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection
    sock = await _connect_sock(
                 └ <function _connect_sock at 0x764e1d151d00>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock
    await loop.sock_connect(sock, address)
          │    │            │     └ ('127.0.0.1', 8000)
          │    │            └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6>
          │    └ <cyfunction Loop.sock_connect at 0x764e1f225490>
          └ <uvloop.Loop running=True closed=False debug=False>
  File "uvloop/loop.pyx", line 2633, in sock_connect
    await fut
  File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb
    raise OSError(err, 'Connect call failed %s' % (address,))

ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000)


The above exception was the direct cause of the following exception:


Traceback (most recent call last):

  File "/usr/local/bin/uvicorn", line 10, in <module>
    sys.exit(main())
    │   │    └ <Command main>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__
    return self.main(*args, **kwargs)
           │    │     │       └ {}
           │    │     └ ()
           │    └ <function BaseCommand.main at 0x764e1f619da0>
           └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main
    rv = self.invoke(ctx)
         │    │      └ <click.core.Context object at 0x764e202e4290>
         │    └ <function Command.invoke at 0x764e1f61a980>
         └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           │   │      │    │           │   └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
           │   │      │    │           └ <click.core.Context object at 0x764e202e4290>
           │   │      │    └ <function main at 0x764e1f1e2f20>
           │   │      └ <Command main>
           │   └ <function Context.invoke at 0x764e1f619300>
           └ <click.core.Context object at 0x764e202e4290>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke
    return __callback(*args, **kwargs)
                       │       └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
                       └ ()
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main
    run(
    └ <function run at 0x764e1f627e20>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run
    server.run()
    │      └ <function Server.run at 0x764e1f485260>
    └ <uvicorn.server.Server object at 0x764e1f6281d0>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run
    return asyncio.run(self.serve(sockets=sockets))
           │       │   │    │             └ None
           │       │   │    └ <function Server.serve at 0x764e1f485300>
           │       │   └ <uvicorn.server.Server object at 0x764e1f6281d0>
           │       └ <function run at 0x764e1f990b80>
           └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           │      │   └ <coroutine object Server.serve at 0x764e1f3b1d50>
           │      └ <function Runner.run at 0x764e1f800720>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           │    │     │                  └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai...
           │    │     └ <cyfunction Loop.run_until_complete at 0x764e1f224380>
           │    └ <uvloop.Loop running=True closed=False debug=False>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro
    await self.app(scope, receive_or_disconnect, send_no_error)
          │    │   │      │                      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df53ce0>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
          │                            │    │    │     │      │        └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df53ce0>
          │                            │    │    │     │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │                            │    │    │     └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    │    └ <starlette.requests.Request object at 0x764d9e997f10>
          │                            │    └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
          │                            └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__
    await self.middleware_stack(scope, receive, send)
          │    │                │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0>
          │    │                │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │    │                └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>>
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
    await route.handle(scope, receive, send)
          │     │      │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0>
          │     │      │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │     │      └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │     └ <function Route.handle at 0x764e1c94c5e0>
          └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
          │    │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <function request_response.<locals>.app at 0x764de41ed120>
          └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
          │                            │    │        │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0>
          │                            │    │        │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │                            │    │        └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    └ <starlette.requests.Request object at 0x764d9e997810>
          │                            └ <function request_response.<locals>.app.<locals>.app at 0x764d9df50040>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df53e20>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <function request_response.<locals>.app.<locals>.app at 0x764d9df50040>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
                     │ └ <starlette.requests.Request object at 0x764d9e997810>
                     └ <function get_request_handler.<locals>.app at 0x764de41ed080>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
                         └ <function run_endpoint_function at 0x764e1c94e3e0>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
    return await dependant.call(**values)
                 │         │      └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm...
                 │         └ <function verify_connection at 0x764ddfb2bba0>
                 └ Dependant(path_params=[], query_params=[], header_params=[], cookie_params=[], body_params=[ModelField(field_info=Body(Pydant...

> File "/app/backend/open_webui/routers/openai.py", line 534, in verify_connection
    async with session.get(
               │       └ <function ClientSession.get at 0x764e1d1c2200>
               └ <aiohttp.client.ClientSession object at 0x764ddff123d0>

  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__
    self._resp: _RetType = await self._coro
    │    │                       │    └ <member '_coro' of '_BaseRequestContextManager' objects>
    │    │                       └ <aiohttp.client._BaseRequestContextManager object at 0x764d9e943460>
    │    └ <member '_resp' of '_BaseRequestContextManager' objects>
    └ <aiohttp.client._BaseRequestContextManager object at 0x764d9e943460>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request
    conn = await self._connector.connect(
                 │    │          └ <function BaseConnector.connect at 0x764e1d1689a0>
                 │    └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0>
                 └ <aiohttp.client.ClientSession object at 0x764ddff123d0>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect
    proto = await self._create_connection(req, traces, timeout)
                  │    │                  │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                  │    │                  │    └ []
                  │    │                  └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90>
                  │    └ <function TCPConnector._create_connection at 0x764e1d1696c0>
                  └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
                     │    │                         │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                     │    │                         │    └ []
                     │    │                         └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90>
                     │    └ <function TCPConnector._create_direct_connection at 0x764e1d169e40>
                     └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection
    raise last_exc
          └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he...
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection
    transp, proto = await self._wrap_create_connection(
                          │    └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0>
                          └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection
    raise client_error(req.connection_key, exc) from exc
          │            │   └ <property object at 0x764e1d135670>
          │            └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90>
          └ <class 'aiohttp.client_exceptions.ClientConnectorError'>

aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)]
2025-03-09 08:43:43.426 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "POST /openai/verify HTTP/1.1" 500 - {}
2025-03-09 08:43:54.828 | ERROR    | open_webui.routers.openai:verify_connection:564 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {}
Traceback (most recent call last):

  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection
    sock = await aiohappyeyeballs.start_connection(
                 │                └ <function start_connection at 0x764e1d13f600>
                 └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection
    raise first_exception
          └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)")
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection
    sock = await _connect_sock(
                 └ <function _connect_sock at 0x764e1d151d00>
  File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock
    await loop.sock_connect(sock, address)
          │    │            │     └ ('127.0.0.1', 8000)
          │    │            └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6>
          │    └ <cyfunction Loop.sock_connect at 0x764e1f225490>
          └ <uvloop.Loop running=True closed=False debug=False>
  File "uvloop/loop.pyx", line 2633, in sock_connect
    await fut
  File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb
    raise OSError(err, 'Connect call failed %s' % (address,))

ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000)


The above exception was the direct cause of the following exception:


Traceback (most recent call last):

  File "/usr/local/bin/uvicorn", line 10, in <module>
    sys.exit(main())
    │   │    └ <Command main>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__
    return self.main(*args, **kwargs)
           │    │     │       └ {}
           │    │     └ ()
           │    └ <function BaseCommand.main at 0x764e1f619da0>
           └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main
    rv = self.invoke(ctx)
         │    │      └ <click.core.Context object at 0x764e202e4290>
         │    └ <function Command.invoke at 0x764e1f61a980>
         └ <Command main>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           │   │      │    │           │   └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
           │   │      │    │           └ <click.core.Context object at 0x764e202e4290>
           │   │      │    └ <function main at 0x764e1f1e2f20>
           │   │      └ <Command main>
           │   └ <function Context.invoke at 0x764e1f619300>
           └ <click.core.Context object at 0x764e202e4290>
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke
    return __callback(*args, **kwargs)
                       │       └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'...
                       └ ()
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main
    run(
    └ <function run at 0x764e1f627e20>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run
    server.run()
    │      └ <function Server.run at 0x764e1f485260>
    └ <uvicorn.server.Server object at 0x764e1f6281d0>
  File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run
    return asyncio.run(self.serve(sockets=sockets))
           │       │   │    │             └ None
           │       │   │    └ <function Server.serve at 0x764e1f485300>
           │       │   └ <uvicorn.server.Server object at 0x764e1f6281d0>
           │       └ <function run at 0x764e1f990b80>
           └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           │      │   └ <coroutine object Server.serve at 0x764e1f3b1d50>
           │      └ <function Runner.run at 0x764e1f800720>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           │    │     │                  └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai...
           │    │     └ <cyfunction Loop.run_until_complete at 0x764e1f224380>
           │    └ <uvloop.Loop running=True closed=False debug=False>
           └ <asyncio.runners.Runner object at 0x764e1f1ebad0>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro
    await self.app(scope, receive_or_disconnect, send_no_error)
          │    │   │      │                      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9e9bac00>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710>
  File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
          │                            │    │    │     │      │        └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9e9bac00>
          │                            │    │    │     │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │                            │    │    │     └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    │    └ <starlette.requests.Request object at 0x764d9dfd7ed0>
          │                            │    └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
          │                            └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__
    await self.middleware_stack(scope, receive, send)
          │    │                │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0>
          │    │                │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │    │                └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>>
          └ <fastapi.routing.APIRouter object at 0x764dddbc0610>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
    await route.handle(scope, receive, send)
          │     │      │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0>
          │     │      │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │     │      └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │     └ <function Route.handle at 0x764e1c94c5e0>
          └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
          │    │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0>
          │    │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │    │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │    └ <function request_response.<locals>.app at 0x764de41ed120>
          └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST'])
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
          │                            │    │        │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0>
          │                            │    │        │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │                            │    │        └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          │                            │    └ <starlette.requests.Request object at 0x764d9dfd7dd0>
          │                            └ <function request_response.<locals>.app.<locals>.app at 0x764d9e9b8a40>
          └ <function wrap_app_handling_exceptions at 0x764e1c862f20>
  File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
          │   │      │        └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9bba60>
          │   │      └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80>
          │   └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c...
          └ <function request_response.<locals>.app.<locals>.app at 0x764d9e9b8a40>
  File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
                     │ └ <starlette.requests.Request object at 0x764d9dfd7dd0>
                     └ <function get_request_handler.<locals>.app at 0x764de41ed080>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
                         └ <function run_endpoint_function at 0x764e1c94e3e0>
  File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
    return await dependant.call(**values)
                 │         │      └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm...
                 │         └ <function verify_connection at 0x764ddfb2bba0>
                 └ Dependant(path_params=[], query_params=[], header_params=[], cookie_params=[], body_params=[ModelField(field_info=Body(Pydant...

> File "/app/backend/open_webui/routers/openai.py", line 534, in verify_connection
    async with session.get(
               │       └ <function ClientSession.get at 0x764e1d1c2200>
               └ <aiohttp.client.ClientSession object at 0x764d9e84abd0>

  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__
    self._resp: _RetType = await self._coro
    │    │                       │    └ <member '_coro' of '_BaseRequestContextManager' objects>
    │    │                       └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97580>
    │    └ <member '_resp' of '_BaseRequestContextManager' objects>
    └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97580>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request
    conn = await self._connector.connect(
                 │    │          └ <function BaseConnector.connect at 0x764e1d1689a0>
                 │    └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510>
                 └ <aiohttp.client.ClientSession object at 0x764d9e84abd0>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect
    proto = await self._create_connection(req, traces, timeout)
                  │    │                  │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                  │    │                  │    └ []
                  │    │                  └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90>
                  │    └ <function TCPConnector._create_connection at 0x764e1d1696c0>
                  └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
                     │    │                         │    │       └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5)
                     │    │                         │    └ []
                     │    │                         └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90>
                     │    └ <function TCPConnector._create_direct_connection at 0x764e1d169e40>
                     └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection
    raise last_exc
          └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he...
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection
    transp, proto = await self._wrap_create_connection(
                          │    └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0>
                          └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510>
  File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection
    raise client_error(req.connection_key, exc) from exc
          │            │   └ <property object at 0x764e1d135670>
          │            └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90>
          └ <class 'aiohttp.client_exceptions.ClientConnectorError'>

aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)]
2025-03-09 08:43:54.832 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:55918 - "POST /openai/verify HTTP/1.1" 500 - {}

Additional Information

No response

Originally created by @ThiruRJST on GitHub (Mar 9, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Other ### Open WebUI Version 0.5.20 ### Ollama Version (if applicable) _No response_ ### Operating System Ubuntu-22.04 ### Browser (if applicable) Chrome ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have listed steps to reproduce the bug in detail. ### Expected Behavior User: What is an Apple? Bot: Apple is a fruit. ### Actual Behavior User: What is an Apple? 500: Open WebUI: Server Connection ### Steps to Reproduce 1. Install and start serving the OpenAI Compatible inference server using vLLM ```vllm serve Qwen/Qwen2.5-1.5B-instruct --dtype=half ``` 2. Run the OpenWebUI using docker ```docker run -d -p 3000:8080 -v open-webui:/app/backend/data --name open-webui ghcr.io/open-webui/open-webui:main``` 3. Setup the connections in OpenWebUI Admin panel. OpenAI Endpoint: BaseURL: http://localhost:8000/v1 (Tried assigning the address directly instead of localhost too) 4. Verify the connection, The network error pops up ### Logs & Screenshots ### StackTrace ``` 2025-03-09 08:43:35.810 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /api/v1/users/ HTTP/1.1" 200 - {} 2025-03-09 08:43:38.423 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34070 - "GET /api/webhook HTTP/1.1" 200 - {} 2025-03-09 08:43:38.425 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48126 - "GET /api/v1/auths/admin/config HTTP/1.1" 200 - {} 2025-03-09 08:43:38.425 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /api/v1/auths/admin/config/ldap/server HTTP/1.1" 200 - {} 2025-03-09 08:43:38.446 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /api/v1/auths/admin/config/ldap HTTP/1.1" 200 - {} 2025-03-09 08:43:38.806 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /api/version/updates HTTP/1.1" 200 - {} 2025-03-09 08:43:39.706 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:48136 - "GET /ollama/config HTTP/1.1" 200 - {} 2025-03-09 08:43:39.706 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34070 - "GET /api/v1/configs/direct_connections HTTP/1.1" 200 - {} 2025-03-09 08:43:39.706 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /openai/config HTTP/1.1" 200 - {} 2025-03-09 08:43:39.715 | ERROR | open_webui.routers.openai:get_models:503 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {} Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection sock = await aiohappyeyeballs.start_connection( │ └ <function start_connection at 0x764e1d13f600> └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection raise first_exception └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)") File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection sock = await _connect_sock( └ <function _connect_sock at 0x764e1d151d00> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock await loop.sock_connect(sock, address) │ │ │ └ ('127.0.0.1', 8000) │ │ └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6> │ └ <cyfunction Loop.sock_connect at 0x764e1f225490> └ <uvloop.Loop running=True closed=False debug=False> File "uvloop/loop.pyx", line 2633, in sock_connect await fut File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb raise OSError(err, 'Connect call failed %s' % (address,)) ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000) The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/bin/uvicorn", line 10, in <module> sys.exit(main()) │ │ └ <Command main> │ └ <built-in function exit> └ <module 'sys' (built-in)> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__ return self.main(*args, **kwargs) │ │ │ └ {} │ │ └ () │ └ <function BaseCommand.main at 0x764e1f619da0> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main rv = self.invoke(ctx) │ │ └ <click.core.Context object at 0x764e202e4290> │ └ <function Command.invoke at 0x764e1f61a980> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke return ctx.invoke(self.callback, **ctx.params) │ │ │ │ │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... │ │ │ │ └ <click.core.Context object at 0x764e202e4290> │ │ │ └ <function main at 0x764e1f1e2f20> │ │ └ <Command main> │ └ <function Context.invoke at 0x764e1f619300> └ <click.core.Context object at 0x764e202e4290> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke return __callback(*args, **kwargs) │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... └ () File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main run( └ <function run at 0x764e1f627e20> File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run server.run() │ └ <function Server.run at 0x764e1f485260> └ <uvicorn.server.Server object at 0x764e1f6281d0> File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run return asyncio.run(self.serve(sockets=sockets)) │ │ │ │ └ None │ │ │ └ <function Server.serve at 0x764e1f485300> │ │ └ <uvicorn.server.Server object at 0x764e1f6281d0> │ └ <function run at 0x764e1f990b80> └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'> File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run return runner.run(main) │ │ └ <coroutine object Server.serve at 0x764e1f3b1d50> │ └ <function Runner.run at 0x764e1f800720> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run return self._loop.run_until_complete(task) │ │ │ └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai... │ │ └ <cyfunction Loop.run_until_complete at 0x764e1f224380> │ └ <uvloop.Loop running=True closed=False debug=False> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro await self.app(scope, receive_or_disconnect, send_no_error) │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df9fec0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__ await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) │ │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df9fec0> │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ │ └ <starlette.requests.Request object at 0x764d9df7e590> │ │ └ <fastapi.routing.APIRouter object at 0x764dddbc0610> │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__ await self.middleware_stack(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>> └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app await route.handle(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function Route.handle at 0x764e1c94c5e0> └ APIRoute(path='/openai/models/{url_idx}', name='get_models', methods=['GET']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle await self.app(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function request_response.<locals>.app at 0x764d9f0d36a0> └ APIRoute(path='/openai/models/{url_idx}', name='get_models', methods=['GET']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app await wrap_app_handling_exceptions(app, request)(scope, receive, send) │ │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9fe20> │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ └ <starlette.requests.Request object at 0x764d9df7ca50> │ └ <function request_response.<locals>.app.<locals>.app at 0x764d9df9ec00> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df9c900> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df9c9a0> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <function request_response.<locals>.app.<locals>.app at 0x764d9df9ec00> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app response = await f(request) │ └ <starlette.requests.Request object at 0x764d9df7ca50> └ <function get_request_handler.<locals>.app at 0x764d9f0d2d40> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app raw_response = await run_endpoint_function( └ <function run_endpoint_function at 0x764e1c94e3e0> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function return await dependant.call(**values) │ │ └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm... │ └ <function get_models at 0x764ddfb28400> └ Dependant(path_params=[ModelField(field_info=Path(PydanticUndefined), name='url_idx', mode='validation')], query_params=[], h... > File "/app/backend/open_webui/routers/openai.py", line 454, in get_models async with session.get( │ └ <function ClientSession.get at 0x764e1d1c2200> └ <aiohttp.client.ClientSession object at 0x764d9e9a6b10> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__ self._resp: _RetType = await self._coro │ │ │ └ <member '_coro' of '_BaseRequestContextManager' objects> │ │ └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97700> │ └ <member '_resp' of '_BaseRequestContextManager' objects> └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97700> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request conn = await self._connector.connect( │ │ └ <function BaseConnector.connect at 0x764e1d1689a0> │ └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90> └ <aiohttp.client.ClientSession object at 0x764d9e9a6b10> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect proto = await self._create_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910> │ └ <function TCPConnector._create_connection at 0x764e1d1696c0> └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection _, proto = await self._create_direct_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910> │ └ <function TCPConnector._create_direct_connection at 0x764e1d169e40> └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection raise last_exc └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he... File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection transp, proto = await self._wrap_create_connection( │ └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0> └ <aiohttp.connector.TCPConnector object at 0x764d9dfb0b90> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection raise client_error(req.connection_key, exc) from exc │ │ └ <property object at 0x764e1d135670> │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa4910> └ <class 'aiohttp.client_exceptions.ClientConnectorError'> aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] 2025-03-09 08:43:39.718 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "GET /openai/models/0 HTTP/1.1" 500 - {} 2025-03-09 08:43:43.422 | ERROR | open_webui.routers.openai:verify_connection:564 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {} Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection sock = await aiohappyeyeballs.start_connection( │ └ <function start_connection at 0x764e1d13f600> └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection raise first_exception └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)") File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection sock = await _connect_sock( └ <function _connect_sock at 0x764e1d151d00> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock await loop.sock_connect(sock, address) │ │ │ └ ('127.0.0.1', 8000) │ │ └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6> │ └ <cyfunction Loop.sock_connect at 0x764e1f225490> └ <uvloop.Loop running=True closed=False debug=False> File "uvloop/loop.pyx", line 2633, in sock_connect await fut File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb raise OSError(err, 'Connect call failed %s' % (address,)) ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000) The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/bin/uvicorn", line 10, in <module> sys.exit(main()) │ │ └ <Command main> │ └ <built-in function exit> └ <module 'sys' (built-in)> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__ return self.main(*args, **kwargs) │ │ │ └ {} │ │ └ () │ └ <function BaseCommand.main at 0x764e1f619da0> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main rv = self.invoke(ctx) │ │ └ <click.core.Context object at 0x764e202e4290> │ └ <function Command.invoke at 0x764e1f61a980> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke return ctx.invoke(self.callback, **ctx.params) │ │ │ │ │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... │ │ │ │ └ <click.core.Context object at 0x764e202e4290> │ │ │ └ <function main at 0x764e1f1e2f20> │ │ └ <Command main> │ └ <function Context.invoke at 0x764e1f619300> └ <click.core.Context object at 0x764e202e4290> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke return __callback(*args, **kwargs) │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... └ () File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main run( └ <function run at 0x764e1f627e20> File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run server.run() │ └ <function Server.run at 0x764e1f485260> └ <uvicorn.server.Server object at 0x764e1f6281d0> File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run return asyncio.run(self.serve(sockets=sockets)) │ │ │ │ └ None │ │ │ └ <function Server.serve at 0x764e1f485300> │ │ └ <uvicorn.server.Server object at 0x764e1f6281d0> │ └ <function run at 0x764e1f990b80> └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'> File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run return runner.run(main) │ │ └ <coroutine object Server.serve at 0x764e1f3b1d50> │ └ <function Runner.run at 0x764e1f800720> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run return self._loop.run_until_complete(task) │ │ │ └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai... │ │ └ <cyfunction Loop.run_until_complete at 0x764e1f224380> │ └ <uvloop.Loop running=True closed=False debug=False> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro await self.app(scope, receive_or_disconnect, send_no_error) │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df53ce0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__ await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) │ │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9df53ce0> │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ │ └ <starlette.requests.Request object at 0x764d9e997f10> │ │ └ <fastapi.routing.APIRouter object at 0x764dddbc0610> │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__ await self.middleware_stack(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>> └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app await route.handle(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function Route.handle at 0x764e1c94c5e0> └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle await self.app(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function request_response.<locals>.app at 0x764de41ed120> └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app await wrap_app_handling_exceptions(app, request)(scope, receive, send) │ │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df507c0> │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ └ <starlette.requests.Request object at 0x764d9e997810> │ └ <function request_response.<locals>.app.<locals>.app at 0x764d9df50040> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9df53e20> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9df53600> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <function request_response.<locals>.app.<locals>.app at 0x764d9df50040> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app response = await f(request) │ └ <starlette.requests.Request object at 0x764d9e997810> └ <function get_request_handler.<locals>.app at 0x764de41ed080> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app raw_response = await run_endpoint_function( └ <function run_endpoint_function at 0x764e1c94e3e0> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function return await dependant.call(**values) │ │ └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm... │ └ <function verify_connection at 0x764ddfb2bba0> └ Dependant(path_params=[], query_params=[], header_params=[], cookie_params=[], body_params=[ModelField(field_info=Body(Pydant... > File "/app/backend/open_webui/routers/openai.py", line 534, in verify_connection async with session.get( │ └ <function ClientSession.get at 0x764e1d1c2200> └ <aiohttp.client.ClientSession object at 0x764ddff123d0> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__ self._resp: _RetType = await self._coro │ │ │ └ <member '_coro' of '_BaseRequestContextManager' objects> │ │ └ <aiohttp.client._BaseRequestContextManager object at 0x764d9e943460> │ └ <member '_resp' of '_BaseRequestContextManager' objects> └ <aiohttp.client._BaseRequestContextManager object at 0x764d9e943460> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request conn = await self._connector.connect( │ │ └ <function BaseConnector.connect at 0x764e1d1689a0> │ └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0> └ <aiohttp.client.ClientSession object at 0x764ddff123d0> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect proto = await self._create_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90> │ └ <function TCPConnector._create_connection at 0x764e1d1696c0> └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection _, proto = await self._create_direct_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90> │ └ <function TCPConnector._create_direct_connection at 0x764e1d169e40> └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection raise last_exc └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he... File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection transp, proto = await self._wrap_create_connection( │ └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0> └ <aiohttp.connector.TCPConnector object at 0x764de4e143d0> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection raise client_error(req.connection_key, exc) from exc │ │ └ <property object at 0x764e1d135670> │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9ea1bc90> └ <class 'aiohttp.client_exceptions.ClientConnectorError'> aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] 2025-03-09 08:43:43.426 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:34078 - "POST /openai/verify HTTP/1.1" 500 - {} 2025-03-09 08:43:54.828 | ERROR | open_webui.routers.openai:verify_connection:564 - Client error: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] - {} Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1115, in _wrap_create_connection sock = await aiohappyeyeballs.start_connection( │ └ <function start_connection at 0x764e1d13f600> └ <module 'aiohappyeyeballs' from '/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/__init__.py'> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 115, in start_connection raise first_exception └ ConnectionRefusedError(111, "Connect call failed ('127.0.0.1', 8000)") File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 72, in start_connection sock = await _connect_sock( └ <function _connect_sock at 0x764e1d151d00> File "/usr/local/lib/python3.11/site-packages/aiohappyeyeballs/impl.py", line 197, in _connect_sock await loop.sock_connect(sock, address) │ │ │ └ ('127.0.0.1', 8000) │ │ └ <socket.socket [closed] fd=-1, family=2, type=1, proto=6> │ └ <cyfunction Loop.sock_connect at 0x764e1f225490> └ <uvloop.Loop running=True closed=False debug=False> File "uvloop/loop.pyx", line 2633, in sock_connect await fut File "uvloop/loop.pyx", line 1108, in uvloop.loop.Loop._sock_connect_cb raise OSError(err, 'Connect call failed %s' % (address,)) ConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 8000) The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/bin/uvicorn", line 10, in <module> sys.exit(main()) │ │ └ <Command main> │ └ <built-in function exit> └ <module 'sys' (built-in)> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1161, in __call__ return self.main(*args, **kwargs) │ │ │ └ {} │ │ └ () │ └ <function BaseCommand.main at 0x764e1f619da0> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1082, in main rv = self.invoke(ctx) │ │ └ <click.core.Context object at 0x764e202e4290> │ └ <function Command.invoke at 0x764e1f61a980> └ <Command main> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1443, in invoke return ctx.invoke(self.callback, **ctx.params) │ │ │ │ │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... │ │ │ │ └ <click.core.Context object at 0x764e202e4290> │ │ │ └ <function main at 0x764e1f1e2f20> │ │ └ <Command main> │ └ <function Context.invoke at 0x764e1f619300> └ <click.core.Context object at 0x764e202e4290> File "/usr/local/lib/python3.11/site-packages/click/core.py", line 788, in invoke return __callback(*args, **kwargs) │ └ {'host': '0.0.0.0', 'port': 8080, 'forwarded_allow_ips': '*', 'app': 'open_webui.main:app', 'uds': None, 'fd': None, 'reload'... └ () File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 412, in main run( └ <function run at 0x764e1f627e20> File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 579, in run server.run() │ └ <function Server.run at 0x764e1f485260> └ <uvicorn.server.Server object at 0x764e1f6281d0> File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 66, in run return asyncio.run(self.serve(sockets=sockets)) │ │ │ │ └ None │ │ │ └ <function Server.serve at 0x764e1f485300> │ │ └ <uvicorn.server.Server object at 0x764e1f6281d0> │ └ <function run at 0x764e1f990b80> └ <module 'asyncio' from '/usr/local/lib/python3.11/asyncio/__init__.py'> File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run return runner.run(main) │ │ └ <coroutine object Server.serve at 0x764e1f3b1d50> │ └ <function Runner.run at 0x764e1f800720> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run return self._loop.run_until_complete(task) │ │ │ └ <Task pending name='Task-1' coro=<Server.serve() running at /usr/local/lib/python3.11/site-packages/uvicorn/server.py:70> wai... │ │ └ <cyfunction Loop.run_until_complete at 0x764e1f224380> │ └ <uvloop.Loop running=True closed=False debug=False> └ <asyncio.runners.Runner object at 0x764e1f1ebad0> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 141, in coro await self.app(scope, receive_or_disconnect, send_no_error) │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9e9bac00> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <open_webui.main.RedirectMiddleware object at 0x764d9ef61710> File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__ await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) │ │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.send_no_error at 0x764d9e9bac00> │ │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ │ └ <starlette.requests.Request object at 0x764d9dfd7ed0> │ │ └ <fastapi.routing.APIRouter object at 0x764dddbc0610> │ └ <starlette.middleware.exceptions.ExceptionMiddleware object at 0x764d9eef8090> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__ await self.middleware_stack(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <bound method Router.app of <fastapi.routing.APIRouter object at 0x764dddbc0610>> └ <fastapi.routing.APIRouter object at 0x764dddbc0610> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app await route.handle(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function Route.handle at 0x764e1c94c5e0> └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle await self.app(scope, receive, send) │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0> │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ └ <function request_response.<locals>.app at 0x764de41ed120> └ APIRoute(path='/openai/verify', name='verify_connection', methods=['POST']) File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app await wrap_app_handling_exceptions(app, request)(scope, receive, send) │ │ │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9ba3e0> │ │ │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... │ │ └ <starlette.requests.Request object at 0x764d9dfd7dd0> │ └ <function request_response.<locals>.app.<locals>.app at 0x764d9e9b8a40> └ <function wrap_app_handling_exceptions at 0x764e1c862f20> File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app await app(scope, receive, sender) │ │ │ └ <function wrap_app_handling_exceptions.<locals>.wrapped_app.<locals>.sender at 0x764d9e9bba60> │ │ └ <function BaseHTTPMiddleware.__call__.<locals>.call_next.<locals>.receive_or_disconnect at 0x764d9e9b9f80> │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': ('172.17.0.2', 8080), 'c... └ <function request_response.<locals>.app.<locals>.app at 0x764d9e9b8a40> File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app response = await f(request) │ └ <starlette.requests.Request object at 0x764d9dfd7dd0> └ <function get_request_handler.<locals>.app at 0x764de41ed080> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app raw_response = await run_endpoint_function( └ <function run_endpoint_function at 0x764e1c94e3e0> File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function return await dependant.call(**values) │ │ └ {'user': UserModel(id='494fe465-e84d-49af-ac97-4b484ea46495', name='Thirumalai Kumar', email='gglrthiru@gmail.com', role='adm... │ └ <function verify_connection at 0x764ddfb2bba0> └ Dependant(path_params=[], query_params=[], header_params=[], cookie_params=[], body_params=[ModelField(field_info=Body(Pydant... > File "/app/backend/open_webui/routers/openai.py", line 534, in verify_connection async with session.get( │ └ <function ClientSession.get at 0x764e1d1c2200> └ <aiohttp.client.ClientSession object at 0x764d9e84abd0> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 1425, in __aenter__ self._resp: _RetType = await self._coro │ │ │ └ <member '_coro' of '_BaseRequestContextManager' objects> │ │ └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97580> │ └ <member '_resp' of '_BaseRequestContextManager' objects> └ <aiohttp.client._BaseRequestContextManager object at 0x764d9df97580> File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 703, in _request conn = await self._connector.connect( │ │ └ <function BaseConnector.connect at 0x764e1d1689a0> │ └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510> └ <aiohttp.client.ClientSession object at 0x764d9e84abd0> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 548, in connect proto = await self._create_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90> │ └ <function TCPConnector._create_connection at 0x764e1d1696c0> └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1056, in _create_connection _, proto = await self._create_direct_connection(req, traces, timeout) │ │ │ │ └ ClientTimeout(total=None, connect=None, sock_read=None, sock_connect=None, ceil_threshold=5) │ │ │ └ [] │ │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90> │ └ <function TCPConnector._create_direct_connection at 0x764e1d169e40> └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1400, in _create_direct_connection raise last_exc └ ClientConnectorError(ConnectionKey(host='127.0.0.1', port=8000, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_he... File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1369, in _create_direct_connection transp, proto = await self._wrap_create_connection( │ └ <function TCPConnector._wrap_create_connection at 0x764e1d1698a0> └ <aiohttp.connector.TCPConnector object at 0x764d9edf6510> File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1130, in _wrap_create_connection raise client_error(req.connection_key, exc) from exc │ │ └ <property object at 0x764e1d135670> │ └ <aiohttp.client_reqrep.ClientRequest object at 0x764d9dfa0c90> └ <class 'aiohttp.client_exceptions.ClientConnectorError'> aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 127.0.0.1:8000 ssl:default [Connect call failed ('127.0.0.1', 8000)] 2025-03-09 08:43:54.832 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 172.17.0.1:55918 - "POST /openai/verify HTTP/1.1" 500 - {} ``` ### Additional Information _No response_
GiteaMirror added the bug label 2025-11-11 15:51:51 -06:00
GiteaMirror commented 2025-11-11 15:51:52 -06:00
Author
Owner
Copy Link
Copy Source

@rgaricano commented on GitHub (Mar 9, 2025):

are you tried with ssl: https://localhost:8000/v1 ?
(it's an ssl error related)

@rgaricano commented on GitHub (Mar 9, 2025): are you tried with ssl: `https://localhost:8000/v1` ? (it's an ssl error related)
GiteaMirror commented 2025-11-11 15:51:52 -06:00
Author
Owner
Copy Link
Copy Source

@ThiruRJST commented on GitHub (Mar 9, 2025):

are you tried with ssl: https://localhost:8000/v1 ? (it's an ssl error related)

But I dont have any ssl setup in local, Well I tried as you said

Image

@ThiruRJST commented on GitHub (Mar 9, 2025): > are you tried with ssl: `https://localhost:8000/v1` ? (it's an ssl error related) But I dont have any ssl setup in local, Well I tried as you said ![Image](https://github.com/user-attachments/assets/f701d0f4-b9dd-4cd2-8025-207906519bc8)
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No labels bug
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
GiteaMirror ninjasurge (Kaehlen Rog)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#4340