When using RancherDesktop, can't connect to the Ollama server on my host #1047

Closed
opened 2025-11-11 14:36:13 -06:00 by GiteaMirror · 0 comments
Owner

Originally created by @ppasieka on GitHub (May 27, 2024).

Bug Report

Description

Bug Summary:
I use RancherDesktop to run docker containers (it is the licensing thing, I can't switch to Docker Desktop). I can pull and start the container, but I can't connect to the Ollama server running on my host machine

Steps to Reproduce:
Follow installation steps from readme:

docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main

Expected Behavior:
Can connect to ollama server, list installed models, trigger inference

Actual Behavior:
Error when starting the Open WebUI (see screenshot)

Environment

  • Open WebUI Version: 0.1.125

  • Ollama (if applicable): 0.1.38

  • Operating System: [Windows 10]

  • Browser (if applicable): any browser

Reproduction Details

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.

Logs and Screenshots

Loading WEBUI_SECRET_KEY from .webui_secret_key
INFO:     Started server process [1]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
INFO:     172.17.0.1:53572 - "GET / HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/entry/start.4d0d7042.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53576 - "GET /_app/immutable/chunks/scheduler.f6668761.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/chunks/singletons.105b85e5.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/chunks/index.afef706d.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/chunks/index.65c87b32.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/entry/app.62dc7e6b.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/nodes/0.9b2c9561.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/chunks/Toaster.svelte_svelte_type_style_lang.4f4e956a.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/chunks/constants.c3d2104f.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/chunks/navigation.6ed5731e.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/assets/Toaster.3a6d0da3.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /_app/immutable/chunks/index.c122cac0.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53576 - "GET /_app/immutable/chunks/each.2cd6bd47.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/assets/0.de36d200.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/assets/2.c7820e19.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/assets/index.8a27bb7e.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /_app/immutable/chunks/index.c4d7520e.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/nodes/1.acdc58d4.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53576 - "GET /_app/immutable/chunks/stores.46842bc6.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/nodes/2.7711eee9.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/chunks/FileSaver.min.898eb36f.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/chunks/_commonjsHelpers.de833af9.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /_app/immutable/chunks/index.24d0f459.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/chunks/index.69f6ab4e.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53576 - "GET /_app/immutable/chunks/index.15f26e66.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/chunks/Modal.68c1a0a5.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/chunks/index.b7ffcff4.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/chunks/AdvancedParams.020cee97.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /_app/immutable/chunks/index.94bf9275.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/chunks/index.3f5e7a6d.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53572 - "GET /_app/immutable/nodes/3.113d8beb.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53576 - "GET /_app/immutable/chunks/index.f3d17e4d.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/chunks/index.4987a420.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /_app/immutable/chunks/Tags.4457bfcc.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53610 - "GET /_app/immutable/chunks/dayjs.min.1e504c00.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /assets/fonts/Arimo-Variable.ttf HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /favicon.png HTTP/1.1" 200 OK
INFO:     172.17.0.1:53614 - "GET /manifest.json HTTP/1.1" 200 OK
INFO:     172.17.0.1:53612 - "GET /api/v1/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /themes/rosepine.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /themes/rosepine-dawn.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53600 - "GET /_app/immutable/nodes/13.a8c7da85.js HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /_app/immutable/assets/13.e43bb62b.css HTTP/1.1" 200 OK
INFO:     172.17.0.1:53588 - "GET /assets/fonts/Mona-Sans.woff2 HTTP/1.1" 200 OK
insert_new_auth
INFO:     172.17.0.1:46504 - "POST /api/v1/auths/signup HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /api/v1/documents/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /ollama/api/tags HTTP/1.1" 500 Internal Server Error
INFO:     172.17.0.1:46508 - "GET /ollama/api/version HTTP/1.1" 500 Internal Server Error
https://api.openai.com/v1/models
INFO:     172.17.0.1:46508 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized
INFO:     172.17.0.1:46504 - "GET /user.png HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/chats/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/auths/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/documents/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:46508 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK
INFO:     172.17.0.1:46504 - "GET /ollama/api/version HTTP/1.1" 500 Internal Server Error
INFO:     172.17.0.1:46508 - "GET /ollama/api/tags HTTP/1.1" 500 Internal Server Error
INFO:     172.17.0.1:46508 - "GET /api/v1/chats/ HTTP/1.1" 200 OK
https://api.openai.com/v1/models
INFO:     172.17.0.1:46508 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized
INFO:     172.17.0.1:49436 - "GET /api/v1/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:49436 - "GET /api/v1/auths/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:49436 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:49436 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:49436 - "GET /api/v1/documents/ HTTP/1.1" 200 OK
INFO:     172.17.0.1:49436 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK
INFO:     172.17.0.1:49438 - "GET /ollama/api/version HTTP/1.1" 500 Internal Server Error
INFO:     172.17.0.1:49436 - "GET /ollama/api/tags HTTP/1.1" 500 Internal Server Error
INFO:     172.17.0.1:49436 - "GET /api/v1/chats/ HTTP/1.1" 200 OK
https://api.openai.com/v1/models
INFO:     172.17.0.1:49436 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized

image

Installation Method

Docker

Notes

I suspect differences in how networks are setup in Rancher Desktop and Docker Desktop.

Originally created by @ppasieka on GitHub (May 27, 2024). # Bug Report ## Description **Bug Summary:** I use RancherDesktop to run docker containers (it is the licensing thing, I can't switch to Docker Desktop). I can pull and start the container, but I can't connect to the Ollama server running on my host machine **Steps to Reproduce:** Follow installation steps from readme: ``` docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main ``` **Expected Behavior:** Can connect to ollama server, list installed models, trigger inference **Actual Behavior:** Error when starting the Open WebUI (see screenshot) ## Environment - **Open WebUI Version:** 0.1.125 - **Ollama (if applicable):** 0.1.38 - **Operating System:** [Windows 10] - **Browser (if applicable):** any browser ## Reproduction Details **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [x] I am on the latest version of both Open WebUI and Ollama. - [ ] I have included the browser console logs. - [ ] I have included the Docker container logs. ## Logs and Screenshots ``` Loading WEBUI_SECRET_KEY from .webui_secret_key INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) INFO: 172.17.0.1:53572 - "GET / HTTP/1.1" 200 OK INFO: 172.17.0.1:53572 - "GET /_app/immutable/entry/start.4d0d7042.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53576 - "GET /_app/immutable/chunks/scheduler.f6668761.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53572 - "GET /_app/immutable/chunks/singletons.105b85e5.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53588 - "GET /_app/immutable/chunks/index.afef706d.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53610 - "GET /_app/immutable/chunks/index.65c87b32.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53600 - "GET /_app/immutable/entry/app.62dc7e6b.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53600 - "GET /_app/immutable/nodes/0.9b2c9561.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53572 - "GET /_app/immutable/chunks/Toaster.svelte_svelte_type_style_lang.4f4e956a.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53610 - "GET /_app/immutable/chunks/constants.c3d2104f.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53588 - "GET /_app/immutable/chunks/navigation.6ed5731e.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53600 - "GET /_app/immutable/assets/Toaster.3a6d0da3.css HTTP/1.1" 200 OK INFO: 172.17.0.1:53612 - "GET /_app/immutable/chunks/index.c122cac0.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53576 - "GET /_app/immutable/chunks/each.2cd6bd47.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53572 - "GET /_app/immutable/assets/0.de36d200.css HTTP/1.1" 200 OK INFO: 172.17.0.1:53588 - "GET /_app/immutable/assets/2.c7820e19.css HTTP/1.1" 200 OK INFO: 172.17.0.1:53610 - "GET /_app/immutable/assets/index.8a27bb7e.css HTTP/1.1" 200 OK INFO: 172.17.0.1:53612 - "GET /_app/immutable/chunks/index.c4d7520e.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53600 - "GET /_app/immutable/nodes/1.acdc58d4.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53576 - "GET /_app/immutable/chunks/stores.46842bc6.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53572 - "GET /_app/immutable/nodes/2.7711eee9.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53588 - "GET /_app/immutable/chunks/FileSaver.min.898eb36f.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53610 - "GET /_app/immutable/chunks/_commonjsHelpers.de833af9.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53612 - "GET /_app/immutable/chunks/index.24d0f459.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53600 - "GET /_app/immutable/chunks/index.69f6ab4e.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53576 - "GET /_app/immutable/chunks/index.15f26e66.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53588 - "GET /_app/immutable/chunks/Modal.68c1a0a5.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53572 - "GET /_app/immutable/chunks/index.b7ffcff4.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53610 - "GET /_app/immutable/chunks/AdvancedParams.020cee97.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53612 - "GET /_app/immutable/chunks/index.94bf9275.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53600 - "GET /_app/immutable/chunks/index.3f5e7a6d.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53572 - "GET /_app/immutable/nodes/3.113d8beb.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53576 - "GET /_app/immutable/chunks/index.f3d17e4d.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53588 - "GET /_app/immutable/chunks/index.4987a420.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53612 - "GET /_app/immutable/chunks/Tags.4457bfcc.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53610 - "GET /_app/immutable/chunks/dayjs.min.1e504c00.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53600 - "GET /assets/fonts/Arimo-Variable.ttf HTTP/1.1" 200 OK INFO: 172.17.0.1:53588 - "GET /favicon.png HTTP/1.1" 200 OK INFO: 172.17.0.1:53614 - "GET /manifest.json HTTP/1.1" 200 OK INFO: 172.17.0.1:53612 - "GET /api/v1/ HTTP/1.1" 200 OK INFO: 172.17.0.1:53588 - "GET /themes/rosepine.css HTTP/1.1" 200 OK INFO: 172.17.0.1:53600 - "GET /themes/rosepine-dawn.css HTTP/1.1" 200 OK INFO: 172.17.0.1:53600 - "GET /_app/immutable/nodes/13.a8c7da85.js HTTP/1.1" 200 OK INFO: 172.17.0.1:53588 - "GET /_app/immutable/assets/13.e43bb62b.css HTTP/1.1" 200 OK INFO: 172.17.0.1:53588 - "GET /assets/fonts/Mona-Sans.woff2 HTTP/1.1" 200 OK insert_new_auth INFO: 172.17.0.1:46504 - "POST /api/v1/auths/signup HTTP/1.1" 200 OK INFO: 172.17.0.1:46504 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK INFO: 172.17.0.1:46504 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK INFO: 172.17.0.1:46504 - "GET /api/v1/documents/ HTTP/1.1" 200 OK INFO: 172.17.0.1:46504 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK INFO: 172.17.0.1:46504 - "GET /ollama/api/tags HTTP/1.1" 500 Internal Server Error INFO: 172.17.0.1:46508 - "GET /ollama/api/version HTTP/1.1" 500 Internal Server Error https://api.openai.com/v1/models INFO: 172.17.0.1:46508 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized INFO: 172.17.0.1:46504 - "GET /user.png HTTP/1.1" 200 OK INFO: 172.17.0.1:46508 - "GET /api/v1/chats/ HTTP/1.1" 200 OK INFO: 172.17.0.1:46508 - "GET /api/v1/ HTTP/1.1" 200 OK INFO: 172.17.0.1:46508 - "GET /api/v1/auths/ HTTP/1.1" 200 OK INFO: 172.17.0.1:46508 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK INFO: 172.17.0.1:46508 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK INFO: 172.17.0.1:46508 - "GET /api/v1/documents/ HTTP/1.1" 200 OK INFO: 172.17.0.1:46508 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK INFO: 172.17.0.1:46504 - "GET /ollama/api/version HTTP/1.1" 500 Internal Server Error INFO: 172.17.0.1:46508 - "GET /ollama/api/tags HTTP/1.1" 500 Internal Server Error INFO: 172.17.0.1:46508 - "GET /api/v1/chats/ HTTP/1.1" 200 OK https://api.openai.com/v1/models INFO: 172.17.0.1:46508 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized INFO: 172.17.0.1:49436 - "GET /api/v1/ HTTP/1.1" 200 OK INFO: 172.17.0.1:49436 - "GET /api/v1/auths/ HTTP/1.1" 200 OK INFO: 172.17.0.1:49436 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK INFO: 172.17.0.1:49436 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK INFO: 172.17.0.1:49436 - "GET /api/v1/documents/ HTTP/1.1" 200 OK INFO: 172.17.0.1:49436 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK INFO: 172.17.0.1:49438 - "GET /ollama/api/version HTTP/1.1" 500 Internal Server Error INFO: 172.17.0.1:49436 - "GET /ollama/api/tags HTTP/1.1" 500 Internal Server Error INFO: 172.17.0.1:49436 - "GET /api/v1/chats/ HTTP/1.1" 200 OK https://api.openai.com/v1/models INFO: 172.17.0.1:49436 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized ``` ![image](https://github.com/open-webui/open-webui/assets/2170707/d7ff3637-20f1-4157-a839-d343b386eb4f) ## Installation Method Docker ## Notes I suspect differences in how networks are setup in Rancher Desktop and Docker Desktop.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#1047