[GH-ISSUE #6549] Ollama v0.3.8 Restart Loop #4118

Closed
opened 2026-04-12 15:00:59 -05:00 by GiteaMirror · 14 comments
Owner

Originally created by @romayojr on GitHub (Aug 29, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6549

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

i haven't seen any reports on this yet so it may just be a me issue, but ollama v0.3.8 container will not run/start, it keeps restarting. no issues with ollama v0.3.7.

docker instance running on W11 WSL2 Ubuntu 24.04 lts using a docker compose file, it's running two services ollama and open webui.

updated ollama from 0.3.7 to 0.3.8 and encountered the issue. ran docker compose pull then docker compose up -d --force-recreate --remove orphans. docker ps showed open-webui container is up and running but ollama container status was showing restarting (139). docker logs -f ollama did not output/return any logs. ran docker compose down to stop and remove the containers. tagged the ollama image with :0.3.7 in my compose file, and everything works so i've reverted to this version for now.

$ docker compose pull
[+] Pulling 18/18
 ✔ open-webui Pulled                                                                                  38.5s
   ✔ e4fff0779e6d Already exists                                                                       0.0s
   ✔ d97016d0706d Already exists                                                                       0.0s
   ✔ 53db1713e5d9 Already exists                                                                       0.0s
   ✔ a8cd795d9ccb Already exists                                                                       0.0s
   ✔ de3ba92de392 Already exists                                                                       0.0s
   ✔ 6f4d87c224b0 Already exists                                                                       0.0s
   ✔ 4f4fb700ef54 Already exists                                                                       0.0s
   ✔ dd92a6022ddb Already exists                                                                       0.0s
   ✔ bbbfed48a772 Already exists                                                                       0.0s
   ✔ a825beebdb5b Already exists                                                                       0.0s
   ✔ fd0f6bc6022b Already exists                                                                       0.0s
   ✔ 4b10ca2c003a Pull complete                                                                       37.1s
   ✔ a3ad9497b5bd Pull complete                                                                       37.7s
   ✔ 51f9a5aab456 Pull complete                                                                       37.7s
   ✔ b2d0f2e14def Pull complete                                                                       37.7s
   ✔ de00304a38e7 Pull complete                                                                       37.9s
 ✔ ollama Pulled                                                                                       0.9s
$ docker compose up -d --force-recreate --remove-orphans
[+] Running 2/2
 ✔ Container ollama      Started                                                                       1.9s
 ✔ Container open-webui  Started                                                                       1.8s
 
$ docker ps
CONTAINER ID   IMAGE                                                     COMMAND                CREATED          STATUS                            PORTS                                         NAMES
53f27cb73df4   ghcr.io/open-webui/open-webui:main                        "bash start.sh"        55 seconds ago   Up 53 seconds (healthy)           0.0.0.0:3000->8080/tcp, [::]:3000->8080/tcp   open-webui
2cc6be2a66c6   ollama/ollama                                             "/bin/ollama serve"    55 seconds ago   Restarting (139) 21 seconds ago                                                 ollama
$ docker image ls
REPOSITORY                                   TAG            IMAGE ID       CREATED        SIZE
ollama/ollama                                latest         1c6909f41f16   21 hours ago   1.98GB
ghcr.io/open-webui/open-webui                main           0ddbc33aa5b0   24 hours ago   3.9GB

compose.yaml

services:
  ollama:
    image: ollama/ollama
    container_name: ollama
    ports:
      - "11434:11434"
    volumes:
      - /home/ollama:/root/.ollama
    restart: unless-stopped
    deploy:
      resources:
        reservations:
          devices:
            - capabilities: ["gpu"]

  open-webui:
    image: ghcr.io/open-webui/open-webui:main
    container_name: open-webui
    ports:
      - "3000:8080"
    environment:
      - "OLLAMA_API_BASE_URL=http://localhost:1143/api"
    extra_hosts:
      - "host.docker.internal:host-gateway"
    volumes:
      - open-webui:/app/backend/data
    networks:
      host: {}
    restart: unless-stopped

volumes:
  open-webui:
networks:
  host: {}

in case gpu info is needed
image

OS

WSL2

GPU

Nvidia

CPU

Intel

Ollama version

v0.3.8

Originally created by @romayojr on GitHub (Aug 29, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6549 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? i haven't seen any reports on this yet so it may just be a me issue, but ollama v0.3.8 container will not run/start, it keeps restarting. no issues with ollama v0.3.7. docker instance running on W11 WSL2 Ubuntu 24.04 lts using a docker compose file, it's running two services ollama and open webui. updated ollama from 0.3.7 to 0.3.8 and encountered the issue. ran `docker compose pull` then `docker compose up -d --force-recreate --remove orphans`. `docker ps` showed open-webui container is up and running but ollama container status was showing restarting (139). `docker logs -f ollama` did not output/return any logs. ran `docker compose down` to stop and remove the containers. tagged the ollama image with :0.3.7 in my compose file, and everything works so i've reverted to this version for now. ``` $ docker compose pull [+] Pulling 18/18 ✔ open-webui Pulled 38.5s ✔ e4fff0779e6d Already exists 0.0s ✔ d97016d0706d Already exists 0.0s ✔ 53db1713e5d9 Already exists 0.0s ✔ a8cd795d9ccb Already exists 0.0s ✔ de3ba92de392 Already exists 0.0s ✔ 6f4d87c224b0 Already exists 0.0s ✔ 4f4fb700ef54 Already exists 0.0s ✔ dd92a6022ddb Already exists 0.0s ✔ bbbfed48a772 Already exists 0.0s ✔ a825beebdb5b Already exists 0.0s ✔ fd0f6bc6022b Already exists 0.0s ✔ 4b10ca2c003a Pull complete 37.1s ✔ a3ad9497b5bd Pull complete 37.7s ✔ 51f9a5aab456 Pull complete 37.7s ✔ b2d0f2e14def Pull complete 37.7s ✔ de00304a38e7 Pull complete 37.9s ✔ ollama Pulled 0.9s ``` ``` $ docker compose up -d --force-recreate --remove-orphans [+] Running 2/2 ✔ Container ollama Started 1.9s ✔ Container open-webui Started 1.8s ``` ``` $ docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 53f27cb73df4 ghcr.io/open-webui/open-webui:main "bash start.sh" 55 seconds ago Up 53 seconds (healthy) 0.0.0.0:3000->8080/tcp, [::]:3000->8080/tcp open-webui 2cc6be2a66c6 ollama/ollama "/bin/ollama serve" 55 seconds ago Restarting (139) 21 seconds ago ollama ``` ``` $ docker image ls REPOSITORY TAG IMAGE ID CREATED SIZE ollama/ollama latest 1c6909f41f16 21 hours ago 1.98GB ghcr.io/open-webui/open-webui main 0ddbc33aa5b0 24 hours ago 3.9GB ``` compose.yaml ``` services: ollama: image: ollama/ollama container_name: ollama ports: - "11434:11434" volumes: - /home/ollama:/root/.ollama restart: unless-stopped deploy: resources: reservations: devices: - capabilities: ["gpu"] open-webui: image: ghcr.io/open-webui/open-webui:main container_name: open-webui ports: - "3000:8080" environment: - "OLLAMA_API_BASE_URL=http://localhost:1143/api" extra_hosts: - "host.docker.internal:host-gateway" volumes: - open-webui:/app/backend/data networks: host: {} restart: unless-stopped volumes: open-webui: networks: host: {} ``` in case gpu info is needed ![image](https://github.com/user-attachments/assets/523eb123-f2b5-4f7a-92ff-7f9d7b7313d4) ### OS WSL2 ### GPU Nvidia ### CPU Intel ### Ollama version v0.3.8
GiteaMirror added the dockernvidiabug labels 2026-04-12 15:00:59 -05:00
Author
Owner

@jmorganca commented on GitHub (Aug 29, 2024):

@romayojr sorry this happened. Would it be possible to share the logs? docker logs ollama

<!-- gh-comment-id:2316786689 --> @jmorganca commented on GitHub (Aug 29, 2024): @romayojr sorry this happened. Would it be possible to share the logs? `docker logs ollama`
Author
Owner

@romayojr commented on GitHub (Aug 29, 2024):

@jmorganca no worries. as i mentioned in my post, docker logs -f ollama is not returning any logs. is there another way to pull the logs?

<!-- gh-comment-id:2316792903 --> @romayojr commented on GitHub (Aug 29, 2024): @jmorganca no worries. as i mentioned in my post, `docker logs -f ollama` is not returning any logs. is there another way to pull the logs?
Author
Owner

@jmorganca commented on GitHub (Aug 29, 2024):

@romayojr try running it without -f, this will show previous logs. Thanks so much!

<!-- gh-comment-id:2316800394 --> @jmorganca commented on GitHub (Aug 29, 2024): @romayojr try running it without `-f`, this will show previous logs. Thanks so much!
Author
Owner

@romayojr commented on GitHub (Aug 29, 2024):

@jmorganca tried it without -f but same result, no output.

<!-- gh-comment-id:2316811567 --> @romayojr commented on GitHub (Aug 29, 2024): @jmorganca tried it without `-f` but same result, no output.
Author
Owner

@romayojr commented on GitHub (Aug 29, 2024):

@jmorganca ran it against v0.3.7 to show the command works

$ docker logs ollama
2024/08/29 06:15:13 routes.go:1125: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR: OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]"
time=2024-08-29T06:15:13.205Z level=INFO source=images.go:753 msg="total blobs: 10"
time=2024-08-29T06:15:13.206Z level=INFO source=images.go:760 msg="total unused blobs removed: 0"
time=2024-08-29T06:15:13.206Z level=INFO source=routes.go:1172 msg="Listening on [::]:11434 (version 0.3.7)"
time=2024-08-29T06:15:13.208Z level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama1888872819/runners
time=2024-08-29T06:15:20.116Z level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cuda_v12 rocm_v60102 cpu cpu_avx cpu_avx2 cuda_v11]"
time=2024-08-29T06:15:20.116Z level=INFO source=gpu.go:200 msg="looking for compatible GPUs"
time=2024-08-29T06:15:20.442Z level=INFO source=types.go:107 msg="inference compute" id=GPU-ab745421-90f6-2006-cf20-0229a6acd7bf library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" total="10.0 GiB" available="8.9 GiB"
[GIN] 2024/08/29 - 06:15:20 | 200 |     993.304µs |    172.29.240.1 | GET      "/api/tags"
[GIN] 2024/08/29 - 06:15:23 | 200 |     234.605µs |    172.29.240.1 | GET      "/api/tags"
<!-- gh-comment-id:2316817467 --> @romayojr commented on GitHub (Aug 29, 2024): @jmorganca ran it against v0.3.7 to show the command works ``` $ docker logs ollama 2024/08/29 06:15:13 routes.go:1125: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR: OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]" time=2024-08-29T06:15:13.205Z level=INFO source=images.go:753 msg="total blobs: 10" time=2024-08-29T06:15:13.206Z level=INFO source=images.go:760 msg="total unused blobs removed: 0" time=2024-08-29T06:15:13.206Z level=INFO source=routes.go:1172 msg="Listening on [::]:11434 (version 0.3.7)" time=2024-08-29T06:15:13.208Z level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama1888872819/runners time=2024-08-29T06:15:20.116Z level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cuda_v12 rocm_v60102 cpu cpu_avx cpu_avx2 cuda_v11]" time=2024-08-29T06:15:20.116Z level=INFO source=gpu.go:200 msg="looking for compatible GPUs" time=2024-08-29T06:15:20.442Z level=INFO source=types.go:107 msg="inference compute" id=GPU-ab745421-90f6-2006-cf20-0229a6acd7bf library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" total="10.0 GiB" available="8.9 GiB" [GIN] 2024/08/29 - 06:15:20 | 200 | 993.304µs | 172.29.240.1 | GET "/api/tags" [GIN] 2024/08/29 - 06:15:23 | 200 | 234.605µs | 172.29.240.1 | GET "/api/tags" ```
Author
Owner

@MaxJa4 commented on GitHub (Aug 29, 2024):

Maybe try docker compose up -d --force-recreate --remove-orphans && docker compose logs -f which will follow the output right after the start, up until the point it crashes.

<!-- gh-comment-id:2316909225 --> @MaxJa4 commented on GitHub (Aug 29, 2024): Maybe try `docker compose up -d --force-recreate --remove-orphans && docker compose logs -f` which will follow the output right after the start, up until the point it crashes.
Author
Owner

@romayojr commented on GitHub (Aug 29, 2024):

@MaxJa4 thank you.

@jmorganca it only returned with a single line of error for ollama. ollama exited with code 0. the rest of the logs is related to open-webui.

$ docker compose up -d --force-recreate --remove-orphans && docker compose logs -f
[+] Running 2/2
 ✔ Container ollama      Started                                                                                                                                                                                     1.7s
 ✔ Container open-webui  Started                                                                                                                                                                                     1.5s
open-webui  | Loading WEBUI_SECRET_KEY from file, not provided as an environment variable.
open-webui  | Generating WEBUI_SECRET_KEY
open-webui  | Loading WEBUI_SECRET_KEY from .webui_secret_key
ollama exited with code 0
open-webui  | /app
open-webui  | Running migrations
open-webui  | INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
open-webui  | INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
open-webui  | INFO  [env] 'ENABLE_OLLAMA_API' loaded from the latest database entry
open-webui  | INFO  [env] 'OLLAMA_BASE_URLS' loaded from the latest database entry
open-webui  | INFO  [env] 'ENABLE_OPENAI_API' loaded from the latest database entry
open-webui  | INFO  [env] 'OPENAI_API_KEYS' loaded from the latest database entry
open-webui  | INFO  [env] 'OPENAI_API_BASE_URLS' loaded from the latest database entry
open-webui  | INFO  [env] 'DEFAULT_LOCALE' loaded from the latest database entry
open-webui  | INFO  [env] 'DEFAULT_PROMPT_SUGGESTIONS' loaded from the latest database entry
open-webui  | WARNI [env]
open-webui  |
open-webui  | WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS.
open-webui  |
open-webui  | INFO  [env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry
open-webui  | INFO  [env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2
open-webui  | INFO  [env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry
open-webui  | INFO  [env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry
open-webui  | INFO  [env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry
open-webui  | INFO  [env] 'SEARXNG_QUERY_URL' loaded from the latest database entry
open-webui  | INFO  [env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry
open-webui  | INFO  [env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'SERPSTACK_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'SERPSTACK_HTTPS' loaded from the latest database entry
open-webui  | INFO  [env] 'SERPER_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'SERPLY_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'TAVILY_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry
open-webui  | INFO  [env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry
open-webui  | INFO  [env] 'IMAGE_GENERATION_ENGINE' loaded from the latest database entry
open-webui  | INFO  [env] 'ENABLE_IMAGE_GENERATION' loaded from the latest database entry
open-webui  | INFO  [env] 'IMAGE_SIZE' loaded from the latest database entry
open-webui  | INFO  [env] 'IMAGE_STEPS' loaded from the latest database entry
open-webui  | INFO  [env] 'IMAGE_GENERATION_MODEL' loaded from the latest database entry
open-webui  | INFO  [apps.audio.main] whisper_device_type: cpu
open-webui  | WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests.
open-webui  | /usr/local/lib/python3.11/site-packages/transformers/tokenization_utils_base.py:1601: FutureWarning: `clean_up_tokenization_spaces` was not set. It will be set to `True` by default. This behavior will be depracted in transformers v4.45, and will be then set to `False` by default. For more details check this issue: https://github.com/huggingface/transformers/issues/31884
open-webui  |   warnings.warn(
open-webui  | INFO:     Started server process [1]
open-webui  | INFO:     Waiting for application startup.
open-webui  | INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
open-webui  | INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
open-webui  | INFO:     Application startup complete.
open-webui  | INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  |
open-webui  |   ___                    __        __   _     _   _ ___
open-webui  |  / _ \ _ __   ___ _ __   \ \      / /__| |__ | | | |_ _|
open-webui  | | | | | '_ \ / _ \ '_ \   \ \ /\ / / _ \ '_ \| | | || |
open-webui  | | |_| | |_) |  __/ | | |   \ V  V /  __/ |_) | |_| || |
open-webui  |  \___/| .__/ \___|_| |_|    \_/\_/ \___|_.__/ \___/|___|
open-webui  |       |_|
open-webui  |
open-webui  |
open-webui  | v0.3.16 - building the best open-source AI user interface.
open-webui  |
open-webui  | https://github.com/open-webui/open-webui
open-webui  |
open-webui  | Running migrations
open-webui  | INFO:     10.0.0.101:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6T5jOP HTTP/1.1" 200 OK
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | INFO:     ('10.0.0.101', 0) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=x1Oc9cveiZOPWjeyAAAA" [accepted]
open-webui  | INFO:     connection open
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | INFO:     10.0.0.114:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6T5l5B HTTP/1.1" 200 OK
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | INFO:     ('10.0.0.114', 0) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=ANmIAmkwvAfyqw-6AAAB" [accepted]
open-webui  | INFO:     connection open
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | INFO:     10.0.0.101:0 - "POST /ws/socket.io/?EIO=4&transport=polling&t=P6T5lMF&sid=x1Oc9cveiZOPWjeyAAAA HTTP/1.1" 200 OK
open-webui  | INFO:     10.0.0.101:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6T5lMG&sid=x1Oc9cveiZOPWjeyAAAA HTTP/1.1" 200 OK
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | INFO:     10.0.0.114:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6T5mLz&sid=ANmIAmkwvAfyqw-6AAAB HTTP/1.1" 200 OK
open-webui  | INFO:     10.0.0.114:0 - "POST /ws/socket.io/?EIO=4&transport=polling&t=P6T5mLx&sid=ANmIAmkwvAfyqw-6AAAB HTTP/1.1" 200 OK
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | INFO:     connection closed
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | ERROR:    Exception in ASGI application
open-webui  |   + Exception Group Traceback (most recent call last):
open-webui  |   |   File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 87, in collapse_excgroups
open-webui  |   |     yield
open-webui  |   |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 190, in __call__
open-webui  |   |     async with anyio.create_task_group() as task_group:
open-webui  |   |   File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 680, in __aexit__
open-webui  |   |     raise BaseExceptionGroup(
open-webui  |   | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
open-webui  |   +-+---------------- 1 ----------------
open-webui  |     | Traceback (most recent call last):
open-webui  |     |   File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
open-webui  |     |     result = await app(  # type: ignore[func-returns-value]
open-webui  |     |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |     |   File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in __call__
open-webui  |     |     return await self.app(scope, receive, send)
open-webui  |     |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |     |   File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in __call__
open-webui  |     |     await super().__call__(scope, receive, send)
open-webui  |     |   File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in __call__
open-webui  |     |     await self.middleware_stack(scope, receive, send)
open-webui  |     |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in __call__
open-webui  |     |     raise exc
open-webui  |     |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in __call__
open-webui  |     |     await self.app(scope, receive, _send)
open-webui  |     |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__
open-webui  |     |     with collapse_excgroups():
open-webui  |     |   File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__
open-webui  |     |     self.gen.throw(typ, value, traceback)
open-webui  |     |   File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui  |     |     raise exc
open-webui  |     |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__
open-webui  |     |     response = await self.dispatch_func(request, call_next)
open-webui  |     |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |     |   File "/app/backend/main.py", line 790, in update_embedding_function
open-webui  |     |     response = await call_next(request)
open-webui  |     |                ^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |     |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 166, in call_next
open-webui  |     |     raise RuntimeError("No response returned.")
open-webui  |     | RuntimeError: No response returned.
open-webui  |     +------------------------------------
open-webui  | During handling of the above exception, another exception occurred:
open-webui  |
open-webui  | Traceback (most recent call last):
open-webui  |   File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
open-webui  |     result = await app(  # type: ignore[func-returns-value]
open-webui  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in __call__
open-webui  |     return await self.app(scope, receive, send)
open-webui  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in __call__
open-webui  |     await super().__call__(scope, receive, send)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in __call__
open-webui  |     await self.middleware_stack(scope, receive, send)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in __call__
open-webui  |     raise exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in __call__
open-webui  |     await self.app(scope, receive, _send)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__
open-webui  |     with collapse_excgroups():
open-webui  |   File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__
open-webui  |     self.gen.throw(typ, value, traceback)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui  |     raise exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__
open-webui  |     response = await self.dispatch_func(request, call_next)
open-webui  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/app/backend/main.py", line 790, in update_embedding_function
open-webui  |     response = await call_next(request)
open-webui  |                ^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next
open-webui  |     raise app_exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
open-webui  |     await self.app(scope, receive_or_disconnect, send_no_error)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__
open-webui  |     with collapse_excgroups():
open-webui  |   File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__
open-webui  |     self.gen.throw(typ, value, traceback)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui  |     raise exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__
open-webui  |     response = await self.dispatch_func(request, call_next)
open-webui  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/app/backend/main.py", line 781, in check_url
open-webui  |     response = await call_next(request)
open-webui  |                ^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next
open-webui  |     raise app_exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
open-webui  |     await self.app(scope, receive_or_disconnect, send_no_error)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__
open-webui  |     with collapse_excgroups():
open-webui  |   File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__
open-webui  |     self.gen.throw(typ, value, traceback)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui  |     raise exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__
open-webui  |     response = await self.dispatch_func(request, call_next)
open-webui  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/app/backend/main.py", line 767, in commit_session_after_request
open-webui  |     response = await call_next(request)
open-webui  |                ^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next
open-webui  |     raise app_exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
open-webui  |     await self.app(scope, receive_or_disconnect, send_no_error)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 85, in __call__
open-webui  |     await self.app(scope, receive, send)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__
open-webui  |     with collapse_excgroups():
open-webui  |   File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__
open-webui  |     self.gen.throw(typ, value, traceback)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui  |     raise exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__
open-webui  |     response = await self.dispatch_func(request, call_next)
open-webui  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/app/backend/main.py", line 713, in dispatch
open-webui  |     return await call_next(request)
open-webui  |            ^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next
open-webui  |     raise app_exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
open-webui  |     await self.app(scope, receive_or_disconnect, send_no_error)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__
open-webui  |     with collapse_excgroups():
open-webui  |   File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__
open-webui  |     self.gen.throw(typ, value, traceback)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
open-webui  |     raise exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__
open-webui  |     response = await self.dispatch_func(request, call_next)
open-webui  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/app/backend/main.py", line 507, in dispatch
open-webui  |     return await call_next(request)
open-webui  |            ^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next
open-webui  |     raise app_exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
open-webui  |     await self.app(scope, receive_or_disconnect, send_no_error)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in __call__
open-webui  |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
open-webui  |     raise exc
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
open-webui  |     await app(scope, receive, sender)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in __call__
open-webui  |     await self.middleware_stack(scope, receive, send)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app
open-webui  |     await route.handle(scope, receive, send)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle
open-webui  |     await self.app(scope, receive, send)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/engineio/async_drivers/asgi.py", line 67, in __call__
open-webui  |     await self.engineio_server.handle_request(scope, receive, send)
open-webui  |   File "/usr/local/lib/python3.11/site-packages/socketio/async_server.py", line 451, in handle_request
open-webui  |     return await self.eio.handle_request(*args, **kwargs)
open-webui  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui  |   File "/usr/local/lib/python3.11/site-packages/engineio/async_server.py", line 229, in handle_request
open-webui  |     method = environ['REQUEST_METHOD']
open-webui  |              ~~~~~~~^^^^^^^^^^^^^^^^^^
open-webui  | KeyError: 'REQUEST_METHOD'
<!-- gh-comment-id:2316975788 --> @romayojr commented on GitHub (Aug 29, 2024): @MaxJa4 thank you. @jmorganca it only returned with a single line of error for ollama. `ollama exited with code 0`. the rest of the logs is related to open-webui. ``` $ docker compose up -d --force-recreate --remove-orphans && docker compose logs -f [+] Running 2/2 ✔ Container ollama Started 1.7s ✔ Container open-webui Started 1.5s open-webui | Loading WEBUI_SECRET_KEY from file, not provided as an environment variable. open-webui | Generating WEBUI_SECRET_KEY open-webui | Loading WEBUI_SECRET_KEY from .webui_secret_key ollama exited with code 0 open-webui | /app open-webui | Running migrations open-webui | INFO [alembic.runtime.migration] Context impl SQLiteImpl. open-webui | INFO [alembic.runtime.migration] Will assume non-transactional DDL. open-webui | INFO [env] 'ENABLE_OLLAMA_API' loaded from the latest database entry open-webui | INFO [env] 'OLLAMA_BASE_URLS' loaded from the latest database entry open-webui | INFO [env] 'ENABLE_OPENAI_API' loaded from the latest database entry open-webui | INFO [env] 'OPENAI_API_KEYS' loaded from the latest database entry open-webui | INFO [env] 'OPENAI_API_BASE_URLS' loaded from the latest database entry open-webui | INFO [env] 'DEFAULT_LOCALE' loaded from the latest database entry open-webui | INFO [env] 'DEFAULT_PROMPT_SUGGESTIONS' loaded from the latest database entry open-webui | WARNI [env] open-webui | open-webui | WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS. open-webui | open-webui | INFO [env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry open-webui | INFO [env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2 open-webui | INFO [env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry open-webui | INFO [env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry open-webui | INFO [env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry open-webui | INFO [env] 'SEARXNG_QUERY_URL' loaded from the latest database entry open-webui | INFO [env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry open-webui | INFO [env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'SERPSTACK_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'SERPSTACK_HTTPS' loaded from the latest database entry open-webui | INFO [env] 'SERPER_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'SERPLY_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'TAVILY_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry open-webui | INFO [env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry open-webui | INFO [env] 'IMAGE_GENERATION_ENGINE' loaded from the latest database entry open-webui | INFO [env] 'ENABLE_IMAGE_GENERATION' loaded from the latest database entry open-webui | INFO [env] 'IMAGE_SIZE' loaded from the latest database entry open-webui | INFO [env] 'IMAGE_STEPS' loaded from the latest database entry open-webui | INFO [env] 'IMAGE_GENERATION_MODEL' loaded from the latest database entry open-webui | INFO [apps.audio.main] whisper_device_type: cpu open-webui | WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests. open-webui | /usr/local/lib/python3.11/site-packages/transformers/tokenization_utils_base.py:1601: FutureWarning: `clean_up_tokenization_spaces` was not set. It will be set to `True` by default. This behavior will be depracted in transformers v4.45, and will be then set to `False` by default. For more details check this issue: https://github.com/huggingface/transformers/issues/31884 open-webui | warnings.warn( open-webui | INFO: Started server process [1] open-webui | INFO: Waiting for application startup. open-webui | INFO [alembic.runtime.migration] Context impl SQLiteImpl. open-webui | INFO [alembic.runtime.migration] Will assume non-transactional DDL. open-webui | INFO: Application startup complete. open-webui | INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | ERROR [apps.ollama.main] Connection error: open-webui | open-webui | ___ __ __ _ _ _ ___ open-webui | / _ \ _ __ ___ _ __ \ \ / /__| |__ | | | |_ _| open-webui | | | | | '_ \ / _ \ '_ \ \ \ /\ / / _ \ '_ \| | | || | open-webui | | |_| | |_) | __/ | | | \ V V / __/ |_) | |_| || | open-webui | \___/| .__/ \___|_| |_| \_/\_/ \___|_.__/ \___/|___| open-webui | |_| open-webui | open-webui | open-webui | v0.3.16 - building the best open-source AI user interface. open-webui | open-webui | https://github.com/open-webui/open-webui open-webui | open-webui | Running migrations open-webui | INFO: 10.0.0.101:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6T5jOP HTTP/1.1" 200 OK open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | INFO: ('10.0.0.101', 0) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=x1Oc9cveiZOPWjeyAAAA" [accepted] open-webui | INFO: connection open open-webui | ERROR [apps.ollama.main] Connection error: open-webui | INFO: 10.0.0.114:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6T5l5B HTTP/1.1" 200 OK open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | INFO: ('10.0.0.114', 0) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=ANmIAmkwvAfyqw-6AAAB" [accepted] open-webui | INFO: connection open open-webui | ERROR [apps.ollama.main] Connection error: open-webui | ERROR [apps.ollama.main] Connection error: open-webui | INFO: 10.0.0.101:0 - "POST /ws/socket.io/?EIO=4&transport=polling&t=P6T5lMF&sid=x1Oc9cveiZOPWjeyAAAA HTTP/1.1" 200 OK open-webui | INFO: 10.0.0.101:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6T5lMG&sid=x1Oc9cveiZOPWjeyAAAA HTTP/1.1" 200 OK open-webui | ERROR [apps.ollama.main] Connection error: open-webui | ERROR [apps.ollama.main] Connection error: open-webui | INFO: 10.0.0.114:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6T5mLz&sid=ANmIAmkwvAfyqw-6AAAB HTTP/1.1" 200 OK open-webui | INFO: 10.0.0.114:0 - "POST /ws/socket.io/?EIO=4&transport=polling&t=P6T5mLx&sid=ANmIAmkwvAfyqw-6AAAB HTTP/1.1" 200 OK open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | ERROR [apps.ollama.main] Connection error: open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | ERROR [apps.ollama.main] Connection error: open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | INFO: connection closed open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | ERROR [apps.ollama.main] Connection error: open-webui | ERROR [apps.ollama.main] Connection error: open-webui | ERROR: Exception in ASGI application open-webui | + Exception Group Traceback (most recent call last): open-webui | | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 87, in collapse_excgroups open-webui | | yield open-webui | | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 190, in __call__ open-webui | | async with anyio.create_task_group() as task_group: open-webui | | File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 680, in __aexit__ open-webui | | raise BaseExceptionGroup( open-webui | | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception) open-webui | +-+---------------- 1 ---------------- open-webui | | Traceback (most recent call last): open-webui | | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi open-webui | | result = await app( # type: ignore[func-returns-value] open-webui | | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | | File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in __call__ open-webui | | return await self.app(scope, receive, send) open-webui | | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in __call__ open-webui | | await super().__call__(scope, receive, send) open-webui | | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in __call__ open-webui | | await self.middleware_stack(scope, receive, send) open-webui | | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in __call__ open-webui | | raise exc open-webui | | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in __call__ open-webui | | await self.app(scope, receive, _send) open-webui | | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__ open-webui | | with collapse_excgroups(): open-webui | | File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__ open-webui | | self.gen.throw(typ, value, traceback) open-webui | | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups open-webui | | raise exc open-webui | | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__ open-webui | | response = await self.dispatch_func(request, call_next) open-webui | | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | | File "/app/backend/main.py", line 790, in update_embedding_function open-webui | | response = await call_next(request) open-webui | | ^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 166, in call_next open-webui | | raise RuntimeError("No response returned.") open-webui | | RuntimeError: No response returned. open-webui | +------------------------------------ open-webui | During handling of the above exception, another exception occurred: open-webui | open-webui | Traceback (most recent call last): open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi open-webui | result = await app( # type: ignore[func-returns-value] open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in __call__ open-webui | return await self.app(scope, receive, send) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in __call__ open-webui | await super().__call__(scope, receive, send) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in __call__ open-webui | await self.middleware_stack(scope, receive, send) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in __call__ open-webui | raise exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in __call__ open-webui | await self.app(scope, receive, _send) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__ open-webui | with collapse_excgroups(): open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__ open-webui | self.gen.throw(typ, value, traceback) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups open-webui | raise exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__ open-webui | response = await self.dispatch_func(request, call_next) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/app/backend/main.py", line 790, in update_embedding_function open-webui | response = await call_next(request) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next open-webui | raise app_exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro open-webui | await self.app(scope, receive_or_disconnect, send_no_error) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__ open-webui | with collapse_excgroups(): open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__ open-webui | self.gen.throw(typ, value, traceback) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups open-webui | raise exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__ open-webui | response = await self.dispatch_func(request, call_next) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/app/backend/main.py", line 781, in check_url open-webui | response = await call_next(request) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next open-webui | raise app_exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro open-webui | await self.app(scope, receive_or_disconnect, send_no_error) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__ open-webui | with collapse_excgroups(): open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__ open-webui | self.gen.throw(typ, value, traceback) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups open-webui | raise exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__ open-webui | response = await self.dispatch_func(request, call_next) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/app/backend/main.py", line 767, in commit_session_after_request open-webui | response = await call_next(request) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next open-webui | raise app_exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro open-webui | await self.app(scope, receive_or_disconnect, send_no_error) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 85, in __call__ open-webui | await self.app(scope, receive, send) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__ open-webui | with collapse_excgroups(): open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__ open-webui | self.gen.throw(typ, value, traceback) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups open-webui | raise exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__ open-webui | response = await self.dispatch_func(request, call_next) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/app/backend/main.py", line 713, in dispatch open-webui | return await call_next(request) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next open-webui | raise app_exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro open-webui | await self.app(scope, receive_or_disconnect, send_no_error) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in __call__ open-webui | with collapse_excgroups(): open-webui | File "/usr/local/lib/python3.11/contextlib.py", line 158, in __exit__ open-webui | self.gen.throw(typ, value, traceback) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups open-webui | raise exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in __call__ open-webui | response = await self.dispatch_func(request, call_next) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/app/backend/main.py", line 507, in dispatch open-webui | return await call_next(request) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next open-webui | raise app_exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro open-webui | await self.app(scope, receive_or_disconnect, send_no_error) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in __call__ open-webui | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app open-webui | raise exc open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app open-webui | await app(scope, receive, sender) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 756, in __call__ open-webui | await self.middleware_stack(scope, receive, send) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 776, in app open-webui | await route.handle(scope, receive, send) open-webui | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 485, in handle open-webui | await self.app(scope, receive, send) open-webui | File "/usr/local/lib/python3.11/site-packages/engineio/async_drivers/asgi.py", line 67, in __call__ open-webui | await self.engineio_server.handle_request(scope, receive, send) open-webui | File "/usr/local/lib/python3.11/site-packages/socketio/async_server.py", line 451, in handle_request open-webui | return await self.eio.handle_request(*args, **kwargs) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/engineio/async_server.py", line 229, in handle_request open-webui | method = environ['REQUEST_METHOD'] open-webui | ~~~~~~~^^^^^^^^^^^^^^^^^^ open-webui | KeyError: 'REQUEST_METHOD' ```
Author
Owner

@igorschlum commented on GitHub (Aug 29, 2024):

Hi @romayojr can you try with anther tool than OpenWebUI? You can try Msty. Or run with CLI and see if Ollama keeps restarting?

<!-- gh-comment-id:2318891020 --> @igorschlum commented on GitHub (Aug 29, 2024): Hi @romayojr can you try with anther tool than OpenWebUI? You can try Msty. Or run with CLI and see if Ollama keeps restarting?
Author
Owner

@MaxJa4 commented on GitHub (Aug 29, 2024):

It is also possible, that Ollama starts faster than Open-Webui, resulting in a delayed execution of the log command, hence just one line of information for Ollama.
Running only your earlier "up" command again, but this time without the "-d" should print your output directly to your console, hopefully catching more information.

docker compose up --force-recreate --remove-orphans

Also, try to add OLLAMA_DEBUG=1 to the environment for the Ollama Container, to show more info in the logs.

<!-- gh-comment-id:2319063142 --> @MaxJa4 commented on GitHub (Aug 29, 2024): It is also possible, that Ollama starts faster than Open-Webui, resulting in a delayed execution of the log command, hence just one line of information for Ollama. Running only your earlier "up" command again, but this time without the "-d" should print your output directly to your console, hopefully catching more information. `docker compose up --force-recreate --remove-orphans` Also, try to add `OLLAMA_DEBUG=1` to the environment for the Ollama Container, to show more info in the logs.
Author
Owner

@romayojr commented on GitHub (Aug 30, 2024):

@MaxJa4 added the environment variable to my ollama container and omitted -d from up command but same result error ollama exited with code 0

shorten version of compose.yaml

services:
  ollama:
    image: ollama/ollama
    container_name: ollama
    ports:
      - "11434:11434"
    volumes:
      - /home/ollama:/root/.ollama
    restart: unless-stopped
    environment:
      - OLLAMA_DEBUG=1

logs:

$ docker compose up --force-recreate --remove-orphans
[+] Running 2/2
 ✔ Container open-webui  Recreated                                                                                                                                                                                   2.4s
 ✔ Container ollama      Recreated                                                                                                                                                                                   0.7s
Attaching to ollama, open-webui
open-webui  | Loading WEBUI_SECRET_KEY from file, not provided as an environment variable.
open-webui  | Generating WEBUI_SECRET_KEY
open-webui  | Loading WEBUI_SECRET_KEY from .webui_secret_key
ollama exited with code 0
open-webui  | /app
open-webui  | Running migrations
open-webui  | INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
open-webui  | INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
open-webui  | INFO  [env] 'ENABLE_OLLAMA_API' loaded from the latest database entry
open-webui  | INFO  [env] 'OLLAMA_BASE_URLS' loaded from the latest database entry
open-webui  | INFO  [env] 'ENABLE_OPENAI_API' loaded from the latest database entry
open-webui  | INFO  [env] 'OPENAI_API_KEYS' loaded from the latest database entry
open-webui  | INFO  [env] 'OPENAI_API_BASE_URLS' loaded from the latest database entry
open-webui  | INFO  [env] 'DEFAULT_LOCALE' loaded from the latest database entry
open-webui  | INFO  [env] 'DEFAULT_PROMPT_SUGGESTIONS' loaded from the latest database entry
open-webui  | WARNI [env]
open-webui  |
open-webui  | WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS.
open-webui  |
open-webui  | INFO  [env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry
open-webui  | INFO  [env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2
open-webui  | INFO  [env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry
open-webui  | INFO  [env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry
open-webui  | INFO  [env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry
open-webui  | INFO  [env] 'SEARXNG_QUERY_URL' loaded from the latest database entry
open-webui  | INFO  [env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry
open-webui  | INFO  [env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'SERPSTACK_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'SERPSTACK_HTTPS' loaded from the latest database entry
open-webui  | INFO  [env] 'SERPER_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'SERPLY_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'TAVILY_API_KEY' loaded from the latest database entry
open-webui  | INFO  [env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry
open-webui  | INFO  [env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry
open-webui  | INFO  [env] 'IMAGE_GENERATION_ENGINE' loaded from the latest database entry
open-webui  | INFO  [env] 'ENABLE_IMAGE_GENERATION' loaded from the latest database entry
open-webui  | INFO  [env] 'IMAGE_SIZE' loaded from the latest database entry
open-webui  | INFO  [env] 'IMAGE_STEPS' loaded from the latest database entry
open-webui  | INFO  [env] 'IMAGE_GENERATION_MODEL' loaded from the latest database entry
open-webui  | INFO  [apps.audio.main] whisper_device_type: cpu
open-webui  | WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests.
open-webui  | /usr/local/lib/python3.11/site-packages/transformers/tokenization_utils_base.py:1601: FutureWarning: `clean_up_tokenization_spaces` was not set. It will be set to `True` by default. This behavior will be depracted in transformers v4.45, and will be then set to `False` by default. For more details check this issue: https://github.com/huggingface/transformers/issues/31884
open-webui  |   warnings.warn(
open-webui  | INFO:     Started server process [1]
open-webui  | INFO:     Waiting for application startup.
open-webui  | INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
open-webui  | INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
open-webui  | INFO:     Application startup complete.
open-webui  | INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  |
open-webui  |   ___                    __        __   _     _   _ ___
open-webui  |  / _ \ _ __   ___ _ __   \ \      / /__| |__ | | | |_ _|
open-webui  | | | | | '_ \ / _ \ '_ \   \ \ /\ / / _ \ '_ \| | | || |
open-webui  | | |_| | |_) |  __/ | | |   \ V  V /  __/ |_) | |_| || |
open-webui  |  \___/| .__/ \___|_| |_|    \_/\_/ \___|_.__/ \___/|___|
open-webui  |       |_|
open-webui  |
open-webui  |
open-webui  | v0.3.16 - building the best open-source AI user interface.
open-webui  |
open-webui  | https://github.com/open-webui/open-webui
open-webui  |
open-webui  | Running migrations
open-webui  | INFO:     10.0.0.114:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6ZhOsZ HTTP/1.1" 200 OK
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | INFO:     ('10.0.0.114', 0) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=XpW_5TE8XTOSDR90AAAA" [accepted]
open-webui  | INFO:     connection open
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | ERROR [apps.ollama.main] Connection error:
open-webui  | INFO:     10.0.0.114:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6ZhQFE&sid=XpW_5TE8XTOSDR90AAAA HTTP/1.1" 200 OK
open-webui  | INFO:     10.0.0.114:0 - "POST /ws/socket.io/?EIO=4&transport=polling&t=P6ZhQFD&sid=XpW_5TE8XTOSDR90AAAA HTTP/1.1" 200 OK
open-webui  | INFO  [apps.openai.main] get_all_models()
open-webui  | INFO  [apps.ollama.main] get_all_models()
open-webui  | ERROR [apps.ollama.main] Connection error:
<!-- gh-comment-id:2321506894 --> @romayojr commented on GitHub (Aug 30, 2024): @MaxJa4 added the environment variable to my ollama container and omitted `-d` from `up` command but same result error `ollama exited with code 0` shorten version of compose.yaml ``` services: ollama: image: ollama/ollama container_name: ollama ports: - "11434:11434" volumes: - /home/ollama:/root/.ollama restart: unless-stopped environment: - OLLAMA_DEBUG=1 ``` logs: ``` $ docker compose up --force-recreate --remove-orphans [+] Running 2/2 ✔ Container open-webui Recreated 2.4s ✔ Container ollama Recreated 0.7s Attaching to ollama, open-webui open-webui | Loading WEBUI_SECRET_KEY from file, not provided as an environment variable. open-webui | Generating WEBUI_SECRET_KEY open-webui | Loading WEBUI_SECRET_KEY from .webui_secret_key ollama exited with code 0 open-webui | /app open-webui | Running migrations open-webui | INFO [alembic.runtime.migration] Context impl SQLiteImpl. open-webui | INFO [alembic.runtime.migration] Will assume non-transactional DDL. open-webui | INFO [env] 'ENABLE_OLLAMA_API' loaded from the latest database entry open-webui | INFO [env] 'OLLAMA_BASE_URLS' loaded from the latest database entry open-webui | INFO [env] 'ENABLE_OPENAI_API' loaded from the latest database entry open-webui | INFO [env] 'OPENAI_API_KEYS' loaded from the latest database entry open-webui | INFO [env] 'OPENAI_API_BASE_URLS' loaded from the latest database entry open-webui | INFO [env] 'DEFAULT_LOCALE' loaded from the latest database entry open-webui | INFO [env] 'DEFAULT_PROMPT_SUGGESTIONS' loaded from the latest database entry open-webui | WARNI [env] open-webui | open-webui | WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS. open-webui | open-webui | INFO [env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry open-webui | INFO [env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2 open-webui | INFO [env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry open-webui | INFO [env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry open-webui | INFO [env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry open-webui | INFO [env] 'SEARXNG_QUERY_URL' loaded from the latest database entry open-webui | INFO [env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry open-webui | INFO [env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'SERPSTACK_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'SERPSTACK_HTTPS' loaded from the latest database entry open-webui | INFO [env] 'SERPER_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'SERPLY_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'TAVILY_API_KEY' loaded from the latest database entry open-webui | INFO [env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry open-webui | INFO [env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry open-webui | INFO [env] 'IMAGE_GENERATION_ENGINE' loaded from the latest database entry open-webui | INFO [env] 'ENABLE_IMAGE_GENERATION' loaded from the latest database entry open-webui | INFO [env] 'IMAGE_SIZE' loaded from the latest database entry open-webui | INFO [env] 'IMAGE_STEPS' loaded from the latest database entry open-webui | INFO [env] 'IMAGE_GENERATION_MODEL' loaded from the latest database entry open-webui | INFO [apps.audio.main] whisper_device_type: cpu open-webui | WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests. open-webui | /usr/local/lib/python3.11/site-packages/transformers/tokenization_utils_base.py:1601: FutureWarning: `clean_up_tokenization_spaces` was not set. It will be set to `True` by default. This behavior will be depracted in transformers v4.45, and will be then set to `False` by default. For more details check this issue: https://github.com/huggingface/transformers/issues/31884 open-webui | warnings.warn( open-webui | INFO: Started server process [1] open-webui | INFO: Waiting for application startup. open-webui | INFO [alembic.runtime.migration] Context impl SQLiteImpl. open-webui | INFO [alembic.runtime.migration] Will assume non-transactional DDL. open-webui | INFO: Application startup complete. open-webui | INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | ERROR [apps.ollama.main] Connection error: open-webui | open-webui | ___ __ __ _ _ _ ___ open-webui | / _ \ _ __ ___ _ __ \ \ / /__| |__ | | | |_ _| open-webui | | | | | '_ \ / _ \ '_ \ \ \ /\ / / _ \ '_ \| | | || | open-webui | | |_| | |_) | __/ | | | \ V V / __/ |_) | |_| || | open-webui | \___/| .__/ \___|_| |_| \_/\_/ \___|_.__/ \___/|___| open-webui | |_| open-webui | open-webui | open-webui | v0.3.16 - building the best open-source AI user interface. open-webui | open-webui | https://github.com/open-webui/open-webui open-webui | open-webui | Running migrations open-webui | INFO: 10.0.0.114:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6ZhOsZ HTTP/1.1" 200 OK open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | INFO: ('10.0.0.114', 0) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=XpW_5TE8XTOSDR90AAAA" [accepted] open-webui | INFO: connection open open-webui | ERROR [apps.ollama.main] Connection error: open-webui | ERROR [apps.ollama.main] Connection error: open-webui | INFO: 10.0.0.114:0 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P6ZhQFE&sid=XpW_5TE8XTOSDR90AAAA HTTP/1.1" 200 OK open-webui | INFO: 10.0.0.114:0 - "POST /ws/socket.io/?EIO=4&transport=polling&t=P6ZhQFD&sid=XpW_5TE8XTOSDR90AAAA HTTP/1.1" 200 OK open-webui | INFO [apps.openai.main] get_all_models() open-webui | INFO [apps.ollama.main] get_all_models() open-webui | ERROR [apps.ollama.main] Connection error: ```
Author
Owner

@MaxJa4 commented on GitHub (Aug 30, 2024):

If you remove the volume mount, does it work then? If there is already something present on the host-side of the mount, it can cause issues as things might get overwritten inside the container, leading to the crash.

<!-- gh-comment-id:2321937316 --> @MaxJa4 commented on GitHub (Aug 30, 2024): If you remove the volume mount, does it work then? If there is already something present on the host-side of the mount, it can cause issues as things might get overwritten inside the container, leading to the crash.
Author
Owner

@romayojr commented on GitHub (Aug 30, 2024):

i mapped it to a different volume mount but no change.

    volumes:
      - /home/ollama_test:/root/.ollama
<!-- gh-comment-id:2321975618 --> @romayojr commented on GitHub (Aug 30, 2024): i mapped it to a different volume mount but no change. ``` volumes: - /home/ollama_test:/root/.ollama ```
Author
Owner

@dhiltgen commented on GitHub (Sep 3, 2024):

@romayojr can you make sure to pull the latest image (v0.3.9) and see if the problem is resolved?

<!-- gh-comment-id:2327602545 --> @dhiltgen commented on GitHub (Sep 3, 2024): @romayojr can you make sure to pull the latest image (v0.3.9) and see if the problem is resolved?
Author
Owner

@romayojr commented on GitHub (Sep 3, 2024):

@dhiltgen yes, the latest image resolved my issue - thank you so much!

removed the tag from my compose file. ran the following two commands:

$ docker compose pull
[+] Pulling 6/6
 ✔ ollama Pulled                                                                                                  27.0s
   ✔ 857cc8cb19c0 Already exists                                                                                   0.0s
   ✔ 6cd4c033dadb Pull complete                                                                                   22.5s
   ✔ d382c9300322 Pull complete                                                                                   22.8s
   ✔ 5c0375be7547 Pull complete                                                                                   25.5s
 ✔ open-webui Pulled                                                                                               0.5s
$ docker compose up -d --force-recreate --remove-orphans && docker logs -f ollama
[+] Running 2/2
 ✔ Container ollama      Started                                                                                   3.4s
 ✔ Container open-webui  Started                                                                                   3.1s
2024/09/03 23:20:16 routes.go:1125: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR: OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]"
time=2024-09-03T23:20:16.719Z level=INFO source=images.go:753 msg="total blobs: 10"
time=2024-09-03T23:20:16.719Z level=INFO source=images.go:760 msg="total unused blobs removed: 0"
time=2024-09-03T23:20:16.719Z level=INFO source=routes.go:1172 msg="Listening on [::]:11434 (version 0.3.9)"
time=2024-09-03T23:20:16.719Z level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama2172983208/runners
time=2024-09-03T23:20:22.748Z level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11 cuda_v12 rocm_v60102]"
time=2024-09-03T23:20:22.748Z level=INFO source=gpu.go:200 msg="looking for compatible GPUs"
time=2024-09-03T23:20:22.891Z level=INFO source=types.go:107 msg="inference compute" id=GPU-ab745421-90f6-2006-cf20-0229a6acd7bf library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" total="10.0 GiB" available="8.9 GiB"
[GIN] 2024/09/03 - 23:20:48 | 200 |     321.103µs |    172.29.240.1 | GET      "/api/tags"
[GIN] 2024/09/03 - 23:21:04 | 200 |      17.776µs |    172.29.240.1 | GET      "/"
[GIN] 2024/09/03 - 23:21:04 | 404 |       8.637µs |    172.29.240.1 | GET      "/favicon.ico"
[GIN] 2024/09/03 - 23:22:00 | 200 |     1.73719ms |    172.29.240.1 | GET      "/api/tags"
[GIN] 2024/09/03 - 23:22:00 | 200 |      80.832µs |    172.29.240.1 | GET      "/api/version"
<!-- gh-comment-id:2327623765 --> @romayojr commented on GitHub (Sep 3, 2024): @dhiltgen yes, the latest image resolved my issue - thank you so much! removed the tag from my compose file. ran the following two commands: ``` $ docker compose pull [+] Pulling 6/6 ✔ ollama Pulled 27.0s ✔ 857cc8cb19c0 Already exists 0.0s ✔ 6cd4c033dadb Pull complete 22.5s ✔ d382c9300322 Pull complete 22.8s ✔ 5c0375be7547 Pull complete 25.5s ✔ open-webui Pulled 0.5s ``` ``` $ docker compose up -d --force-recreate --remove-orphans && docker logs -f ollama [+] Running 2/2 ✔ Container ollama Started 3.4s ✔ Container open-webui Started 3.1s 2024/09/03 23:20:16 routes.go:1125: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR: OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]" time=2024-09-03T23:20:16.719Z level=INFO source=images.go:753 msg="total blobs: 10" time=2024-09-03T23:20:16.719Z level=INFO source=images.go:760 msg="total unused blobs removed: 0" time=2024-09-03T23:20:16.719Z level=INFO source=routes.go:1172 msg="Listening on [::]:11434 (version 0.3.9)" time=2024-09-03T23:20:16.719Z level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama2172983208/runners time=2024-09-03T23:20:22.748Z level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11 cuda_v12 rocm_v60102]" time=2024-09-03T23:20:22.748Z level=INFO source=gpu.go:200 msg="looking for compatible GPUs" time=2024-09-03T23:20:22.891Z level=INFO source=types.go:107 msg="inference compute" id=GPU-ab745421-90f6-2006-cf20-0229a6acd7bf library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" total="10.0 GiB" available="8.9 GiB" [GIN] 2024/09/03 - 23:20:48 | 200 | 321.103µs | 172.29.240.1 | GET "/api/tags" [GIN] 2024/09/03 - 23:21:04 | 200 | 17.776µs | 172.29.240.1 | GET "/" [GIN] 2024/09/03 - 23:21:04 | 404 | 8.637µs | 172.29.240.1 | GET "/favicon.ico" [GIN] 2024/09/03 - 23:22:00 | 200 | 1.73719ms | 172.29.240.1 | GET "/api/tags" [GIN] 2024/09/03 - 23:22:00 | 200 | 80.832µs | 172.29.240.1 | GET "/api/version" ```
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#4118