OSError: Error no file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory /app/backend/data/cache/embedding/models/models--sentence-transformers--all-MiniLM-L6-v2/snapshots/8b3219a92973c328a8e22fadcfa821b5dc75636a.
Actual Behavior:
the docker container start failure
Environment
Open WebUI Version: [main]
Ollama (if applicable): [0.1.42-rocm]
Operating System: [Ubuntu 24.04]
Reproduction Details
Confirmation:
[yes ] I have read and followed all the instructions provided in the README.md.
[yes ] I am on the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
[yes ] I have included the Docker container logs.
Logs and Screenshots
Docker Container Logs:
Traceback (most recent call last):
2024-06-09T15:48:10.983616995Z File "/usr/local/bin/uvicorn", line 8, in <module>
2024-06-09T15:48:10.983620812Z sys.exit(main())
2024-06-09T15:48:10.983623828Z ^^^^^^
2024-06-09T15:48:10.983626653Z File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
2024-06-09T15:48:10.983724454Z return self.main(*args, **kwargs)
2024-06-09T15:48:10.983732970Z ^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.983736326Z File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1078, in main
2024-06-09T15:48:10.983864993Z rv = self.invoke(ctx)
2024-06-09T15:48:10.983872678Z ^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.983875142Z File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
2024-06-09T15:48:10.984011514Z return ctx.invoke(self.callback, **ctx.params)
2024-06-09T15:48:10.984021552Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984024308Z File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke
2024-06-09T15:48:10.984085100Z return __callback(*args, **kwargs)
2024-06-09T15:48:10.984088927Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984091522Z File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 410, in main
2024-06-09T15:48:10.984135834Z run(
2024-06-09T15:48:10.984145662Z File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 578, in run
2024-06-09T15:48:10.984222834Z server.run()
2024-06-09T15:48:10.984225980Z File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 61, in run
2024-06-09T15:48:10.984227944Z return asyncio.run(self.serve(sockets=sockets))
2024-06-09T15:48:10.984244715Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984247870Z File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
2024-06-09T15:48:10.984282444Z return runner.run(main)
2024-06-09T15:48:10.984284829Z ^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984303453Z File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
2024-06-09T15:48:10.984326947Z return self._loop.run_until_complete(task)
2024-06-09T15:48:10.984334591Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984337075Z File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
2024-06-09T15:48:10.984385875Z File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 68, in serve
2024-06-09T15:48:10.984414849Z config.load()
2024-06-09T15:48:10.984417103Z File "/usr/local/lib/python3.11/site-packages/uvicorn/config.py", line 473, in load
2024-06-09T15:48:10.984478917Z self.loaded_app = import_from_string(self.app)
2024-06-09T15:48:10.984486581Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984488976Z File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 21, in import_from_string
2024-06-09T15:48:10.984513431Z module = importlib.import_module(module_str)
2024-06-09T15:48:10.984525884Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984527817Z File "/usr/local/lib/python3.11/importlib/__init__.py", line 126, in import_module
2024-06-09T15:48:10.984554908Z return _bootstrap._gcd_import(name[level:], package, level)
2024-06-09T15:48:10.984576568Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984586686Z File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
2024-06-09T15:48:10.984588850Z File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
2024-06-09T15:48:10.984590824Z File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
2024-06-09T15:48:10.984592697Z File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
2024-06-09T15:48:10.984594451Z File "<frozen importlib._bootstrap_external>", line 940, in exec_module
2024-06-09T15:48:10.984596184Z File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
2024-06-09T15:48:10.984598258Z File "/app/backend/main.py", line 30, in <module>
2024-06-09T15:48:10.984606513Z from apps.rag.main import app as rag_app
2024-06-09T15:48:10.984618946Z File "/app/backend/apps/rag/main.py", line 200, in <module>
2024-06-09T15:48:10.984656405Z update_embedding_model(
2024-06-09T15:48:10.984660332Z File "/app/backend/apps/rag/main.py", line 177, in update_embedding_model
2024-06-09T15:48:10.984687733Z app.state.sentence_transformer_ef = sentence_transformers.SentenceTransformer(
2024-06-09T15:48:10.984701709Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984703762Z File "/usr/local/lib/python3.11/site-packages/sentence_transformers/SentenceTransformer.py", line 197, in __init__
2024-06-09T15:48:10.984790963Z modules = self._load_sbert_model(
2024-06-09T15:48:10.984794079Z ^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984796624Z File "/usr/local/lib/python3.11/site-packages/sentence_transformers/SentenceTransformer.py", line 1296, in _load_sbert_model
2024-06-09T15:48:10.985099063Z module = Transformer(model_name_or_path, cache_dir=cache_folder, **kwargs)
2024-06-09T15:48:10.985122376Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.985127405Z File "/usr/local/lib/python3.11/site-packages/sentence_transformers/models/Transformer.py", line 36, in __init__
2024-06-09T15:48:10.985175093Z self._load_model(model_name_or_path, config, cache_dir, **model_args)
2024-06-09T15:48:10.985195491Z File "/usr/local/lib/python3.11/site-packages/sentence_transformers/models/Transformer.py", line 65, in _load_model
2024-06-09T15:48:10.985232780Z self.auto_model = AutoModel.from_pretrained(
2024-06-09T15:48:10.985235114Z ^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.985240684Z File "/usr/local/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 563, in from_pretrained
2024-06-09T15:48:10.985314951Z return model_class.from_pretrained(
2024-06-09T15:48:10.985317907Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.985330650Z File "/usr/local/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3305, in from_pretrained
2024-06-09T15:48:10.985619454Z raise EnvironmentError(
2024-06-09T15:48:10.985626196Z OSError: Error no file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory /app/backend/data/cache/embedding/models/models--sentence-transformers--all-MiniLM-L6-v2/snapshots/8b3219a92973c328a8e22fadcfa821b5dc75636a.
Installation Method
Docker
Originally created by @vergilyoungdante on GitHub (Jun 9, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/2954
# Bug Report
## Description
**Bug Summary:**
when I started open-webui with docker compose, It show an error with OSError
**Steps to Reproduce:**
start open-webui with docker compose
```
ollama:
image: ollama/ollama:0.1.42-rocm
container_name: ollama
hostname: ollama
restart: unless-stopped
user: root
volumes:
- /mnt/data/vergil/ollama:/root/.ollama
devices:
- /dev/kfd
- /dev/dri
ports:
- 31434:11434
open-webui:
image: ghcr.io/open-webui/open-webui:main
container_name: open-webui
hostname: open-webui
restart: unless-stopped
volumes:
- /mnt/data/vergil/openwebui:/app/backend/data
ports:
- 28080:8080
environment:
- OLLAMA_BASE_URL=ollama:11434
- WEBUI_SECRET_KEY=TKCS@Pass1234!
- HF_ENDPOINT=https://hf-mirror.com
extra_hosts:
- host.docker.internal:host-gateway
depends_on:
- ollama
```
**Expected Behavior:**
I find a error log:
```
OSError: Error no file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory /app/backend/data/cache/embedding/models/models--sentence-transformers--all-MiniLM-L6-v2/snapshots/8b3219a92973c328a8e22fadcfa821b5dc75636a.
```
**Actual Behavior:**
the docker container start failure
## Environment
- **Open WebUI Version:** [main]
- **Ollama (if applicable):** [0.1.42-rocm]
- **Operating System:** [Ubuntu 24.04]
## Reproduction Details
**Confirmation:**
- [yes ] I have read and followed all the instructions provided in the README.md.
- [yes ] I am on the latest version of both Open WebUI and Ollama.
- [ ] I have included the browser console logs.
- [yes ] I have included the Docker container logs.
## Logs and Screenshots
**Docker Container Logs:**
```
Traceback (most recent call last):
2024-06-09T15:48:10.983616995Z File "/usr/local/bin/uvicorn", line 8, in <module>
2024-06-09T15:48:10.983620812Z sys.exit(main())
2024-06-09T15:48:10.983623828Z ^^^^^^
2024-06-09T15:48:10.983626653Z File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
2024-06-09T15:48:10.983724454Z return self.main(*args, **kwargs)
2024-06-09T15:48:10.983732970Z ^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.983736326Z File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1078, in main
2024-06-09T15:48:10.983864993Z rv = self.invoke(ctx)
2024-06-09T15:48:10.983872678Z ^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.983875142Z File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
2024-06-09T15:48:10.984011514Z return ctx.invoke(self.callback, **ctx.params)
2024-06-09T15:48:10.984021552Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984024308Z File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke
2024-06-09T15:48:10.984085100Z return __callback(*args, **kwargs)
2024-06-09T15:48:10.984088927Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984091522Z File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 410, in main
2024-06-09T15:48:10.984135834Z run(
2024-06-09T15:48:10.984145662Z File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 578, in run
2024-06-09T15:48:10.984222834Z server.run()
2024-06-09T15:48:10.984225980Z File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 61, in run
2024-06-09T15:48:10.984227944Z return asyncio.run(self.serve(sockets=sockets))
2024-06-09T15:48:10.984244715Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984247870Z File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
2024-06-09T15:48:10.984282444Z return runner.run(main)
2024-06-09T15:48:10.984284829Z ^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984303453Z File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
2024-06-09T15:48:10.984326947Z return self._loop.run_until_complete(task)
2024-06-09T15:48:10.984334591Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984337075Z File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
2024-06-09T15:48:10.984385875Z File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 68, in serve
2024-06-09T15:48:10.984414849Z config.load()
2024-06-09T15:48:10.984417103Z File "/usr/local/lib/python3.11/site-packages/uvicorn/config.py", line 473, in load
2024-06-09T15:48:10.984478917Z self.loaded_app = import_from_string(self.app)
2024-06-09T15:48:10.984486581Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984488976Z File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 21, in import_from_string
2024-06-09T15:48:10.984513431Z module = importlib.import_module(module_str)
2024-06-09T15:48:10.984525884Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984527817Z File "/usr/local/lib/python3.11/importlib/__init__.py", line 126, in import_module
2024-06-09T15:48:10.984554908Z return _bootstrap._gcd_import(name[level:], package, level)
2024-06-09T15:48:10.984576568Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984586686Z File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
2024-06-09T15:48:10.984588850Z File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
2024-06-09T15:48:10.984590824Z File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
2024-06-09T15:48:10.984592697Z File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
2024-06-09T15:48:10.984594451Z File "<frozen importlib._bootstrap_external>", line 940, in exec_module
2024-06-09T15:48:10.984596184Z File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
2024-06-09T15:48:10.984598258Z File "/app/backend/main.py", line 30, in <module>
2024-06-09T15:48:10.984606513Z from apps.rag.main import app as rag_app
2024-06-09T15:48:10.984618946Z File "/app/backend/apps/rag/main.py", line 200, in <module>
2024-06-09T15:48:10.984656405Z update_embedding_model(
2024-06-09T15:48:10.984660332Z File "/app/backend/apps/rag/main.py", line 177, in update_embedding_model
2024-06-09T15:48:10.984687733Z app.state.sentence_transformer_ef = sentence_transformers.SentenceTransformer(
2024-06-09T15:48:10.984701709Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984703762Z File "/usr/local/lib/python3.11/site-packages/sentence_transformers/SentenceTransformer.py", line 197, in __init__
2024-06-09T15:48:10.984790963Z modules = self._load_sbert_model(
2024-06-09T15:48:10.984794079Z ^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.984796624Z File "/usr/local/lib/python3.11/site-packages/sentence_transformers/SentenceTransformer.py", line 1296, in _load_sbert_model
2024-06-09T15:48:10.985099063Z module = Transformer(model_name_or_path, cache_dir=cache_folder, **kwargs)
2024-06-09T15:48:10.985122376Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.985127405Z File "/usr/local/lib/python3.11/site-packages/sentence_transformers/models/Transformer.py", line 36, in __init__
2024-06-09T15:48:10.985175093Z self._load_model(model_name_or_path, config, cache_dir, **model_args)
2024-06-09T15:48:10.985195491Z File "/usr/local/lib/python3.11/site-packages/sentence_transformers/models/Transformer.py", line 65, in _load_model
2024-06-09T15:48:10.985232780Z self.auto_model = AutoModel.from_pretrained(
2024-06-09T15:48:10.985235114Z ^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.985240684Z File "/usr/local/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 563, in from_pretrained
2024-06-09T15:48:10.985314951Z return model_class.from_pretrained(
2024-06-09T15:48:10.985317907Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-06-09T15:48:10.985330650Z File "/usr/local/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3305, in from_pretrained
2024-06-09T15:48:10.985619454Z raise EnvironmentError(
2024-06-09T15:48:10.985626196Z OSError: Error no file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory /app/backend/data/cache/embedding/models/models--sentence-transformers--all-MiniLM-L6-v2/snapshots/8b3219a92973c328a8e22fadcfa821b5dc75636a.
```
## Installation Method
Docker
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @vergilyoungdante on GitHub (Jun 9, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/2954
Bug Report
Description
Bug Summary:
when I started open-webui with docker compose, It show an error with OSError
Steps to Reproduce:
start open-webui with docker compose
Expected Behavior:
I find a error log:
Actual Behavior:
the docker container start failure
Environment
Open WebUI Version: [main]
Ollama (if applicable): [0.1.42-rocm]
Operating System: [Ubuntu 24.04]
Reproduction Details
Confirmation:
Logs and Screenshots
Docker Container Logs:
Installation Method
Docker