mirror of
https://github.com/open-webui/open-webui.git
synced 2026-06-04 07:47:12 -05:00
[GH-ISSUE #832] Set Ollama model directory in docker compose #12230
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @norton-chris on GitHub (Feb 21, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/832
I understand the Ollama handles the model directory folder, however, I'm launching Ollama and open-webui with docker compose: ./run-compose.sh --enable-gpu --build
I see in Ollama to set a different model directory you export OLLAMA_MODEL=/path/to/models
I did that in the docker-compose.yaml and added my models path to volumes /root/.ollama.
Here's a snippet of my docker-compose.yaml:
but I still don't see the models in the webui or when I run
ollama listin the ollama docker container.What am I doing wrong?
@justinh-rahb commented on GitHub (Feb 21, 2024):
If you set that after having using Ollama with the default location, the models are not moved automatically, you'll need to do that. It could also be your drive formatting; I tried to do similar to you using an external drive, but because it was formatted with exFAT there was no symlink support, which causes Ollama to not see any of the models.