I understand the Ollama handles the model directory folder, however, I'm launching Ollama and open-webui with docker compose: ./run-compose.sh --enable-gpu --build
I see in Ollama to set a different model directory you export OLLAMA_MODEL=/path/to/models
I did that in the docker-compose.yaml and added my models path to volumes /root/.ollama.
Here's a snippet of my docker-compose.yaml:
but I still don't see the models in the webui or when I run ollama list in the ollama docker container.
What am I doing wrong?
Originally created by @norton-chris on GitHub (Feb 21, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/832
I understand the Ollama handles the model directory folder, however, I'm launching Ollama and open-webui with docker compose: ./run-compose.sh --enable-gpu --build
I see in Ollama to set a different model directory you export OLLAMA_MODEL=/path/to/models
I did that in the docker-compose.yaml and added my models path to volumes /root/.ollama.
Here's a snippet of my docker-compose.yaml:
```
services:
ollama:
environment:
- OLLAMA_MODELS=/root/.ollama/models
volumes:
- ollama:/root/.ollama
- /mnt/2TB_SSD/text-gen/text-generation-webui/models:/root/.ollama/models
....(rest of docker-compose)
```
but I still don't see the models in the webui or when I run `ollama list` in the ollama docker container.
What am I doing wrong?
If you set that after having using Ollama with the default location, the models are not moved automatically, you'll need to do that. It could also be your drive formatting; I tried to do similar to you using an external drive, but because it was formatted with exFAT there was no symlink support, which causes Ollama to not see any of the models.
<!-- gh-comment-id:1957787361 -->
@justinh-rahb commented on GitHub (Feb 21, 2024):
If you set that after having using Ollama with the default location, the models are not moved automatically, you'll need to do that. It could also be your drive formatting; I tried to do similar to you using an external drive, but because it was formatted with exFAT there was no symlink support, which causes Ollama to not see any of the models.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @norton-chris on GitHub (Feb 21, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/832
I understand the Ollama handles the model directory folder, however, I'm launching Ollama and open-webui with docker compose: ./run-compose.sh --enable-gpu --build
I see in Ollama to set a different model directory you export OLLAMA_MODEL=/path/to/models
I did that in the docker-compose.yaml and added my models path to volumes /root/.ollama.
Here's a snippet of my docker-compose.yaml:
but I still don't see the models in the webui or when I run
ollama listin the ollama docker container.What am I doing wrong?
@justinh-rahb commented on GitHub (Feb 21, 2024):
If you set that after having using Ollama with the default location, the models are not moved automatically, you'll need to do that. It could also be your drive formatting; I tried to do similar to you using an external drive, but because it was formatted with exFAT there was no symlink support, which causes Ollama to not see any of the models.