Originally created by @SurvivaLlama on GitHub (May 13, 2024).
Is your feature request related to a problem? Please describe.
I have 2 servers running ollama. When a new llama is released I have to manually select each server and tell it to download that new llama model. I'm lazy and dont want do to that.
Describe the solution you'd like
When I tell open-webui to download a model, open-webui should download that model onto both ollama servers. When I tell it to delete a model, the ui should delete the model on both servers.
Originally created by @SurvivaLlama on GitHub (May 13, 2024).
**Is your feature request related to a problem? Please describe.**
I have 2 servers running ollama. When a new llama is released I have to manually select each server and tell it to download that new llama model. I'm lazy and dont want do to that.
**Describe the solution you'd like**
When I tell open-webui to download a model, open-webui should download that model onto both ollama servers. When I tell it to delete a model, the ui should delete the model on both servers.
This is going to sound dumb, but I solved this by just syncing the model folder with syncthing. totally works.
@SurvivaLlama commented on GitHub (May 13, 2024):
This is going to sound dumb, but I solved this by just syncing the model folder with syncthing. totally works.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @SurvivaLlama on GitHub (May 13, 2024).
Is your feature request related to a problem? Please describe.
I have 2 servers running ollama. When a new llama is released I have to manually select each server and tell it to download that new llama model. I'm lazy and dont want do to that.
Describe the solution you'd like
When I tell open-webui to download a model, open-webui should download that model onto both ollama servers. When I tell it to delete a model, the ui should delete the model on both servers.
@SurvivaLlama commented on GitHub (May 13, 2024):
This is going to sound dumb, but I solved this by just syncing the model folder with syncthing. totally works.