Modelfile interface is currently limited to using only models officially provided by Ollama .
Providing a UI interface to browse huggingface for GGUF models , selecting and downloading them by clicking buttons and able to use them in modelfiles would be great
Originally created by @kavinask007 on GitHub (Dec 15, 2023).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/234
Modelfile interface is currently limited to using only models officially provided by Ollama .
Providing a UI interface to browse huggingface for GGUF models , selecting and downloading them by clicking buttons and able to use them in modelfiles would be great
Ollama web server does support local files
https://github.com/jmorganca/ollama/tree/main?tab=readme-ov-file#import-from-gguf
Hi, Thanks for the suggestion. I've actually been thinking of ways to implement this feature for a while now, I'll get around to it when I can, stay tuned!
<!-- gh-comment-id:1858238496 -->
@tjbck commented on GitHub (Dec 15, 2023):
Hi, Thanks for the suggestion. I've actually been thinking of ways to implement this feature for a while now, I'll get around to it when I can, stay tuned!
Hi! I've been actively working on this feature, and intuitively showing huggingface files on the webui seems tricker than I thought :/ As an alternative, I'll be adding a feature where users can download the gguf files themselves and then upload it to the webui. Stay tuned!
<!-- gh-comment-id:1868390792 -->
@tjbck commented on GitHub (Dec 23, 2023):
Hi! I've been actively working on this feature, and intuitively showing huggingface files on the webui seems tricker than I thought :/ As an alternative, I'll be adding a feature where users can download the gguf files themselves and then upload it to the webui. Stay tuned!
It's marked as complete. You can find it in the models tab, in settings.
<!-- gh-comment-id:2146724754 -->
@cleanunicorn commented on GitHub (Jun 4, 2024):
> No news on this feauture ?
It's marked as complete. You can find it in the models tab, in settings.
@RichardFevrier commented on GitHub (Jan 6, 2025):
Really? cause I'm having trouble to find where to download models from HF.
<!-- gh-comment-id:2573518548 -->
@RichardFevrier commented on GitHub (Jan 6, 2025):
Really? cause I'm having trouble to find where to download models from HF.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @kavinask007 on GitHub (Dec 15, 2023).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/234
Modelfile interface is currently limited to using only models officially provided by Ollama .
Providing a UI interface to browse huggingface for GGUF models , selecting and downloading them by clicking buttons and able to use them in modelfiles would be great
Ollama web server does support local files
https://github.com/jmorganca/ollama/tree/main?tab=readme-ov-file#import-from-gguf
@tjbck commented on GitHub (Dec 15, 2023):
Hi, Thanks for the suggestion. I've actually been thinking of ways to implement this feature for a while now, I'll get around to it when I can, stay tuned!
@tjbck commented on GitHub (Dec 23, 2023):
Hi! I've been actively working on this feature, and intuitively showing huggingface files on the webui seems tricker than I thought :/ As an alternative, I'll be adding a feature where users can download the gguf files themselves and then upload it to the webui. Stay tuned!
@Nodael commented on GitHub (May 24, 2024):
No news on this feauture ?
@cleanunicorn commented on GitHub (Jun 4, 2024):
It's marked as complete. You can find it in the models tab, in settings.
@RichardFevrier commented on GitHub (Jan 6, 2025):
Really? cause I'm having trouble to find where to download models from HF.