mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 23:21:44 -05:00
feat: UI to download gguf models from huggingface and use it model files #99
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @kavinask007 on GitHub (Dec 15, 2023).
Modelfile interface is currently limited to using only models officially provided by Ollama .
Providing a UI interface to browse huggingface for GGUF models , selecting and downloading them by clicking buttons and able to use them in modelfiles would be great
Ollama web server does support local files
https://github.com/jmorganca/ollama/tree/main?tab=readme-ov-file#import-from-gguf
@tjbck commented on GitHub (Dec 15, 2023):
Hi, Thanks for the suggestion. I've actually been thinking of ways to implement this feature for a while now, I'll get around to it when I can, stay tuned!
@tjbck commented on GitHub (Dec 23, 2023):
Hi! I've been actively working on this feature, and intuitively showing huggingface files on the webui seems tricker than I thought :/ As an alternative, I'll be adding a feature where users can download the gguf files themselves and then upload it to the webui. Stay tuned!
@Nodael commented on GitHub (May 24, 2024):
No news on this feauture ?
@cleanunicorn commented on GitHub (Jun 4, 2024):
It's marked as complete. You can find it in the models tab, in settings.
@RichardFevrier commented on GitHub (Jan 6, 2025):
Really? cause I'm having trouble to find where to download models from HF.