feat: UI to download gguf models from huggingface and use it model files #99

Closed
opened 2025-11-11 14:05:31 -06:00 by GiteaMirror · 5 comments
Owner

Originally created by @kavinask007 on GitHub (Dec 15, 2023).

Modelfile interface is currently limited to using only models officially provided by Ollama .
Providing a UI interface to browse huggingface for GGUF models , selecting and downloading them by clicking buttons and able to use them in modelfiles would be great

Ollama web server does support local files
https://github.com/jmorganca/ollama/tree/main?tab=readme-ov-file#import-from-gguf

Originally created by @kavinask007 on GitHub (Dec 15, 2023). Modelfile interface is currently limited to using only models officially provided by Ollama . Providing a UI interface to browse huggingface for GGUF models , selecting and downloading them by clicking buttons and able to use them in modelfiles would be great Ollama web server does support local files https://github.com/jmorganca/ollama/tree/main?tab=readme-ov-file#import-from-gguf
Author
Owner

@tjbck commented on GitHub (Dec 15, 2023):

Hi, Thanks for the suggestion. I've actually been thinking of ways to implement this feature for a while now, I'll get around to it when I can, stay tuned!

@tjbck commented on GitHub (Dec 15, 2023): Hi, Thanks for the suggestion. I've actually been thinking of ways to implement this feature for a while now, I'll get around to it when I can, stay tuned!
Author
Owner

@tjbck commented on GitHub (Dec 23, 2023):

Hi! I've been actively working on this feature, and intuitively showing huggingface files on the webui seems tricker than I thought :/ As an alternative, I'll be adding a feature where users can download the gguf files themselves and then upload it to the webui. Stay tuned!

@tjbck commented on GitHub (Dec 23, 2023): Hi! I've been actively working on this feature, and intuitively showing huggingface files on the webui seems tricker than I thought :/ As an alternative, I'll be adding a feature where users can download the gguf files themselves and then upload it to the webui. Stay tuned!
Author
Owner

@Nodael commented on GitHub (May 24, 2024):

No news on this feauture ?

@Nodael commented on GitHub (May 24, 2024): No news on this feauture ?
Author
Owner

@cleanunicorn commented on GitHub (Jun 4, 2024):

No news on this feauture ?

It's marked as complete. You can find it in the models tab, in settings.

@cleanunicorn commented on GitHub (Jun 4, 2024): > No news on this feauture ? It's marked as complete. You can find it in the models tab, in settings.
Author
Owner

@RichardFevrier commented on GitHub (Jan 6, 2025):

Really? cause I'm having trouble to find where to download models from HF.

@RichardFevrier commented on GitHub (Jan 6, 2025): Really? cause I'm having trouble to find where to download models from HF.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#99