Wrote scripts to import gguf files/folder #5626

Open
opened 2025-11-12 13:04:40 -06:00 by GiteaMirror · 2 comments
Owner

Originally created by @gl2007 on GitHub (Jan 30, 2025).

Don't see a "discussion" tab like I see for other repos, so just creating an issue.
Had a bunch of gguf's in a folder, so wrote 2 scripts (windows and shell) to import a single gguf and all ggufs in a given folder.

Don't know how to get a PR in but I can attach them here is any of you think they are useful.

Originally created by @gl2007 on GitHub (Jan 30, 2025). Don't see a "discussion" tab like I see for other repos, so just creating an issue. Had a bunch of gguf's in a folder, so wrote 2 scripts (windows and shell) to import a single gguf and all ggufs in a given folder. Don't know how to get a PR in but I can attach them here is any of you think they are useful.
GiteaMirror added the feature request label 2025-11-12 13:04:40 -06:00
Author
Owner

@zhurunhua commented on GitHub (Feb 10, 2025):

how to import gguf folder?

Image
@zhurunhua commented on GitHub (Feb 10, 2025): how to import gguf folder? <img width="696" alt="Image" src="https://github.com/user-attachments/assets/4f7495d2-0f3f-4985-b979-ceb7408b91f8" />
Author
Owner

@gl2007 commented on GitHub (Feb 12, 2025):

import_gguf.zip extract the zip file and try running the appropriate script against your folder.

Note: your screenshot shows that you have downloaded the model in separate parts, I don't think ollama's import feature supports that. You need to download entire gguf in one shot or maybe combine it into one gguf per model.

@gl2007 commented on GitHub (Feb 12, 2025): [import_gguf.zip](https://github.com/user-attachments/files/18761667/import_gguf.zip) extract the zip file and try running the appropriate script against your folder. Note: your screenshot shows that you have downloaded the model in separate parts, I don't think ollama's import feature supports that. You need to download entire gguf in one shot or maybe combine it into one gguf per model.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama-ollama#5626