[GH-ISSUE #8677] Wrote scripts to import gguf files/folder #31381

Open
opened 2026-04-22 11:47:12 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @gl2007 on GitHub (Jan 30, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/8677

Don't see a "discussion" tab like I see for other repos, so just creating an issue.
Had a bunch of gguf's in a folder, so wrote 2 scripts (windows and shell) to import a single gguf and all ggufs in a given folder.

Don't know how to get a PR in but I can attach them here is any of you think they are useful.

Originally created by @gl2007 on GitHub (Jan 30, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/8677 Don't see a "discussion" tab like I see for other repos, so just creating an issue. Had a bunch of gguf's in a folder, so wrote 2 scripts (windows and shell) to import a single gguf and all ggufs in a given folder. Don't know how to get a PR in but I can attach them here is any of you think they are useful.
GiteaMirror added the feature request label 2026-04-22 11:47:12 -05:00
Author
Owner

@zhurunhua commented on GitHub (Feb 10, 2025):

how to import gguf folder?

Image
<!-- gh-comment-id:2647471209 --> @zhurunhua commented on GitHub (Feb 10, 2025): how to import gguf folder? <img width="696" alt="Image" src="https://github.com/user-attachments/assets/4f7495d2-0f3f-4985-b979-ceb7408b91f8" />
Author
Owner

@gl2007 commented on GitHub (Feb 12, 2025):

import_gguf.zip extract the zip file and try running the appropriate script against your folder.

Note: your screenshot shows that you have downloaded the model in separate parts, I don't think ollama's import feature supports that. You need to download entire gguf in one shot or maybe combine it into one gguf per model.

<!-- gh-comment-id:2652563695 --> @gl2007 commented on GitHub (Feb 12, 2025): [import_gguf.zip](https://github.com/user-attachments/files/18761667/import_gguf.zip) extract the zip file and try running the appropriate script against your folder. Note: your screenshot shows that you have downloaded the model in separate parts, I don't think ollama's import feature supports that. You need to download entire gguf in one shot or maybe combine it into one gguf per model.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#31381