[GH-ISSUE #9309] 需要ollama支持加载同个模型的多个gguf文件 #31834

Closed
opened 2026-04-22 12:36:16 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @MusicOfWind on GitHub (Feb 24, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9309

有些模型有多个gguf文件构成,但是目前无法在ollama进行加载启动

Originally created by @MusicOfWind on GitHub (Feb 24, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9309 有些模型有多个gguf文件构成,但是目前无法在ollama进行加载启动
GiteaMirror added the feature request label 2026-04-22 12:36:16 -05:00
Author
Owner

@AncientMystic commented on GitHub (Feb 24, 2025):

You can use llama.cpp to merge models.
您可以使用llama.cpp来合并模型。

命令示例:
Example command:

~/llama.cpp/gguf-split --merge infile-00001-of-0000N.gguf outfile.gguf

~/llama.cpp/gguf-split --merge 文件-00001-of-0000N.gguf 外文件.gguf

While it is not ollama support, i Hope this helps
虽然这不是ollama的支持,但我希望这有帮助

<!-- gh-comment-id:2677501620 --> @AncientMystic commented on GitHub (Feb 24, 2025): You can use llama.cpp to merge models. 您可以使用llama.cpp来合并模型。 命令示例: Example command: ~/llama.cpp/gguf-split --merge infile-00001-of-0000N.gguf outfile.gguf ~/llama.cpp/gguf-split --merge 文件-00001-of-0000N.gguf 外文件.gguf While it is not ollama support, i Hope this helps 虽然这不是ollama的支持,但我希望这有帮助
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#31834