github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 08:30:05 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #1502] add mixtral-8x7b-v0.1 gguf model[from TheBloke] support #62850

New Issue
Closed
opened 2026-05-03 10:30:21 -05:00 by GiteaMirror · 1 comment
GiteaMirror commented 2026-05-03 10:30:21 -05:00
Owner
Copy Link

Originally created by @mintisan on GitHub (Dec 13, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/1502

Originally assigned to: @jmorganca on GitHub.

I download https://huggingface.co/TheBloke/Mixtral-8x7B-v0.1-GGUF, and create with ollama.

(base) ➜  Mixtral-8x7B-v0.1-GGUF ls
Modelfile                     mixtral-8x7b-v0.1.Q4_K_M.gguf
(base) ➜  Mixtral-8x7B-v0.1-GGUF cat Modelfile
FROM ./mixtral-8x7b-v0.1.Q4_K_M.gguf
(base) ➜  Mixtral-8x7B-v0.1-GGUF ollama create mixtral_8x7b_v0.1 -f Modelfile
transferring model data
creating model layer
using already created layer sha256:5e066c60d89d904db46c3bf577661040578a223a5a39ba3fd23ff091549767f0
writing layer sha256:fc2cce1b755caff29480bd61609c4c9fb495919d4af07adfe5b1a5ab0ffe5679
writing manifest
success

But not support when running it

(base) ➜  Mixtral-8x7B-v0.1-GGUF ollama run mixtral_8x7b_v0.1
Error: llama runner: failed to load model '/Users/mintisan/.ollama/models/blobs/sha256:5e066c60d89d904db41549767f0': this model may be incompatible with your version of Ollama. If you previously pulled this model, try updating it by running `ollama pull mixtral_8x7b_v0.1:latest`
Originally created by @mintisan on GitHub (Dec 13, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/1502 Originally assigned to: @jmorganca on GitHub. I download https://huggingface.co/TheBloke/Mixtral-8x7B-v0.1-GGUF, and create with ollama. ``` (base) ➜ Mixtral-8x7B-v0.1-GGUF ls Modelfile mixtral-8x7b-v0.1.Q4_K_M.gguf (base) ➜ Mixtral-8x7B-v0.1-GGUF cat Modelfile FROM ./mixtral-8x7b-v0.1.Q4_K_M.gguf (base) ➜ Mixtral-8x7B-v0.1-GGUF ollama create mixtral_8x7b_v0.1 -f Modelfile transferring model data creating model layer using already created layer sha256:5e066c60d89d904db46c3bf577661040578a223a5a39ba3fd23ff091549767f0 writing layer sha256:fc2cce1b755caff29480bd61609c4c9fb495919d4af07adfe5b1a5ab0ffe5679 writing manifest success ``` But not support when running it ``` (base) ➜ Mixtral-8x7B-v0.1-GGUF ollama run mixtral_8x7b_v0.1 Error: llama runner: failed to load model '/Users/mintisan/.ollama/models/blobs/sha256:5e066c60d89d904db41549767f0': this model may be incompatible with your version of Ollama. If you previously pulled this model, try updating it by running `ollama pull mixtral_8x7b_v0.1:latest` ```
GiteaMirror commented 2026-05-03 10:30:23 -05:00
Author
Owner
Copy Link

@justinh-rahb commented on GitHub (Dec 13, 2023):

It's in the merge queue already #1475

<!-- gh-comment-id:1854207494 --> @justinh-rahb commented on GitHub (Dec 13, 2023): It's in the merge queue already #1475
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#62850
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?