[GH-ISSUE #2253] Invalid file magic dolphin-2.7-mixtral gguf #27052

Closed
opened 2026-04-22 03:57:31 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @fschiro on GitHub (Jan 29, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2253

Hello, I'm having trouble creating dolphin-2.7-mixtral from a GGUF. Is the model supported?

ollama --version
ollama version is 0.1.22

cat Modelfile 
FROM ./dolphin-2.7-mixtral-8x7b.Q4_K_M.gguf

ls
config.json
dolphin-2.7-mixtral-8x7b.Q2_K.gguf
dolphin-2.7-mixtral-8x7b.Q3_K_M.gguf
dolphin-2.7-mixtral-8x7b.Q4_0.gguf
dolphin-2.7-mixtral-8x7b.Q4_K_M.gguf
dolphin-2.7-mixtral-8x7b.Q5_0.gguf
dolphin-2.7-mixtral-8x7b.Q5_K_M.gguf
dolphin-2.7-mixtral-8x7b.Q6_K.gguf
dolphin-2.7-mixtral-8x7b.Q8_0.gguf
Modelfile
README.md

ollama create dm2.7_4km -f Modelfile
transferring model data 
creating model layer 
Error: invalid file magic
Originally created by @fschiro on GitHub (Jan 29, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2253 Hello, I'm having trouble creating dolphin-2.7-mixtral from a GGUF. Is the model supported? ```bash ollama --version ollama version is 0.1.22 cat Modelfile FROM ./dolphin-2.7-mixtral-8x7b.Q4_K_M.gguf ls config.json dolphin-2.7-mixtral-8x7b.Q2_K.gguf dolphin-2.7-mixtral-8x7b.Q3_K_M.gguf dolphin-2.7-mixtral-8x7b.Q4_0.gguf dolphin-2.7-mixtral-8x7b.Q4_K_M.gguf dolphin-2.7-mixtral-8x7b.Q5_0.gguf dolphin-2.7-mixtral-8x7b.Q5_K_M.gguf dolphin-2.7-mixtral-8x7b.Q6_K.gguf dolphin-2.7-mixtral-8x7b.Q8_0.gguf Modelfile README.md ollama create dm2.7_4km -f Modelfile transferring model data creating model layer Error: invalid file magic ```
Author
Owner

@mxyng commented on GitHub (Jan 29, 2024):

Hi, can you link the model repo?

FWIW dolphin mixtral 2.7 is available in the Ollama library if you only care about running it

<!-- gh-comment-id:1915203197 --> @mxyng commented on GitHub (Jan 29, 2024): Hi, can you link the model repo? FWIW dolphin mixtral 2.7 is available in the Ollama library if you only care about running it
Author
Owner

@fschiro commented on GitHub (Jan 30, 2024):

Here is the repo link, I'm trying to get this uncensored version: TheBloke/dolphin-2.7-mixtral

<!-- gh-comment-id:1916913420 --> @fschiro commented on GitHub (Jan 30, 2024): Here is the repo link, I'm trying to get this uncensored version: [TheBloke/dolphin-2.7-mixtral](https://huggingface.co/TheBloke/dolphin-2.7-mixtral-8x7b-GGUF)
Author
Owner

@bmizerany commented on GitHub (Mar 11, 2024):

@fschiro The model is https://ollama.com/library/dolphin-mixtral:v2.7.

Closing this issue, but feel free to reopen if you need to.

<!-- gh-comment-id:1989184955 --> @bmizerany commented on GitHub (Mar 11, 2024): @fschiro The model is https://ollama.com/library/dolphin-mixtral:v2.7. Closing this issue, but feel free to reopen if you need to.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#27052