github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 16:11:34 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #2321] Error: invalid file magic when creating an xs model #1339

New Issue
Closed
opened 2026-04-12 11:10:30 -05:00 by GiteaMirror · 7 comments
GiteaMirror commented 2026-04-12 11:10:30 -05:00
Owner
Copy Link

Originally created by @eramax on GitHub (Feb 2, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2321

Originally assigned to: @bmizerany on GitHub.

Hi,
I tried to create a new model using this gguf file chat-67b-xs.gguf but i didn't work and gave me this output.
I think the xs models is not being supported yet by ollama, but it is working fine the same file using llama.cpp ~/dev/llama.cpp/main --color --instruct -ngl 100 -m deepseek-chat-67b-xs.gguf

➜  models ollama create deepseek-chat-67b-xs
transferring model data
creating model layer
Error: invalid file magic

Modelfile

FROM ./deepseek-chat-67b-xs.gguf

TEMPLATE """{{ .System }}
### Instruction:
{{ .Prompt }}
### Response:"""

PARAMETER stop "<s>"
PARAMETER stop "### Instruction:"
PARAMETER stop "### Response:"

PARAMETER num_ctx 2048
PARAMETER temperature 0.3
#PARAMETER top_k 40
#PARAMETER top_p 0.8
#PARAMETER num_predict 1024

SYSTEM """You are an AI programming assistant"""
Originally created by @eramax on GitHub (Feb 2, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2321 Originally assigned to: @bmizerany on GitHub. Hi, I tried to create a new model using this [gguf file chat-67b-xs.gguf](https://huggingface.co/KnutJaegersberg/awesome-2bit-gguf/blob/main/deepseek-chat-67b-xs.gguf) but i didn't work and gave me this output. I think the xs models is not being supported yet by ollama, but it is working fine the same file using llama.cpp `~/dev/llama.cpp/main --color --instruct -ngl 100 -m deepseek-chat-67b-xs.gguf` ```bash ➜ models ollama create deepseek-chat-67b-xs transferring model data creating model layer Error: invalid file magic ``` ### Modelfile ``` FROM ./deepseek-chat-67b-xs.gguf TEMPLATE """{{ .System }} ### Instruction: {{ .Prompt }} ### Response:""" PARAMETER stop "<s>" PARAMETER stop "### Instruction:" PARAMETER stop "### Response:" PARAMETER num_ctx 2048 PARAMETER temperature 0.3 #PARAMETER top_k 40 #PARAMETER top_p 0.8 #PARAMETER num_predict 1024 SYSTEM """You are an AI programming assistant""" ```
GiteaMirror commented 2026-04-12 11:10:31 -05:00
Author
Owner
Copy Link

@eramax commented on GitHub (Feb 8, 2024):

@jmorganca , does this a problem in my side only or IQ xs models aren't supported yet?

<!-- gh-comment-id:1934777223 --> @eramax commented on GitHub (Feb 8, 2024): @jmorganca , does this a problem in my side only or IQ xs models aren't supported yet?
GiteaMirror commented 2026-04-12 11:10:32 -05:00
Author
Owner
Copy Link

@virt-10 commented on GitHub (Feb 15, 2024):

Someone managed to do it.
Model: https://ollama.com/impactframes/mistral_alpha_xs
Post: https://www.reddit.com/r/ollama/comments/1aozwms/mistral_alpha_xs_knut_j%C3%A4gersbergs_2bit_imatrix/

Also since it seems to be supported will IQ3_XXS support be added?

I have also been trying to do this but with no success I even compiled version 0.1.25 and 0.1.21 as stated in the post.
Maybe there is something wrong with the arch PKGBUILD?

Edit:
Tried it with the official install script didn't work.

<!-- gh-comment-id:1945270736 --> @virt-10 commented on GitHub (Feb 15, 2024): Someone managed to do it. Model: https://ollama.com/impactframes/mistral_alpha_xs Post: https://www.reddit.com/r/ollama/comments/1aozwms/mistral_alpha_xs_knut_j%C3%A4gersbergs_2bit_imatrix/ Also since it seems to be supported will IQ3_XXS support be added? I have also been trying to do this but with no success I even compiled version 0.1.25 and 0.1.21 as stated in the post. Maybe there is something wrong with the arch PKGBUILD? Edit: Tried it with the official install script didn't work.
GiteaMirror commented 2026-04-12 11:10:32 -05:00
Author
Owner
Copy Link

@bmizerany commented on GitHub (Mar 12, 2024):

I'm unable to reproduce with the latest version of Ollama. I'm going to close this for now, but please reopen if the issues persists.

My output using your provided Modelfile and the gguf model:

; ls
Modelfile			deepseek-chat-67b-xs.gguf
; ollama create deepseek-chat-67b-xs
transferring model data 
creating model layer 
creating template layer 
creating system layer 
creating parameters layer 
creating config layer 
using already created layer sha256:cdbc2eeea6d46a3985b151ea03bdc16b83883d2e5de16d808c3c4b54779e0c40 
writing layer sha256:071ef283861a9a36eca353dd6128b9f3b114a09d7888db6fe0b782cc46ecc08c 
writing layer sha256:1a34d9fe82c00072c2b2657e8c0df1c506e2c6c513e0bff4020dea81702d5dc2 
writing layer sha256:72417c131801d602397eeb0e9d45bdacafce5437442154f5b3b52dc7c31c003e 
writing layer sha256:ea55261939a21fd7611604c99f46745840fec2830440ac4faef0856b98ffd4bb 
writing manifest 
success 
; ollama run deepseek-chat-67b-xs       
>>> hello
Hello, how can I assist you today?

>>> Send a message (/? for help)
<!-- gh-comment-id:1992321612 --> @bmizerany commented on GitHub (Mar 12, 2024): I'm unable to reproduce with the latest version of Ollama. I'm going to close this for now, but please reopen if the issues persists. My output using your provided Modelfile and the gguf model: ``` ; ls Modelfile deepseek-chat-67b-xs.gguf ; ollama create deepseek-chat-67b-xs transferring model data creating model layer creating template layer creating system layer creating parameters layer creating config layer using already created layer sha256:cdbc2eeea6d46a3985b151ea03bdc16b83883d2e5de16d808c3c4b54779e0c40 writing layer sha256:071ef283861a9a36eca353dd6128b9f3b114a09d7888db6fe0b782cc46ecc08c writing layer sha256:1a34d9fe82c00072c2b2657e8c0df1c506e2c6c513e0bff4020dea81702d5dc2 writing layer sha256:72417c131801d602397eeb0e9d45bdacafce5437442154f5b3b52dc7c31c003e writing layer sha256:ea55261939a21fd7611604c99f46745840fec2830440ac4faef0856b98ffd4bb writing manifest success ; ollama run deepseek-chat-67b-xs >>> hello Hello, how can I assist you today? >>> Send a message (/? for help) ```
GiteaMirror commented 2026-04-12 11:10:32 -05:00
Author
Owner
Copy Link

@oldgithubman commented on GitHub (Apr 15, 2024):

It seems only certain IQ quants are supported? Could we get the rest supported or can a list of the supported ones be posted prominently on the main readme? Kind of annoying to do all the work only to find out it's not supported

<!-- gh-comment-id:2054270621 --> @oldgithubman commented on GitHub (Apr 15, 2024): It seems only certain IQ quants are supported? Could we get the rest supported or can a list of the supported ones be posted prominently on the main readme? Kind of annoying to do all the work only to find out it's not supported
GiteaMirror commented 2026-04-12 11:10:32 -05:00
Author
Owner
Copy Link

@bmizerany commented on GitHub (Apr 15, 2024):

I can see how that would be frustrating, @oldmanjk. There is more discussion about this going on in #3622. We'll keep investigating.

<!-- gh-comment-id:2057802660 --> @bmizerany commented on GitHub (Apr 15, 2024): I can see how that would be frustrating, @oldmanjk. There is more discussion about this going on in #3622. We'll keep investigating.
GiteaMirror commented 2026-04-12 11:10:33 -05:00
Author
Owner
Copy Link

@h34tnet commented on GitHub (Apr 25, 2024):

i just stumbled upon that error. first i downloaded [Meta-Llama-3-70B-Instruct-IQ2_XS.gguf](https://huggingface.co/lmstudio-community/Meta-Llama-3-70B-Instruct-GGUF/blob/main/Meta-Llama-3-70B-Instruct-IQ2_XS.gguf) and converted it to llama3-70b-iq2 by using FROM path/to/model.gguf - this worked. then i tried to recreate the model (to change the system prompt) by creating a new model file using FROM llama3-70b-iq2 and this failed:

ollama create llama3-70b-iq2-kotlin -f .\llama3-70b-iq2-kotlin
transferring model data
creating model layer
Error: invalid file magic
<!-- gh-comment-id:2076975760 --> @h34tnet commented on GitHub (Apr 25, 2024): i just stumbled upon that error. first i downloaded `[Meta-Llama-3-70B-Instruct-IQ2_XS.gguf](https://huggingface.co/lmstudio-community/Meta-Llama-3-70B-Instruct-GGUF/blob/main/Meta-Llama-3-70B-Instruct-IQ2_XS.gguf)` and converted it to `llama3-70b-iq2` by using `FROM path/to/model.gguf` - this worked. then i tried to recreate the model (to change the system prompt) by creating a new model file using `FROM llama3-70b-iq2` and this failed: ``` ollama create llama3-70b-iq2-kotlin -f .\llama3-70b-iq2-kotlin transferring model data creating model layer Error: invalid file magic ```
GiteaMirror commented 2026-04-12 11:10:33 -05:00
Author
Owner
Copy Link

@twobombs commented on GitHub (May 4, 2024):

Screenshot from 2024-05-04 12-22-24

same here on the IQ3_M file - will fetch externally at runtime, but would be great if integrated at build time

<!-- gh-comment-id:2094109851 --> @twobombs commented on GitHub (May 4, 2024): ![Screenshot from 2024-05-04 12-22-24](https://github.com/ollama/ollama/assets/12692227/5684a2d8-f231-430c-9834-96117d66589c) same here on the IQ3_M file - will fetch externally at runtime, but would be great if integrated at build time
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#1339
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?