[GH-ISSUE #4786] Error: invalid file magic for IQ2_M.gguf based models #65052

Open
opened 2026-05-03 19:39:11 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @Greatz08 on GitHub (Jun 2, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4786

https://huggingface.co/bartowski/Codestral-22B-v0.1-GGUF

From this hugging face repo i downloaded - Codestral-22B-v0.1-IQ2_M.gguf this model , But when i tried to build with ollama it give me Error: invalid file magic . I did research in ollama issues and many IQ models support were added thanks to devs but this IQ2_M support i couldnt see so creating this issue here so that support for this type of model can be added to ollama so that many more can test type of quantized model.
This variant is much better than some supported ones by ollama like IQ2_XS so addition of this variant will help them in choosing better too in my opinion saying on basis of this data :
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

Thankyou very much for this awesome project devs :-))

Originally created by @Greatz08 on GitHub (Jun 2, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4786 https://huggingface.co/bartowski/Codestral-22B-v0.1-GGUF From this hugging face repo i downloaded - Codestral-22B-v0.1-IQ2_M.gguf this model , But when i tried to build with ollama it give me Error: invalid file magic . I did research in ollama issues and many IQ models support were added thanks to devs but this IQ2_M support i couldnt see so creating this issue here so that support for this type of model can be added to ollama so that many more can test type of quantized model. This variant is much better than some supported ones by ollama like IQ2_XS so addition of this variant will help them in choosing better too in my opinion saying on basis of this data : https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 Thankyou very much for this awesome project devs :-))
GiteaMirror added the model label 2026-05-03 19:39:11 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#65052