[GH-ISSUE #913] Modelfile invalid version #46956

Closed
opened 2026-04-28 02:15:57 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @eduardofarina on GitHub (Oct 26, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/913

I've finetuned a llama2 model and applied this step here https://github.com/jmorganca/ollama/blob/main/docs/import.md#step-2-convert-and-quantize-to-a-bin-file-optional-for-pytorch-and-safetensors to generate de q4_0.bin file However my Modelfile that contains FROM ./q4_0.bin TEMPLATE "[INST] {{ .Prompt }} [/INST]" when I run ollama create llama_ft -f Modelfile appear parsing modelfile looking for model ⠋ creating model layer Error: invalid version

Originally created by @eduardofarina on GitHub (Oct 26, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/913 I've finetuned a llama2 model and applied this step here https://github.com/jmorganca/ollama/blob/main/docs/import.md#step-2-convert-and-quantize-to-a-bin-file-optional-for-pytorch-and-safetensors to generate de q4_0.bin file However my Modelfile that contains `FROM ./q4_0.bin TEMPLATE "[INST] {{ .Prompt }} [/INST]"` when I run ` ollama create llama_ft -f Modelfile` appear `parsing modelfile looking for model ⠋ creating model layer Error: invalid version`
Author
Owner

@mxyng commented on GitHub (Oct 26, 2023):

This is likely because the bin file is ggufv3 which is incompatible with ollama version v0.1.3 and earlier. Can you update ollama to the latest version and retry?

<!-- gh-comment-id:1781453164 --> @mxyng commented on GitHub (Oct 26, 2023): This is likely because the bin file is ggufv3 which is incompatible with ollama version v0.1.3 and earlier. Can you update ollama to the latest version and retry?
Author
Owner

@eduardofarina commented on GitHub (Oct 26, 2023):

Thanks, it worked. Only installed it again curl https://ollama.ai/install.sh | sh

<!-- gh-comment-id:1781518596 --> @eduardofarina commented on GitHub (Oct 26, 2023): Thanks, it worked. Only installed it again `curl https://ollama.ai/install.sh | sh`
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#46956