[GH-ISSUE #5014] Models based on 'Qwen2ForCausalLM' are not yet supported #3173

Open
opened 2026-04-12 13:39:43 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @antlaborli on GitHub (Jun 13, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/5014

What is the issue?

I have downloaded the Qwen2-7b modle file(file type:safetensor), then using ollama create to load modle[ollama create QWEN2-7B -f qwen7b.modefile], the following is modle file content: FROM /app/antlaobr/models/Qwen2-7B
but get the follow error:

(base) antlabor@gpu001:/app/antlabor/models$ ollama create QWEN2-7B -f qwen7b.modefile
transferring model data
unpacking model metadata
Error: Models based on 'Qwen2ForCausalLM' are not yet supported

pls help me to solve this

OS

Linux

GPU

Nvidia

CPU

No response

Ollama version

0.1.43

Originally created by @antlaborli on GitHub (Jun 13, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/5014 ### What is the issue? I have downloaded the Qwen2-7b modle file(file type:safetensor), then using ollama create to load modle[ollama create QWEN2-7B -f qwen7b.modefile], the following is modle file content: FROM /app/antlaobr/models/Qwen2-7B but get the follow error: (base) antlabor@gpu001:/app/antlabor/models$ ollama create QWEN2-7B -f qwen7b.modefile transferring model data unpacking model metadata Error: Models based on 'Qwen2ForCausalLM' are not yet supported pls help me to solve this ### OS Linux ### GPU Nvidia ### CPU _No response_ ### Ollama version 0.1.43
GiteaMirror added the bug label 2026-04-12 13:39:44 -05:00
Author
Owner

@byebyebruce commented on GitHub (Aug 1, 2024):

You should convert model to gguf type at first. Check out here

<!-- gh-comment-id:2262113277 --> @byebyebruce commented on GitHub (Aug 1, 2024): You should convert model to gguf type at first. Check out [here](https://github.com/ggerganov/llama.cpp/blob/master/examples/quantize/README.md)
Author
Owner

@Sakurasilent commented on GitHub (Nov 15, 2024):

+1

<!-- gh-comment-id:2477882747 --> @Sakurasilent commented on GitHub (Nov 15, 2024): +1
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#3173