github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-07-16 05:05:37 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #3813] Error: Models based on 'Qwen2ForCausalLM' are not yet supported #80037

New Issue
Closed
opened 2026-05-09 08:07:46 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-05-09 08:07:46 -05:00
Owner
Copy Link

Originally created by @VidyasagarDudekula on GitHub (Apr 22, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3813

What is the issue?

When I ran a this command:- ollama create qwen-14b-quant -f /home/vidyasagar/rr/ModelFile.txt

the text file consists of:-
FROM /home/user/rr/quantized_14_b_awq

TEMPLATE """{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>{{ end }}<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""

SYSTEM """"""

PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>

This is the terminal output:-
transferring model data
unpacking model metadata
Error: Models based on 'Qwen2ForCausalLM' are not yet supported

But I see there are the Qwen 1.5 supported models, Then why mine is not working?
can someone explain this? am I doing anything wrong?

OS

Linux

GPU

Nvidia

CPU

AMD

Ollama version

0.1.32

Originally created by @VidyasagarDudekula on GitHub (Apr 22, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3813 ### What is the issue? When I ran a this command:- ollama create qwen-14b-quant -f /home/vidyasagar/rr/ModelFile.txt the text file consists of:- FROM /home/user/rr/quantized_14_b_awq TEMPLATE """{{ if .System }}<|im_start|>system {{ .System }}<|im_end|>{{ end }}<|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant """ SYSTEM """""" PARAMETER stop <|im_start|> PARAMETER stop <|im_end|> This is the terminal output:- transferring model data unpacking model metadata Error: Models based on 'Qwen2ForCausalLM' are not yet supported But I see there are the Qwen 1.5 supported models, Then why mine is not working? can someone explain this? am I doing anything wrong? ### OS Linux ### GPU Nvidia ### CPU AMD ### Ollama version 0.1.32
GiteaMirror added the bug label 2026-05-09 08:07:46 -05:00
GiteaMirror commented 2026-05-09 08:07:50 -05:00
Author
Owner
Copy Link

@thinkverse commented on GitHub (Apr 22, 2024):

Afaik the Qwen 1.5 versions on Ollama are Qwen 2, look at family in the model layer and it says qwen2, might be that Ollama doesn't support the AWQ versions. 🤷‍♂️

I tried converting the 7B AWQ version with llama.cpp and that didn't work either and it doesn't seem to be an official GGUF of the 14b AWQ version, which model did you use?

Screenshot 2024-04-22 at 17 33 17
<!-- gh-comment-id:2069922948 --> @thinkverse commented on GitHub (Apr 22, 2024): Afaik the [Qwen 1.5](https://ollama.com/library/qwen) versions on Ollama are Qwen 2, look at `family` in the `model` layer and it says `qwen2`, might be that Ollama doesn't support the AWQ versions. 🤷‍♂️ I tried converting the 7B AWQ version with llama.cpp and that didn't work either and it doesn't seem to be an official GGUF of the 14b AWQ version, which model did you use? <img width="900" alt="Screenshot 2024-04-22 at 17 33 17" src="https://github.com/ollama/ollama/assets/2221746/a61c375f-383d-4842-93f3-5f23feb46fc0">
GiteaMirror commented 2026-05-09 08:07:53 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jan 19, 2026):

AWQ quantization is not currently supported by ollama.

<!-- gh-comment-id:3768866926 --> @rick-github commented on GitHub (Jan 19, 2026): AWQ quantization is not currently supported by ollama.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#80037
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?