[GH-ISSUE #8500] when using gguf files of qwen2-vl,something wrong happen:Error: invalid file magic! #5478

Closed
opened 2026-04-12 16:42:29 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @twythebest on GitHub (Jan 20, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/8500

I have download two files:mmproj-model-f32.gguf and Qwen2-VL-7B-Instruct-Q8_0.gguf. Here is my modelfile:
FROM ./mmproj-model-f32.gguf
FROM ./Qwen2-VL-7B-Instruct-Q8_0.gguf

TEMPLATE """{{- range $index, $_ := .Messages }}<|start_header_id|>{{ .Role }}<|end_header_id|>

{{ .Content }}
{{- if gt (len (slice $.Messages $index)) 1 }}<|eot_id|>
{{- else if ne .Role "assistant" }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{{ end }}
{{- end }}"""

PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
when I use comand:ollama create qwen2-vl -f config.txt,error shows:'Error: invalid file magic'!
please help me solve thids problem,thanks!

Originally created by @twythebest on GitHub (Jan 20, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/8500 I have download two files:mmproj-model-f32.gguf and Qwen2-VL-7B-Instruct-Q8_0.gguf. Here is my modelfile: FROM ./mmproj-model-f32.gguf FROM ./Qwen2-VL-7B-Instruct-Q8_0.gguf TEMPLATE """{{- range $index, $_ := .Messages }}<|start_header_id|>{{ .Role }}<|end_header_id|> {{ .Content }} {{- if gt (len (slice $.Messages $index)) 1 }}<|eot_id|> {{- else if ne .Role "assistant" }}<|eot_id|><|start_header_id|>assistant<|end_header_id|> {{ end }} {{- end }}""" PARAMETER stop "<|im_start|>" PARAMETER stop "<|im_end|>" when I use comand:ollama create qwen2-vl -f config.txt,error shows:'Error: invalid file magic'! please help me solve thids problem,thanks!
Author
Owner

@rick-github commented on GitHub (Jan 20, 2025):

qwen2-vl is not supported by ollama yet, https://github.com/ollama/ollama/issues/6564

<!-- gh-comment-id:2602180464 --> @rick-github commented on GitHub (Jan 20, 2025): qwen2-vl is not supported by ollama yet, https://github.com/ollama/ollama/issues/6564
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#5478