github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 00:22:43 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #15475] Help about 500 Internal Server Error #56405

New Issue
Open
opened 2026-04-29 10:46:39 -05:00 by GiteaMirror · 9 comments
GiteaMirror commented 2026-04-29 10:46:39 -05:00
Owner
Copy Link

Originally created by @Fuhua-code on GitHub (Apr 10, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/15475

server.log

What is the issue?

I need to convert the GUFF model I downloaded from modelscope into a version that matches with ollama. To do this, I have written a Modelfile:
FROM "D:\LLM\llama_cpp\qwen-vl-4b\Qwen3VL-4B-Instruct-Q4_K_M.gguf"
ADAPTER "D:\LLM\llama_cpp\qwen-vl-4b\mmproj-Qwen3VL-4B-Instruct-F16.gguf"
PARAMETER num_ctx 8192
After running and waiting for Olama to successfully complete the model conversion, I ran the model but encountered the following error:
Error: 500 Internal Server Error: model runner has unexpectedly stopped, this may be due to resource limitations or an internal error, check ollama server logs for details
This article is machine translation.

Relevant log output

OS

windows 11 24H2

GPU

4060 laptop

CPU

i9-13900H

Ollama version

0.20.5

Originally created by @Fuhua-code on GitHub (Apr 10, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/15475 [server.log](https://github.com/user-attachments/files/26631077/server.log) ### What is the issue? I need to convert the GUFF model I downloaded from modelscope into a version that matches with ollama. To do this, I have written a Modelfile: FROM "D:\LLM\llama_cpp\qwen-vl-4b\Qwen3VL-4B-Instruct-Q4_K_M.gguf" ADAPTER "D:\LLM\llama_cpp\qwen-vl-4b\mmproj-Qwen3VL-4B-Instruct-F16.gguf" PARAMETER num_ctx 8192 After running and waiting for Olama to successfully complete the model conversion, I ran the model but encountered the following error: Error: 500 Internal Server Error: model runner has unexpectedly stopped, this may be due to resource limitations or an internal error, check ollama server logs for details This article is machine translation. ### Relevant log output ```shell ``` ### OS windows 11 24H2 ### GPU 4060 laptop ### CPU i9-13900H ### Ollama version 0.20.5
GiteaMirror added the bug label 2026-04-29 10:46:39 -05:00
GiteaMirror commented 2026-04-29 10:46:44 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Apr 10, 2026):

Server logs will aid in debugging.

But it looks like you are trying to import a standard q4_K_M quant of Qwen3VL-4B-instruct, why not just use the one from the ollama library?

ollama pull qwen3-vl:4b-instruct-q4_K_M
echo FROM qwen3-vl:4b-instruct-q4_K_M > Modelfile
echo PARAMETER num_ctx 8192 >> Modelfile
ollama create qwen3-vl:4b-instruct-8k-q4_K_M
<!-- gh-comment-id:4223894907 --> @rick-github commented on GitHub (Apr 10, 2026): [Server logs](https://docs.ollama.com/troubleshooting) will aid in debugging. But it looks like you are trying to import a standard q4_K_M quant of Qwen3VL-4B-instruct, why not just use the one from the ollama library? ``` ollama pull qwen3-vl:4b-instruct-q4_K_M echo FROM qwen3-vl:4b-instruct-q4_K_M > Modelfile echo PARAMETER num_ctx 8192 >> Modelfile ollama create qwen3-vl:4b-instruct-8k-q4_K_M ```
GiteaMirror commented 2026-04-29 10:46:45 -05:00
Author
Owner
Copy Link

@Fuhua-code commented on GitHub (Apr 10, 2026):

Server logs will aid in debugging.

But it looks like you are trying to import a standard q4_K_M quant of Qwen3VL-4B-instruct, why not just use the one from the ollama library?

ollama pull qwen3-vl:4b-instruct-q4_K_M
echo FROM qwen3-vl:4b-instruct-q4_K_M > Modelfile
echo PARAMETER num_ctx 8192 >> Modelfile
ollama create qwen3-vl:4b-instruct-8k-q4_K_M

I have uploaded the server. log, thank you for the reminder.

Yes, I am downloading this, but the download speed of the model using Olama in my network environment is very slow.

Or is there any other way to download the models of Ollama?

<!-- gh-comment-id:4223937219 --> @Fuhua-code commented on GitHub (Apr 10, 2026): > [Server logs](https://docs.ollama.com/troubleshooting) will aid in debugging. > > But it looks like you are trying to import a standard q4_K_M quant of Qwen3VL-4B-instruct, why not just use the one from the ollama library? > > ``` > ollama pull qwen3-vl:4b-instruct-q4_K_M > echo FROM qwen3-vl:4b-instruct-q4_K_M > Modelfile > echo PARAMETER num_ctx 8192 >> Modelfile > ollama create qwen3-vl:4b-instruct-8k-q4_K_M > ``` I have uploaded the server. log, thank you for the reminder. Yes, I am downloading this, but the download speed of the model using Olama in my network environment is very slow. Or is there any other way to download the models of Ollama?
GiteaMirror commented 2026-04-29 10:46:46 -05:00
Author
Owner
Copy Link

@PureBlissAK commented on GitHub (Apr 18, 2026):

🤖 Automated Triage & Analysis Report

Issue: #15475
Analyzed: 2026-04-18T18:20:53.997640

Analysis

  • Type: unknown
  • Severity: medium
  • Components: unknown

Implementation Plan

  • Effort: medium
  • Steps:

This issue has been triaged and marked for implementation.

<!-- gh-comment-id:4274307380 --> @PureBlissAK commented on GitHub (Apr 18, 2026): <!-- ollama-issue-orchestrator:v1 issue:15475 --> ## 🤖 Automated Triage & Analysis Report **Issue**: #15475 **Analyzed**: 2026-04-18T18:20:53.997640 ### Analysis - **Type**: unknown - **Severity**: medium - **Components**: unknown ### Implementation Plan - **Effort**: medium - **Steps**: *This issue has been triaged and marked for implementation.*
GiteaMirror commented 2026-04-29 10:46:46 -05:00
Author
Owner
Copy Link

@yangqiheng2019 commented on GitHub (Apr 24, 2026):

hello，do you resolve this issue？I encountered the same issue you did.

<!-- gh-comment-id:4310377883 --> @yangqiheng2019 commented on GitHub (Apr 24, 2026): hello，do you resolve this issue？I encountered the same issue you did.
GiteaMirror commented 2026-04-29 10:46:47 -05:00
Author
Owner
Copy Link

@Fuhua-code commented on GitHub (Apr 24, 2026):

hello，do you resolve this issue？I encountered the same issue you did.

I couldn't solve it, so in the end I had to download the model from the Ollama official website.

没有解决，最后在ollama官方库下载的

<!-- gh-comment-id:4312697884 --> @Fuhua-code commented on GitHub (Apr 24, 2026): > hello，do you resolve this issue？I encountered the same issue you did. I couldn't solve it, so in the end I had to download the model from the Ollama official website. 没有解决，最后在ollama官方库下载的
GiteaMirror commented 2026-04-29 10:46:47 -05:00
Author
Owner
Copy Link

@yangqiheng2019 commented on GitHub (Apr 27, 2026):

hello，do you resolve this issue？I encountered the same issue you did.

I couldn't solve it, so in the end I had to download the model from the Ollama official website.

没有解决，最后在ollama官方库下载的

谢谢，我查询了一下，可能是缺少一个视觉编码器，不知道这个怎么解决

<!-- gh-comment-id:4324398704 --> @yangqiheng2019 commented on GitHub (Apr 27, 2026): > > hello，do you resolve this issue？I encountered the same issue you did. > > I couldn't solve it, so in the end I had to download the model from the Ollama official website. > > 没有解决，最后在ollama官方库下载的 谢谢，我查询了一下，可能是缺少一个视觉编码器，不知道这个怎么解决
GiteaMirror commented 2026-04-29 10:46:48 -05:00
Author
Owner
Copy Link

@Fuhua-code commented on GitHub (Apr 27, 2026):

hello，do you resolve this issue？I encountered the same issue you did.

I couldn't solve it, so in the end I had to download the model from the Ollama official website.

没有解决，最后在ollama官方库下载的

谢谢，我查询了一下，可能是缺少一个视觉编码器，不知道这个怎么解决

ollama提供的命令是可以把那个视觉模块转化为哈希文件的，但我在实际使用时依然报这个错😇

<!-- gh-comment-id:4324409044 --> @Fuhua-code commented on GitHub (Apr 27, 2026): > > > hello，do you resolve this issue？I encountered the same issue you did. > > > > I couldn't solve it, so in the end I had to download the model from the Ollama official website. > > > > 没有解决，最后在ollama官方库下载的 > > 谢谢，我查询了一下，可能是缺少一个视觉编码器，不知道这个怎么解决 ollama提供的命令是可以把那个视觉模块转化为哈希文件的，但我在实际使用时依然报这个错😇
GiteaMirror commented 2026-04-29 10:46:48 -05:00
Author
Owner
Copy Link

@yangqiheng2019 commented on GitHub (Apr 27, 2026):

hello，do you resolve this issue？I encountered the same issue you did.

I couldn't solve it, so in the end I had to download the model from the Ollama official website.
没有解决，最后在ollama官方库下载的

谢谢，我查询了一下，可能是缺少一个视觉编码器，不知道这个怎么解决

ollama提供的命令是可以把那个视觉模块转化为哈希文件的，但我在实际使用时依然报这个错😇
我也是，关键我的是自己训练的，没法用官方库的东西

<!-- gh-comment-id:4326403754 --> @yangqiheng2019 commented on GitHub (Apr 27, 2026): > > > > hello，do you resolve this issue？I encountered the same issue you did. > > > > > > > > > I couldn't solve it, so in the end I had to download the model from the Ollama official website. > > > 没有解决，最后在ollama官方库下载的 > > > > > > 谢谢，我查询了一下，可能是缺少一个视觉编码器，不知道这个怎么解决 > > ollama提供的命令是可以把那个视觉模块转化为哈希文件的，但我在实际使用时依然报这个错😇 我也是，关键我的是自己训练的，没法用官方库的东西
GiteaMirror commented 2026-04-29 10:46:49 -05:00
Author
Owner
Copy Link

@Fuhua-code commented on GitHub (Apr 27, 2026):

hello，do you resolve this issue？I encountered the same issue you did.

I couldn't solve it, so in the end I had to download the model from the Ollama official website.
没有解决，最后在ollama官方库下载的

谢谢，我查询了一下，可能是缺少一个视觉编码器，不知道这个怎么解决

ollama提供的命令是可以把那个视觉模块转化为哈希文件的，但我在实际使用时依然报这个错😇
我也是，关键我的是自己训练的，没法用官方库的东西

那可能得用LLM.cpp或者LLM STUDIO来部署了

<!-- gh-comment-id:4327437225 --> @Fuhua-code commented on GitHub (Apr 27, 2026): > > > > > hello，do you resolve this issue？I encountered the same issue you did. > > > > > > > > > > > > I couldn't solve it, so in the end I had to download the model from the Ollama official website. > > > > 没有解决，最后在ollama官方库下载的 > > > > > > > > > 谢谢，我查询了一下，可能是缺少一个视觉编码器，不知道这个怎么解决 > > > > ollama提供的命令是可以把那个视觉模块转化为哈希文件的，但我在实际使用时依然报这个错😇 > 我也是，关键我的是自己训练的，没法用官方库的东西 > 那可能得用LLM.cpp或者LLM STUDIO来部署了
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#56405
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?