[GH-ISSUE #12648] The latest version of ollama cannot use the previously installed gguf model #8395

Closed
opened 2026-04-12 21:02:37 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @nkinfe on GitHub (Oct 16, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/12648

What is the issue?

Error message: Error: 500 Internal Server Error: llama runner process has terminated: exit status 2.

hf.co/mradermacher/Hunyuan-MT-7B-GGUF:Q4_K_M,It can still be used before, and find a solution

Relevant log output


OS

No response

GPU

No response

CPU

No response

Ollama version

No response

Originally created by @nkinfe on GitHub (Oct 16, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/12648 ### What is the issue? Error message: Error: 500 Internal Server Error: llama runner process has terminated: exit status 2. hf.co/mradermacher/Hunyuan-MT-7B-GGUF:Q4_K_M,It can still be used before, and find a solution ### Relevant log output ```shell ``` ### OS _No response_ ### GPU _No response_ ### CPU _No response_ ### Ollama version _No response_
GiteaMirror added the needs more infobug labels 2026-04-12 21:02:37 -05:00
Author
Owner

@rick-github commented on GitHub (Oct 16, 2025):

Server log may help in debugging.

<!-- gh-comment-id:3410119216 --> @rick-github commented on GitHub (Oct 16, 2025): [Server log](https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#how-to-troubleshoot-issues) may help in debugging.
Author
Owner

@HeylonNHP commented on GitHub (Oct 18, 2025):

I'm having the same issue with ollama 0.12.6 too. Really annoying as some of these gguf models aren't available from the ollama models page.

<!-- gh-comment-id:3418621506 --> @HeylonNHP commented on GitHub (Oct 18, 2025): I'm having the same issue with ollama 0.12.6 too. Really annoying as some of these gguf models aren't available from the ollama models page.
Author
Owner

@rick-github commented on GitHub (Oct 18, 2025):

Server log may help in debugging.

<!-- gh-comment-id:3419055896 --> @rick-github commented on GitHub (Oct 18, 2025): [Server log](https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#how-to-troubleshoot-issues) may help in debugging.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#8395