[GH-ISSUE #12693] 500 Internal Server Error: Unable to Load Model File for granite4:tiny-h #70480

Closed
opened 2026-05-04 21:40:57 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @sayedshaun on GitHub (Oct 19, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/12693

What is the issue?

When attempting to run the granite4:tiny-h model using the Ollama CLI and ChatOllama class from langchain, the command fails with a 500 Internal Server Error. The error specifically indicates an inability to load the model file located at /usr/share/ollama/.ollama/models/blobs/sha256-9811e90b0eecf2b194aafad5bb386279f338a45412a9e6f86b718cca6626c495. This issue persists despite the model appearing in the ollama list output, suggesting a potential corruption or loading issue with the model blob.

Relevant log output

ResponseError: unable to load model: /usr/share/ollama/.ollama/models/blobs/sha256-9811e90b0eecf2b194aafad5bb386279f338a45412a9e6f86b718cca6626c495 (status code: 500)

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.11.4

Originally created by @sayedshaun on GitHub (Oct 19, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/12693 ### What is the issue? When attempting to run the `granite4:tiny-h` model using the Ollama CLI and `ChatOllama` class from langchain, the command fails with a 500 Internal Server Error. The error specifically indicates an inability to load the model file located at `/usr/share/ollama/.ollama/models/blobs/sha256-9811e90b0eecf2b194aafad5bb386279f338a45412a9e6f86b718cca6626c495`. This issue persists despite the model appearing in the `ollama list` output, suggesting a potential corruption or loading issue with the model blob. ### Relevant log output ```shell ResponseError: unable to load model: /usr/share/ollama/.ollama/models/blobs/sha256-9811e90b0eecf2b194aafad5bb386279f338a45412a9e6f86b718cca6626c495 (status code: 500) ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.11.4
GiteaMirror added the bug label 2026-05-04 21:40:57 -05:00
Author
Owner

@rick-github commented on GitHub (Oct 19, 2025):

ollama 0.11.4 doesn't support granite4. Upgrade to 0.11.5 or newer.

<!-- gh-comment-id:3419750179 --> @rick-github commented on GitHub (Oct 19, 2025): ollama 0.11.4 doesn't support granite4. Upgrade to 0.11.5 or newer.
Author
Owner

@sayedshaun commented on GitHub (Oct 20, 2025):

Thank you! It worked with the updated version.

<!-- gh-comment-id:3420396591 --> @sayedshaun commented on GitHub (Oct 20, 2025): Thank you! It worked with the updated version.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#70480