[GH-ISSUE #6888] an unknown error was encountered while running the model #66397

Open
opened 2026-05-04 03:49:29 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @ghost on GitHub (Sep 20, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6888

What is the issue?

API returns error message which does not tell what is wrong.

Reproduce:

install model llava:13b-v1.5-q4_0

save this file:
req-data.txt

run this command:
curl -d "`cat req-data.txt`" http://localhost:11434/api/generate

API responds with:
{"error":"an unknown error was encountered while running the model "}

OS

Linux

GPU

Nvidia

CPU

AMD

Ollama version

0.3.10

Originally created by @ghost on GitHub (Sep 20, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6888 ### What is the issue? API returns error message which does not tell what is wrong. Reproduce: install model llava:13b-v1.5-q4_0 save this file: [req-data.txt](https://github.com/user-attachments/files/17068575/req-data.txt) run this command: ```curl -d "`cat req-data.txt`" http://localhost:11434/api/generate``` API responds with: {"error":"an unknown error was encountered while running the model "} ### OS Linux ### GPU Nvidia ### CPU AMD ### Ollama version 0.3.10
GiteaMirror added the bug label 2026-05-04 03:49:29 -05:00
Author
Owner

@ghost commented on GitHub (Sep 20, 2024):

with this request it just hangs and doesnt return anything
req-data2.txt

<!-- gh-comment-id:2362553985 --> @ghost commented on GitHub (Sep 20, 2024): with this request it just hangs and doesnt return anything [req-data2.txt](https://github.com/user-attachments/files/17068770/req-data2.txt)
Author
Owner

@ghost commented on GitHub (Sep 20, 2024):

reducing number of characters in prompt results into proper response

this one works:
req-data-ok.txt

<!-- gh-comment-id:2362557182 --> @ghost commented on GitHub (Sep 20, 2024): reducing number of characters in prompt results into proper response this one works: [req-data-ok.txt](https://github.com/user-attachments/files/17068784/req-data-ok.txt)
Author
Owner

@ghost commented on GitHub (Sep 20, 2024):

my guess is that request is too large compared to context size limit.

the error message could be better.

<!-- gh-comment-id:2362559245 --> @ghost commented on GitHub (Sep 20, 2024): my guess is that request is too large compared to context size limit. the error message could be better.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#66397