[GH-ISSUE #9533] Ollama stop processing request without error. #6219

Open
opened 2026-04-12 17:37:20 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @ricky-bug on GitHub (Mar 6, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9533

What is the issue?

I used qwen:7b to extract somethings from thousands of text ,but it stopped processing request unpredictably with no error returned.

Relevant log output

Here is the log. The last response occurred after i stopped my programe.
[GIN] 2025/03/06 - 11:05:50 | 200 | 1.3655709s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:05:51 | 200 | 1.3723884s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:05:53 | 200 | 1.3856899s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:05:54 | 200 | 1.3489615s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:05:56 | 200 | 1.613231s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:05:57 | 200 | 1.3488688s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:05:58 | 200 | 1.3488556s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:06:00 | 200 | 1.3483834s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:06:01 | 200 | 1.3736995s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:06:02 | 200 | 1.3468758s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:06:04 | 200 | 1.343276s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:06:05 | 200 | 1.3512894s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:06:07 | 200 | 1.3640879s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:06:08 | 200 | 1.3514527s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 11:06:10 | 200 | 2.4528513s | 127.0.0.1 | POST "/api/chat"
[GIN] 2025/03/06 - 13:19:39 | 200 | 2h13m28s | 127.0.0.1 | POST "/api/chat"

OS

No response

GPU

Nvidia

CPU

Intel

Ollama version

0.5.7

Originally created by @ricky-bug on GitHub (Mar 6, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9533 ### What is the issue? I used qwen:7b to extract somethings from thousands of text ,but it stopped processing request unpredictably with no error returned. ### Relevant log output ```shell Here is the log. The last response occurred after i stopped my programe. [GIN] 2025/03/06 - 11:05:50 | 200 | 1.3655709s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:05:51 | 200 | 1.3723884s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:05:53 | 200 | 1.3856899s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:05:54 | 200 | 1.3489615s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:05:56 | 200 | 1.613231s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:05:57 | 200 | 1.3488688s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:05:58 | 200 | 1.3488556s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:06:00 | 200 | 1.3483834s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:06:01 | 200 | 1.3736995s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:06:02 | 200 | 1.3468758s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:06:04 | 200 | 1.343276s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:06:05 | 200 | 1.3512894s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:06:07 | 200 | 1.3640879s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:06:08 | 200 | 1.3514527s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 11:06:10 | 200 | 2.4528513s | 127.0.0.1 | POST "/api/chat" [GIN] 2025/03/06 - 13:19:39 | 200 | 2h13m28s | 127.0.0.1 | POST "/api/chat" ``` ### OS _No response_ ### GPU Nvidia ### CPU Intel ### Ollama version 0.5.7
GiteaMirror added the bug label 2026-04-12 17:37:20 -05:00
Author
Owner

@farzadsbmila commented on GitHub (Jun 2, 2025):

I have a similar situation.
Running Ollama (0.9.0) for the first time on a new system.
ollama serve and ollama run llama3.2:1b (and other models) work, but the server is unresponsive. After I interrupt a request using control-C, a log entry shows up on the server with a 200 status code for the chat endpoint, but a response is never returned. i tried with curl and the prompt from ollama run.
Using python 3.12.9, cuda 12.6.0, Ubuntu 22.04.3 LTS, Nvidia l40s (also tried with RTX8000).

<!-- gh-comment-id:2932848137 --> @farzadsbmila commented on GitHub (Jun 2, 2025): I have a similar situation. Running Ollama (`0.9.0`) for the first time on a new system. `ollama serve` and `ollama run llama3.2:1b` (and other models) work, but the server is unresponsive. After I interrupt a request using control-C, a log entry shows up on the server with a `200` status code for the `chat` endpoint, but a response is never returned. i tried with `curl` and the prompt from `ollama run`. Using `python 3.12.9`, `cuda 12.6.0`, `Ubuntu 22.04.3 LTS`, `Nvidia l40s` (also tried with `RTX8000`).
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#6219