[GH-ISSUE #5910] Ollama serve hangs on openai completions request #3689

Closed
opened 2026-04-12 14:30:19 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @ikamensh on GitHub (Jul 24, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/5910

What is the issue?

I was processing files locally in a loop, and at some point process just stopped moving forward. I had to do keyboard interrupt. In the terminal, this gave this entry, at the end of the log below. In the terminal running python query source, on termination I've seen it hanged in sock.receive() call.

[GIN] 2024/07/24 - 14:25:35 | 200 | 2.729474292s | 127.0.0.1 | POST "/v1/chat/completions"
[GIN] 2024/07/24 - 14:25:36 | 200 | 1.86225825s | 127.0.0.1 | POST "/v1/chat/completions"
[GIN] 2024/07/24 - 14:25:40 | 200 | 3.38871s | 127.0.0.1 | POST "/v1/chat/completions"
[GIN] 2024/07/24 - 14:25:45 | 200 | 4.8193825s | 127.0.0.1 | POST "/v1/chat/completions"
[GIN] 2024/07/24 - 14:25:47 | 200 | 2.7770215s | 127.0.0.1 | POST "/v1/chat/completions"

[GIN] 2024/07/24 - 14:31:02 | 500 | 5m14s | 127.0.0.1 | POST "/v1/chat/completions"
time=2024-07-24T14:33:00.048+02:00 level=INFO source=memory.go:309 msg="o

OS

macOS

GPU

AMD

CPU

Apple

Ollama version

0.1.48

Originally created by @ikamensh on GitHub (Jul 24, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/5910 ### What is the issue? I was processing files locally in a loop, and at some point process just stopped moving forward. I had to do keyboard interrupt. In the terminal, this gave this entry, at the end of the log below. In the terminal running python query source, on termination I've seen it hanged in sock.receive() call. [GIN] 2024/07/24 - 14:25:35 | 200 | 2.729474292s | 127.0.0.1 | POST "/v1/chat/completions" [GIN] 2024/07/24 - 14:25:36 | 200 | 1.86225825s | 127.0.0.1 | POST "/v1/chat/completions" [GIN] 2024/07/24 - 14:25:40 | 200 | 3.38871s | 127.0.0.1 | POST "/v1/chat/completions" [GIN] 2024/07/24 - 14:25:45 | 200 | 4.8193825s | 127.0.0.1 | POST "/v1/chat/completions" [GIN] 2024/07/24 - 14:25:47 | 200 | 2.7770215s | 127.0.0.1 | POST "/v1/chat/completions" [GIN] 2024/07/24 - 14:31:02 | 500 | 5m14s | 127.0.0.1 | POST "/v1/chat/completions" time=2024-07-24T14:33:00.048+02:00 level=INFO source=memory.go:309 msg="o ### OS macOS ### GPU AMD ### CPU Apple ### Ollama version 0.1.48
GiteaMirror added the bug label 2026-04-12 14:30:19 -05:00
Author
Owner

@jmorganca commented on GitHub (Jul 30, 2024):

@ikamensh do you have the remaining logs after time=2024-07-24T14:33:00.048+02:00 level=INFO source=memory.go:309 msg="o? This would help us debug 😊

<!-- gh-comment-id:2258781608 --> @jmorganca commented on GitHub (Jul 30, 2024): @ikamensh do you have the remaining logs after `time=2024-07-24T14:33:00.048+02:00 level=INFO source=memory.go:309 msg="o`? This would help us debug 😊
Author
Owner

@ikamensh commented on GitHub (Jul 30, 2024):

Is there some log file locally? I didn't notice I've missed something in copy paste. If it reoccurs I could paste more

<!-- gh-comment-id:2258880692 --> @ikamensh commented on GitHub (Jul 30, 2024): Is there some log file locally? I didn't notice I've missed something in copy paste. If it reoccurs I could paste more
Author
Owner

@royjhan commented on GitHub (Jul 30, 2024):

@ikamensh https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md

<!-- gh-comment-id:2258883594 --> @royjhan commented on GitHub (Jul 30, 2024): @ikamensh https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md
Author
Owner

@ikamensh commented on GitHub (Jul 31, 2024):

server.log surprisingly has the oldest and latest entries but not from the date this happened. It has some stuff from when I just installed ollama (June) and late July 28-30. if it reoccurs I will post whats in the logs.

<!-- gh-comment-id:2259695540 --> @ikamensh commented on GitHub (Jul 31, 2024): server.log surprisingly has the oldest and latest entries but not from the date this happened. It has some stuff from when I just installed ollama (June) and late July 28-30. if it reoccurs I will post whats in the logs.
Author
Owner

@jmorganca commented on GitHub (Sep 4, 2024):

@ikamensh is this still happening? If so let me know and I can re-open. Version 0.1.48 is quite old – I'd recommend upgrading and then let us know if the issue still persists and I can re-open this.

<!-- gh-comment-id:2327881306 --> @jmorganca commented on GitHub (Sep 4, 2024): @ikamensh is this still happening? If so let me know and I can re-open. Version 0.1.48 is quite old – I'd recommend upgrading and then let us know if the issue still persists and I can re-open this.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#3689