[GH-ISSUE #6135] When processing long texts, it freezes and there is no response. #3831

Closed
opened 2026-04-12 14:39:55 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @jiaguangqi on GitHub (Aug 2, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6135

What is the issue?

I am using Ollama to run llama3.1:70b. When processing long texts, it freezes and there is no response. I have checked the server’s CPU, memory, and GPU usage, and they are all low. What could be the problem?

OS

Linux

GPU

Nvidia

CPU

AMD

Ollama version

0.1.30

Originally created by @jiaguangqi on GitHub (Aug 2, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6135 ### What is the issue? I am using Ollama to run llama3.1:70b. When processing long texts, it freezes and there is no response. I have checked the server’s CPU, memory, and GPU usage, and they are all low. What could be the problem? ### OS Linux ### GPU Nvidia ### CPU AMD ### Ollama version 0.1.30
GiteaMirror added the bug label 2026-04-12 14:39:55 -05:00
Author
Owner

@rick-github commented on GitHub (Aug 2, 2024):

Server logs may help in debugging.

<!-- gh-comment-id:2264924227 --> @rick-github commented on GitHub (Aug 2, 2024): [Server logs](https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#how-to-troubleshoot-issues) may help in debugging.
Author
Owner

@igorschlum commented on GitHub (Aug 2, 2024):

@jiaguangqi and please test with 0.3.3, ollama 0.1.3 is October, 13th 2023, unless you wanted to type 0.3.1

<!-- gh-comment-id:2266146829 --> @igorschlum commented on GitHub (Aug 2, 2024): @jiaguangqi and please test with 0.3.3, ollama 0.1.3 is October, 13th 2023, unless you wanted to type 0.3.1
Author
Owner

@jiaguangqi commented on GitHub (Aug 8, 2024):

how to upgrade?

---Original---
From: "Igor @.>
Date: Sat, Aug 3, 2024 05:08 AM
To: @.
>;
Cc: @.@.>;
Subject: Re: [ollama/ollama] When processing long texts, it freezes and thereis no response. (Issue #6135)

@jiaguangqi and please test with 0.3.3, ollama 0.1.3 is October, 13th 2023, unless you wanted to type 0.3.1


Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: @.***>

<!-- gh-comment-id:2276088043 --> @jiaguangqi commented on GitHub (Aug 8, 2024): how to upgrade? ---Original--- From: "Igor ***@***.***&gt; Date: Sat, Aug 3, 2024 05:08 AM To: ***@***.***&gt;; Cc: ***@***.******@***.***&gt;; Subject: Re: [ollama/ollama] When processing long texts, it freezes and thereis no response. (Issue #6135) @jiaguangqi and please test with 0.3.3, ollama 0.1.3 is October, 13th 2023, unless you wanted to type 0.3.1 — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***&gt;
Author
Owner
<!-- gh-comment-id:2276095006 --> @rick-github commented on GitHub (Aug 8, 2024): https://github.com/ollama/ollama/blob/main/docs/faq.md#how-can-i-upgrade-ollama
Author
Owner

@pdevine commented on GitHub (Sep 13, 2024):

@jiaguangqi what was happening was most likely a context shift. When the context fills up, part of the context has to be lopped off in order to keep processing. I don't remember the performance characteristics for the version you are using though given that is almost a year ago 😅

I'll close the issue for now, but feel free to keep commenting and we can reopen if you're still seeing a problem.

<!-- gh-comment-id:2349740693 --> @pdevine commented on GitHub (Sep 13, 2024): @jiaguangqi what was happening was most likely a context shift. When the context fills up, part of the context has to be lopped off in order to keep processing. I don't remember the performance characteristics for the version you are using though given that is almost a year ago 😅 I'll close the issue for now, but feel free to keep commenting and we can reopen if you're still seeing a problem.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#3831