[GH-ISSUE #1338] response with forever loop <s> #696

Closed
opened 2026-04-12 10:22:20 -05:00 by GiteaMirror · 6 comments
Owner

Originally created by @yangboz on GitHub (Dec 1, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/1338

when testing llama2 or other models pulled from https://ollama.ai/library
after successfully running the model mix languages , we can see the "" sometime displayed on console forever results to blank loop forever.

any idea ?

Originally created by @yangboz on GitHub (Dec 1, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/1338 when testing llama2 or other models pulled from https://ollama.ai/library after successfully running the model mix languages , we can see the "<s>" sometime displayed on console forever results to blank loop forever. any idea ?
GiteaMirror added the bug label 2026-04-12 10:22:20 -05:00
Author
Owner

@mchiang0610 commented on GitHub (Dec 1, 2023):

Hi,

Would it be possible for you to pull the llama2 you have again? (using ollama pull) I just want to make sure you have the latest.

which version of ollama are you running? Can check via ( ollama -v )

<!-- gh-comment-id:1836530458 --> @mchiang0610 commented on GitHub (Dec 1, 2023): Hi, Would it be possible for you to pull the llama2 you have again? (using ollama pull) I just want to make sure you have the latest. which version of ollama are you running? Can check via ( `ollama -v` )
Author
Owner

@yangboz commented on GitHub (Dec 2, 2023):

yangboz@macdeMBP ebook % ollama -v
ollama version 0.1.3

<!-- gh-comment-id:1836981022 --> @yangboz commented on GitHub (Dec 2, 2023): yangboz@macdeMBP ebook % ollama -v ollama version 0.1.3
Author
Owner

@yugame commented on GitHub (Dec 2, 2023):

I encountered the same situation, it seems to have generated a large number of spaces, making the process very long.

[GIN] 2023/12/02 - 19:01:49 | 200 | 2m31s | 192.168.3.18 | POST "/api/generate"

my client log:
response length=4914
test execute run 151.27s

testing under normal conditions returns only about 100 characters.

This often happens in the use of the Zephyr model and occasionally in Mistral.

ollama version 0.1.13

<!-- gh-comment-id:1837119550 --> @yugame commented on GitHub (Dec 2, 2023): I encountered the same situation, it seems to have generated a large number of spaces, making the process very long. [GIN] 2023/12/02 - 19:01:49 | 200 | 2m31s | 192.168.3.18 | POST "/api/generate" my client log: response length=4914 test execute run 151.27s testing under normal conditions returns only about 100 characters. This often happens in the use of the Zephyr model and occasionally in Mistral. ollama version 0.1.13
Author
Owner

@yugame commented on GitHub (Dec 2, 2023):

It might be an issue caused by the JSON format. I haven't encountered the same problem when I don't use this mode.

<!-- gh-comment-id:1837161536 --> @yugame commented on GitHub (Dec 2, 2023): It might be an issue caused by the JSON format. I haven't encountered the same problem when I don't use this mode.
Author
Owner

@stevenquinn commented on GitHub (Dec 23, 2023):

I'm having the same issue here, only seen when using the --format json flag. Running on an M1 MacBook Pro.

ollama version is 0.1.17

<!-- gh-comment-id:1868328832 --> @stevenquinn commented on GitHub (Dec 23, 2023): I'm having the same issue here, only seen when using the `--format json` flag. Running on an M1 MacBook Pro. `ollama version is 0.1.17`
Author
Owner

@mchiang0610 commented on GitHub (Mar 12, 2024):

Hi @yangboz @yangboz @stevenquinn sorry about this. This should be fixed with recent releases of Ollama. If you have an older model, please try to update it by performing an ollama pull <model_name>

Sorry about the issue. Thank you!

<!-- gh-comment-id:1992518368 --> @mchiang0610 commented on GitHub (Mar 12, 2024): Hi @yangboz @yangboz @stevenquinn sorry about this. This should be fixed with recent releases of Ollama. If you have an older model, please try to update it by performing an `ollama pull <model_name>` Sorry about the issue. Thank you!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#696