[GH-ISSUE #13617] Generation issues on a Gemma 3 Model again. #8960

Closed
opened 2026-04-12 21:47:33 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @MichaelBTryin on GitHub (Jan 4, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/13617

What is the issue?

Model: "hf.co/mradermacher/gemma-3-4b-it-heretic-uncensored-abliterated-Extreme-i1-GGUF:Q4_K_M"
Ollama on Windows 11 latest.
_
For the past week approx, I have had generation errors.
Note that it was less frequent on Ollama directly.

I have mine configured to aim for 1-3 sentences, so that may be why it seems more frequent. It does not happen on every gen, but on every 1 out of 3 approx.

Relevant log output

This is an example directly on Ollama: "A More Recent Googlemmsm Update: It’saks just been tweaked at Googlemmsm." 


Examples in my own project include snipits like: "that’ers", "that',s", "It’", "I’refinely", " It’refall", " that’ refucking", "that’ls", "It'refit,", "We' refines", "Michael I'refine!", "stuffin’", "perfectochn mash", "It’refit to", " I', love", "Let'ate that",  "let'refine that!", "people are usuallyeager to", "It'ngit seemed", "that’ers a", "Well that’ally be nice", "Well that'k just ", "Oh hey! Just got to. What’ink?", "that'refine! "

OS

Windows

GPU

Nvidia

CPU

AMD

Ollama version

0.13.5

Originally created by @MichaelBTryin on GitHub (Jan 4, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/13617 ### What is the issue? Model: "hf.co/mradermacher/gemma-3-4b-it-heretic-uncensored-abliterated-Extreme-i1-GGUF:Q4_K_M" Ollama on Windows 11 latest. _ For the past week approx, I have had generation errors. Note that it was less frequent on Ollama directly. I have mine configured to aim for 1-3 sentences, so that may be why it seems more frequent. It does not happen on every gen, but on every 1 out of 3 approx. ### Relevant log output ```shell This is an example directly on Ollama: "A More Recent Googlemmsm Update: It’saks just been tweaked at Googlemmsm." Examples in my own project include snipits like: "that’ers", "that',s", "It’", "I’refinely", " It’refall", " that’ refucking", "that’ls", "It'refit,", "We' refines", "Michael I'refine!", "stuffin’", "perfectochn mash", "It’refit to", " I', love", "Let'ate that", "let'refine that!", "people are usuallyeager to", "It'ngit seemed", "that’ers a", "Well that’ally be nice", "Well that'k just ", "Oh hey! Just got to. What’ink?", "that'refine! " ``` ### OS Windows ### GPU Nvidia ### CPU AMD ### Ollama version 0.13.5
GiteaMirror added the needs more infobug labels 2026-04-12 21:47:33 -05:00
Author
Owner

@rick-github commented on GitHub (Jan 4, 2026):

Does it happen with an unmodified model?

<!-- gh-comment-id:3707589671 --> @rick-github commented on GitHub (Jan 4, 2026): Does it happen with an [unmodified model](https://ollama.com/library/gemma3:4b-it-q4_K_M)?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#8960