[GH-ISSUE #15270] [Bug] Gemma4 reduces words to two literals #71827

Open
opened 2026-05-05 02:38:33 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @ErfolgreichCharismatisch on GitHub (Apr 3, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/15270

The new gemma4 is really exciting. It has a great context understanding. Question is also which context lengths to give it with Ollama. There's just one problem that I experienced in German and that is words are sometimes reduced to two literals. That might be the case in other languages as well. I only tried it in German. So even though otherwise understanding, grammar and all of that is really good, but sometimes it's just the first literal and the last literal of a word instead of the full word. And I don't think this is a model problem. I think this is an internal alignment problem. So in other words this is something that you can fix and it's not due to the model itself. Of course it could also be due to a badly converted model.
If you fix this, gemma4 would definitely be a state of the art offline model.

Originally created by @ErfolgreichCharismatisch on GitHub (Apr 3, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/15270 The new gemma4 is really exciting. It has a great context understanding. Question is also which context lengths to give it with Ollama. There's just one problem that I experienced in German and that is words are sometimes reduced to two literals. That might be the case in other languages as well. I only tried it in German. So even though otherwise understanding, grammar and all of that is really good, but sometimes it's just the first literal and the last literal of a word instead of the full word. And I don't think this is a model problem. I think this is an internal alignment problem. So in other words this is something that you can fix and it's not due to the model itself. Of course it could also be due to a badly converted model. If you fix this, gemma4 would definitely be a state of the art offline model.
Author
Owner

@szmarczak commented on GitHub (Apr 3, 2026):

You're using an out of date ollama. Upgrade to newest version.

<!-- gh-comment-id:4183377431 --> @szmarczak commented on GitHub (Apr 3, 2026): You're using an out of date ollama. Upgrade to newest version.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#71827