[PR #10679] model: fix vocabulary #13324

Closed
opened 2026-04-13 00:23:49 -05:00 by GiteaMirror · 0 comments
Owner

Original Pull Request: https://github.com/ollama/ollama/pull/10679

State: closed
Merged: Yes


not setting EOT may cause models to prematurely end generation if the model outputs a token 0. mitigate this by setting EOT to the EOS token ID when the model does not expect it to be set. #10577 should fix this more generally

**Original Pull Request:** https://github.com/ollama/ollama/pull/10679 **State:** closed **Merged:** Yes --- not setting EOT may cause models to prematurely end generation if the model outputs a token 0. mitigate this by setting EOT to the EOS token ID when the model does not expect it to be set. #10577 should fix this more generally
GiteaMirror added the pull-request label 2026-04-13 00:23:49 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#13324