[PR #15252] Remove duplicated BOS token from functiongemma #15092

Open
opened 2026-04-13 01:10:11 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/15252
Author: @wangwillian0
Created: 4/3/2026
Status: 🔄 Open

Base: mainHead: main


📝 Commits (1)

  • 3e9fca3 Remove duplicated BOS token from functiongemma

📊 Changes

1 file changed (+0 additions, -2 deletions)

View changed files

📝 model/renderers/functiongemma.go (+0 -2)

📄 Description

If Im not mistaken, only the gemma4 started using add_bos_token=false in their tokenizer config.

time=2026-04-03T02:30:26.020Z level=WARN source=vocabulary.go:49 msg="adding bos token to prompt which already has it" id=[2]
time=2026-04-03T02:30:26.020Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=2

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/15252 **Author:** [@wangwillian0](https://github.com/wangwillian0) **Created:** 4/3/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (1) - [`3e9fca3`](https://github.com/ollama/ollama/commit/3e9fca34cc8bcaef4df92e3401460355b4ffc828) Remove duplicated BOS token from functiongemma ### 📊 Changes **1 file changed** (+0 additions, -2 deletions) <details> <summary>View changed files</summary> 📝 `model/renderers/functiongemma.go` (+0 -2) </details> ### 📄 Description If Im not mistaken, only the gemma4 started using `add_bos_token=false` in their tokenizer config. ``` time=2026-04-03T02:30:26.020Z level=WARN source=vocabulary.go:49 msg="adding bos token to prompt which already has it" id=[2] time=2026-04-03T02:30:26.020Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=2 ``` --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-13 01:10:11 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#15092