[PR #13453] [MERGED] model: default gemma 3 rope scale to 1.0 #76510

Closed
opened 2026-05-05 09:06:37 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/13453
Author: @jmorganca
Created: 12/13/2025
Status: Merged
Merged: 12/13/2025
Merged by: @jmorganca

Base: mainHead: jmorganca/gemma3-default-rope-scale-1


📝 Commits (2)

  • c49e9f8 model: default gemma 3 rope scale to 1.0
  • 79e98b2 Fix detection of gemma3 1b to disable logit softcapping

📊 Changes

1 file changed (+34 additions, -26 deletions)

View changed files

📝 model/models/gemma3/model_text.go (+34 -26)

📄 Description

Default rope scale to 1.0, as Gemma3 1B does not set this value and assumes a default of 1.0. For other sizes, rope.factor should be set to 8.0. Also fixes a bug in Gemma3 1B where we apply logit softcapping (the previous check to set it to 0.0 was not effective)


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/13453 **Author:** [@jmorganca](https://github.com/jmorganca) **Created:** 12/13/2025 **Status:** ✅ Merged **Merged:** 12/13/2025 **Merged by:** [@jmorganca](https://github.com/jmorganca) **Base:** `main` ← **Head:** `jmorganca/gemma3-default-rope-scale-1` --- ### 📝 Commits (2) - [`c49e9f8`](https://github.com/ollama/ollama/commit/c49e9f88b2f57c4916546d0b10e535737ae8e37b) model: default gemma 3 rope scale to 1.0 - [`79e98b2`](https://github.com/ollama/ollama/commit/79e98b2a9bd2d4d19910ead15983d7c83b1b8d58) Fix detection of gemma3 1b to disable logit softcapping ### 📊 Changes **1 file changed** (+34 additions, -26 deletions) <details> <summary>View changed files</summary> 📝 `model/models/gemma3/model_text.go` (+34 -26) </details> ### 📄 Description Default rope scale to 1.0, as Gemma3 1B does not set this value and assumes a default of 1.0. For other sizes, `rope.factor` should be set to 8.0. Also fixes a bug in Gemma3 1B where we apply logit softcapping (the previous check to set it to 0.0 was not effective) --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-05-05 09:06:37 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#76510