[PR #9692] [MERGED] models/gemma3: remove final logit softcap #38911

Closed
opened 2026-04-22 23:34:08 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/9692
Author: @BruceMacD
Created: 3/12/2025
Status: Merged
Merged: 3/12/2025
Merged by: @BruceMacD

Base: mainHead: brucemacd/remove-final-gemma-softcap


📝 Commits (1)

  • 53d2bd4 models/gemma3: remove final logit softcap

📊 Changes

1 file changed (+10 additions, -17 deletions)

View changed files

📝 model/models/gemma3/model_text.go (+10 -17)

📄 Description

Softcap isn't in the whitepaper/implementation for the language model so we should remove it. There is no discernible difference in output with it removed.

With softcap:

❯ ollama run gemma3:27b
>>> I need to get warm. What button turns up the heat? /Users/bruce/Desktop/gemma-3-multimodal
... ity-example.png
Added image '/Users/bruce/Desktop/gemma-3-multimodality-example.png'
Based on the image, the button that turns up the heat is **暖房 (Danbou)**.

It's the button in the top right corner of the remote. It translates to "heating" in
Japanese.

❯ ollama run gemma3:4b
>>> I need to get warm. What button turns up the heat? /Users/bruce/Desktop/gemma-3-multimodal
... ity-example.png
Added image '/Users/bruce/Desktop/gemma-3-multimodality-example.png'
Based on the image, the button to turn up the heat is the **冷房 (Yurou)** button.

It's labeled "冷房" which translates to "air conditioning" or "cooling," but in this
context, it controls the heating function.

❯ ollama run gemma3:1b
>>> what does h2o stand for?
H2O stands for **water**.

It's a common abbreviation used in the context of machine learning and data analysis,
particularly when referring to the H2O library, which is a popular open-source Python
library for watermarking and data analysis.

However, it's important to note that it's also a widely recognized and used term for
water in general.

Without softcap:

❯ ./ollama run gemma3:27b
>>> I need to get warm. What button turns up the heat? /Users/bruce/Desktop/gemma-3-multimodal
... ity-example.png
Added image '/Users/bruce/Desktop/gemma-3-multimodality-example.png'
Based on the image, the button that turns up the heat is **暖房 (Danbou)**.

This is the Japanese word for "heating". It's the top-right button on the remote.

❯ ./ollama run gemma3:4b
>>> I need to get warm. What button turns up the heat? /Users/bruce/Desktop/gemma-3-multimodal
... ity-example.png
Added image '/Users/bruce/Desktop/gemma-3-multimodality-example.png'
Based on the image, the button to turn up the heat is the **冷房 (Yurou)** button.

It's labeled with the characters for "cooling" (which is used to turn on the heat).

❯ ./ollama run gemma3:1b
>>> what does h2o stand for?
H2O stands for **water**.

It's a common abbreviation used in the context of machine learning and data analysis,
particularly in the field of natural language processing (NLP). It's a shorthand way to
refer to the fundamental element of water that is crucial for many data processing tasks.

Tested with the example from the blog post for multimodal: https://developers.googleblog.com/en/introducing-gemma3/


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/9692 **Author:** [@BruceMacD](https://github.com/BruceMacD) **Created:** 3/12/2025 **Status:** ✅ Merged **Merged:** 3/12/2025 **Merged by:** [@BruceMacD](https://github.com/BruceMacD) **Base:** `main` ← **Head:** `brucemacd/remove-final-gemma-softcap` --- ### 📝 Commits (1) - [`53d2bd4`](https://github.com/ollama/ollama/commit/53d2bd4675beb0d692c3c2d5ca525a15a159782e) models/gemma3: remove final logit softcap ### 📊 Changes **1 file changed** (+10 additions, -17 deletions) <details> <summary>View changed files</summary> 📝 `model/models/gemma3/model_text.go` (+10 -17) </details> ### 📄 Description Softcap isn't in the whitepaper/implementation for the language model so we should remove it. There is no discernible difference in output with it removed. With softcap: ``` ❯ ollama run gemma3:27b >>> I need to get warm. What button turns up the heat? /Users/bruce/Desktop/gemma-3-multimodal ... ity-example.png Added image '/Users/bruce/Desktop/gemma-3-multimodality-example.png' Based on the image, the button that turns up the heat is **暖房 (Danbou)**. It's the button in the top right corner of the remote. It translates to "heating" in Japanese. ❯ ollama run gemma3:4b >>> I need to get warm. What button turns up the heat? /Users/bruce/Desktop/gemma-3-multimodal ... ity-example.png Added image '/Users/bruce/Desktop/gemma-3-multimodality-example.png' Based on the image, the button to turn up the heat is the **冷房 (Yurou)** button. It's labeled "冷房" which translates to "air conditioning" or "cooling," but in this context, it controls the heating function. ❯ ollama run gemma3:1b >>> what does h2o stand for? H2O stands for **water**. It's a common abbreviation used in the context of machine learning and data analysis, particularly when referring to the H2O library, which is a popular open-source Python library for watermarking and data analysis. However, it's important to note that it's also a widely recognized and used term for water in general. ``` Without softcap: ``` ❯ ./ollama run gemma3:27b >>> I need to get warm. What button turns up the heat? /Users/bruce/Desktop/gemma-3-multimodal ... ity-example.png Added image '/Users/bruce/Desktop/gemma-3-multimodality-example.png' Based on the image, the button that turns up the heat is **暖房 (Danbou)**. This is the Japanese word for "heating". It's the top-right button on the remote. ❯ ./ollama run gemma3:4b >>> I need to get warm. What button turns up the heat? /Users/bruce/Desktop/gemma-3-multimodal ... ity-example.png Added image '/Users/bruce/Desktop/gemma-3-multimodality-example.png' Based on the image, the button to turn up the heat is the **冷房 (Yurou)** button. It's labeled with the characters for "cooling" (which is used to turn on the heat). ❯ ./ollama run gemma3:1b >>> what does h2o stand for? H2O stands for **water**. It's a common abbreviation used in the context of machine learning and data analysis, particularly in the field of natural language processing (NLP). It's a shorthand way to refer to the fundamental element of water that is crucial for many data processing tasks. ``` Tested with the example from the blog post for multimodal: https://developers.googleblog.com/en/introducing-gemma3/ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-22 23:34:08 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#38911