[PR #12185] [MERGED] batch: use tensors for outputs #44978

Closed
opened 2026-04-25 00:40:35 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/12185
Author: @mxyng
Created: 9/4/2025
Status: Merged
Merged: 9/15/2025
Merged by: @mxyng

Base: mainHead: mxyng/batch


📝 Commits (1)

  • bc274bd batch: use tensors for outputs

📊 Changes

14 files changed (+27 additions, -37 deletions)

View changed files

📝 model/input/input.go (+7 -7)
📝 model/models/gemma2/model.go (+1 -2)
📝 model/models/gemma3/embed.go (+0 -1)
📝 model/models/gemma3/model_text.go (+1 -2)
📝 model/models/gemma3n/model_text.go (+1 -1)
📝 model/models/gptoss/model.go (+2 -2)
📝 model/models/llama/model.go (+1 -1)
📝 model/models/llama4/model.go (+1 -3)
📝 model/models/mistral3/model.go (+1 -2)
📝 model/models/mllama/model.go (+1 -2)
📝 model/models/qwen2/model.go (+1 -1)
📝 model/models/qwen25vl/model.go (+1 -2)
📝 model/models/qwen3/model.go (+1 -1)
📝 runner/ollamarunner/runner.go (+8 -10)

📄 Description

this cleans up the model interface slightly without too much impact in other areas


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/12185 **Author:** [@mxyng](https://github.com/mxyng) **Created:** 9/4/2025 **Status:** ✅ Merged **Merged:** 9/15/2025 **Merged by:** [@mxyng](https://github.com/mxyng) **Base:** `main` ← **Head:** `mxyng/batch` --- ### 📝 Commits (1) - [`bc274bd`](https://github.com/ollama/ollama/commit/bc274bdee2140153880e12852d0ebc7198647277) batch: use tensors for outputs ### 📊 Changes **14 files changed** (+27 additions, -37 deletions) <details> <summary>View changed files</summary> 📝 `model/input/input.go` (+7 -7) 📝 `model/models/gemma2/model.go` (+1 -2) 📝 `model/models/gemma3/embed.go` (+0 -1) 📝 `model/models/gemma3/model_text.go` (+1 -2) 📝 `model/models/gemma3n/model_text.go` (+1 -1) 📝 `model/models/gptoss/model.go` (+2 -2) 📝 `model/models/llama/model.go` (+1 -1) 📝 `model/models/llama4/model.go` (+1 -3) 📝 `model/models/mistral3/model.go` (+1 -2) 📝 `model/models/mllama/model.go` (+1 -2) 📝 `model/models/qwen2/model.go` (+1 -1) 📝 `model/models/qwen25vl/model.go` (+1 -2) 📝 `model/models/qwen3/model.go` (+1 -1) 📝 `runner/ollamarunner/runner.go` (+8 -10) </details> ### 📄 Description this cleans up the model interface slightly without too much impact in other areas --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-25 00:40:35 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#44978