[PR #10018] [MERGED] ml: Remove Output from Context interface #44366

Closed
opened 2026-04-24 23:52:27 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/10018
Author: @jessegross
Created: 3/27/2025
Status: Merged
Merged: 3/27/2025
Merged by: @jessegross

Base: mainHead: jessegross/output


📝 Commits (1)

  • 858b277 ml: Remove Output from Context interface

📊 Changes

3 files changed (+3 additions, -23 deletions)

View changed files

📝 kvcache/causal_test.go (+0 -1)
📝 ml/backend.go (+2 -4)
📝 ml/backend/ggml/ggml.go (+1 -18)

📄 Description

Model implementations should use Input for all of their tensors supplied to the model. This includes tensors that relate to the outputs, which is confusing since there is also an Output funciton.

Since Output is only used internally in GGML and not used by any model implementations, we can remove it from the interface to reduce confusion.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/10018 **Author:** [@jessegross](https://github.com/jessegross) **Created:** 3/27/2025 **Status:** ✅ Merged **Merged:** 3/27/2025 **Merged by:** [@jessegross](https://github.com/jessegross) **Base:** `main` ← **Head:** `jessegross/output` --- ### 📝 Commits (1) - [`858b277`](https://github.com/ollama/ollama/commit/858b277430a7fa05626cecc4ffd4a7fd8fde3666) ml: Remove Output from Context interface ### 📊 Changes **3 files changed** (+3 additions, -23 deletions) <details> <summary>View changed files</summary> 📝 `kvcache/causal_test.go` (+0 -1) 📝 `ml/backend.go` (+2 -4) 📝 `ml/backend/ggml/ggml.go` (+1 -18) </details> ### 📄 Description Model implementations should use Input for all of their tensors supplied to the model. This includes tensors that relate to the outputs, which is confusing since there is also an Output funciton. Since Output is only used internally in GGML and not used by any model implementations, we can remove it from the interface to reduce confusion. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-24 23:52:27 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#44366