[PR #10064] [CLOSED] support no caching when kvCacheType is "nocache" for deterministic completion #18405

Closed
opened 2026-04-16 06:34:01 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/10064
Author: @wyli
Created: 3/31/2025
Status: Closed

Base: mainHead: cacheflag


📝 Commits (3)

📊 Changes

5 files changed (+17 additions, -8 deletions)

View changed files

📝 docs/faq.md (+3 -2)
📝 fs/ggml/ggml.go (+1 -1)
📝 runner/llamarunner/runner.go (+6 -2)
📝 runner/ollamarunner/cache.go (+6 -2)
📝 runner/ollamarunner/runner.go (+1 -1)

📄 Description

based on the discussions https://github.com/ollama/ollama/issues/5321, an option to disable caching is needed to ensure reproducibility. setting kvCacheType to "nocache" is a simple way to achieve it.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/10064 **Author:** [@wyli](https://github.com/wyli) **Created:** 3/31/2025 **Status:** ❌ Closed **Base:** `main` ← **Head:** `cacheflag` --- ### 📝 Commits (3) - [`9e24e84`](https://github.com/ollama/ollama/commit/9e24e840ddb0be4e508359d3a423e4a8fcbd9c41) add nocache option - [`c50abcb`](https://github.com/ollama/ollama/commit/c50abcb1d0fead6d57558780981d6096b3cb775d) fixes close - [`47731b6`](https://github.com/ollama/ollama/commit/47731b687f808537701c4eb12366752fd4371904) add to validation ### 📊 Changes **5 files changed** (+17 additions, -8 deletions) <details> <summary>View changed files</summary> 📝 `docs/faq.md` (+3 -2) 📝 `fs/ggml/ggml.go` (+1 -1) 📝 `runner/llamarunner/runner.go` (+6 -2) 📝 `runner/ollamarunner/cache.go` (+6 -2) 📝 `runner/ollamarunner/runner.go` (+1 -1) </details> ### 📄 Description based on the discussions https://github.com/ollama/ollama/issues/5321, an option to disable caching is needed to ensure reproducibility. setting `kvCacheType` to `"nocache"` is a simple way to achieve it. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-16 06:34:01 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#18405