[PR #7430] [CLOSED] feat: allow setting KV cache type #74712

Closed
opened 2026-05-05 06:58:11 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/7430
Author: @sammcj
Created: 10/30/2024
Status: Closed

Base: mainHead: feature/kv-quant-old-runners-backup


📝 Commits (6)

  • 0a9aff3 feat: allow setting KV cache type
  • 3534c0d Merge branch 'main' into feature/kv-quant
  • 5f0dd87 Merge branch 'main' into feature/kv-quant
  • 0ed8476 Merge branch 'main' into feature/kv-quant
  • 921f257 Merge branch 'main' into feature/kv-quant
  • 46cf842 Merge branch 'main' into feature/kv-quant

📊 Changes

7 files changed (+295 additions, -17 deletions)

View changed files

📝 cmd/cmd.go (+2 -0)
📝 docs/faq.md (+31 -3)
📝 envconfig/config.go (+6 -0)
📝 llm/ext_server/server.cpp (+20 -2)
📝 llm/memory.go (+38 -2)
📝 llm/memory_test.go (+115 -1)
📝 llm/server.go (+83 -9)

📄 Description

No description provided


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/7430 **Author:** [@sammcj](https://github.com/sammcj) **Created:** 10/30/2024 **Status:** ❌ Closed **Base:** `main` ← **Head:** `feature/kv-quant-old-runners-backup` --- ### 📝 Commits (6) - [`0a9aff3`](https://github.com/ollama/ollama/commit/0a9aff3ebdb42974323aa290f828ee0e161f3ac8) feat: allow setting KV cache type - [`3534c0d`](https://github.com/ollama/ollama/commit/3534c0d46a8768439c579607de0ed05f7987475b) Merge branch 'main' into feature/kv-quant - [`5f0dd87`](https://github.com/ollama/ollama/commit/5f0dd877f11cc55bf7a0005f2fc979c86044461e) Merge branch 'main' into feature/kv-quant - [`0ed8476`](https://github.com/ollama/ollama/commit/0ed8476ff392d2e1f4b3cfe1c3e3ed51279c4d32) Merge branch 'main' into feature/kv-quant - [`921f257`](https://github.com/ollama/ollama/commit/921f257b8189d3705c5d1527989ac939e3bb8dba) Merge branch 'main' into feature/kv-quant - [`46cf842`](https://github.com/ollama/ollama/commit/46cf842723f62981859ad680cf6a74b77886114a) Merge branch 'main' into feature/kv-quant ### 📊 Changes **7 files changed** (+295 additions, -17 deletions) <details> <summary>View changed files</summary> 📝 `cmd/cmd.go` (+2 -0) 📝 `docs/faq.md` (+31 -3) 📝 `envconfig/config.go` (+6 -0) 📝 `llm/ext_server/server.cpp` (+20 -2) 📝 `llm/memory.go` (+38 -2) 📝 `llm/memory_test.go` (+115 -1) 📝 `llm/server.go` (+83 -9) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-05-05 06:58:12 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#74712