[PR #2263] [MERGED] Bump llama.cpp to b1999 #10839

Closed
opened 2026-04-12 23:12:26 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/2263
Author: @dhiltgen
Created: 1/30/2024
Status: Merged
Merged: 1/31/2024
Merged by: @dhiltgen

Base: mainHead: bump_llamacpp


📝 Commits (1)

📊 Changes

4 files changed (+130 additions, -27 deletions)

View changed files

📝 llm/ext_server/ext_server.cpp (+35 -22)
📝 llm/llama.cpp (+1 -1)
📝 llm/patches/01-cache.diff (+4 -4)
llm/patches/02-shutdown.diff (+90 -0)

📄 Description

This requires an upstream change to support graceful termination, carried as a patch.

Tracking branches for the 2 patches:

I'm going to mark it draft until I can run more testing (so far happy path on windows, mac and linux looks good)


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/2263 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 1/30/2024 **Status:** ✅ Merged **Merged:** 1/31/2024 **Merged by:** [@dhiltgen](https://github.com/dhiltgen) **Base:** `main` ← **Head:** `bump_llamacpp` --- ### 📝 Commits (1) - [`72b12c3`](https://github.com/ollama/ollama/commit/72b12c3be7f7d8b2e0d1fb703e6d6973caff6493) Bump llama.cpp to b1999 ### 📊 Changes **4 files changed** (+130 additions, -27 deletions) <details> <summary>View changed files</summary> 📝 `llm/ext_server/ext_server.cpp` (+35 -22) 📝 `llm/llama.cpp` (+1 -1) 📝 `llm/patches/01-cache.diff` (+4 -4) ➕ `llm/patches/02-shutdown.diff` (+90 -0) </details> ### 📄 Description This requires an upstream change to support graceful termination, carried as a patch. Tracking branches for the 2 patches: - 01-cache.diff - https://github.com/dhiltgen/llama.cpp/tree/kv_cache - 02-shutdown.diff - https://github.com/dhiltgen/llama.cpp/tree/server_shutdown I'm going to mark it draft until I can run more testing (so far happy path on windows, mac and linux looks good) --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-12 23:12:26 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#10839