[PR #4188] [MERGED] User our bundled libraries (cuda) instead of the host library #11410

Closed
opened 2026-04-12 23:29:35 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/4188
Author: @dhiltgen
Created: 5/6/2024
Status: Merged
Merged: 5/6/2024
Merged by: @dhiltgen

Base: mainHead: use_our_lib


📝 Commits (1)

📊 Changes

2 files changed (+31 additions, -15 deletions)

View changed files

📝 gpu/gpu.go (+7 -0)
📝 llm/server.go (+24 -15)

📄 Description

Trying to live off the land for cuda libraries was not the right strategy. We need to use the version we compiled against to ensure things work properly.

This is most likely going to break Jetson v11 systems, but it turns out the change to favor host cuda libraries is breaking
quite a few users.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/4188 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 5/6/2024 **Status:** ✅ Merged **Merged:** 5/6/2024 **Merged by:** [@dhiltgen](https://github.com/dhiltgen) **Base:** `main` ← **Head:** `use_our_lib` --- ### 📝 Commits (1) - [`380378c`](https://github.com/ollama/ollama/commit/380378cc80f3cffd703d5946e87a5ac990df273c) Use our libraries first ### 📊 Changes **2 files changed** (+31 additions, -15 deletions) <details> <summary>View changed files</summary> 📝 `gpu/gpu.go` (+7 -0) 📝 `llm/server.go` (+24 -15) </details> ### 📄 Description Trying to live off the land for cuda libraries was not the right strategy. We need to use the version we compiled against to ensure things work properly. This is most likely going to break Jetson v11 systems, but it turns out the change to favor host cuda libraries is breaking quite a few users. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-12 23:29:35 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#11410