[PR #1914] [MERGED] Smarter GPU Management library detection #57418

Closed
opened 2026-04-29 12:01:27 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/1914
Author: @dhiltgen
Created: 1/10/2024
Status: Merged
Merged: 1/10/2024
Merged by: @dhiltgen

Base: mainHead: smarter_cuda_detection


📝 Commits (2)

  • 9754ae4 Support optional override of the target archictures
  • 3c49c3a Harden GPU mgmt library lookup

📊 Changes

6 files changed (+169 additions, -65 deletions)

View changed files

📝 gpu/gpu.go (+153 -17)
📝 gpu/gpu_info_cuda.c (+5 -24)
📝 gpu/gpu_info_cuda.h (+1 -1)
📝 gpu/gpu_info_rocm.c (+7 -21)
📝 gpu/gpu_info_rocm.h (+1 -1)
📝 scripts/build_linux.sh (+2 -1)

📄 Description

When there are multiple management libraries installed on a system
not every one will be compatible with the current driver. This change
improves our management library algorithm to build up a set of discovered
libraries based on glob patterns, and then try all of them until we're able to
load one without error.

Fixes #1903
Fixes #1898
Fixes #1888
Fixes #1879


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/1914 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 1/10/2024 **Status:** ✅ Merged **Merged:** 1/10/2024 **Merged by:** [@dhiltgen](https://github.com/dhiltgen) **Base:** `main` ← **Head:** `smarter_cuda_detection` --- ### 📝 Commits (2) - [`9754ae4`](https://github.com/ollama/ollama/commit/9754ae4c899c5a55e7725f195f5581aad33866b2) Support optional override of the target archictures - [`3c49c3a`](https://github.com/ollama/ollama/commit/3c49c3ab0da9cccbcca333ae278687734bb5cec8) Harden GPU mgmt library lookup ### 📊 Changes **6 files changed** (+169 additions, -65 deletions) <details> <summary>View changed files</summary> 📝 `gpu/gpu.go` (+153 -17) 📝 `gpu/gpu_info_cuda.c` (+5 -24) 📝 `gpu/gpu_info_cuda.h` (+1 -1) 📝 `gpu/gpu_info_rocm.c` (+7 -21) 📝 `gpu/gpu_info_rocm.h` (+1 -1) 📝 `scripts/build_linux.sh` (+2 -1) </details> ### 📄 Description When there are multiple management libraries installed on a system not every one will be compatible with the current driver. This change improves our management library algorithm to build up a set of discovered libraries based on glob patterns, and then try all of them until we're able to load one without error. Fixes #1903 Fixes #1898 Fixes #1888 Fixes #1879 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-29 12:01:27 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#57418