[PR #2116] [MERGED] Add support for CUDA 5.0 cards #16058

Closed
opened 2026-04-16 05:14:52 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/2116
Author: @dhiltgen
Created: 1/20/2024
Status: Merged
Merged: 1/27/2024
Merged by: @dhiltgen

Base: mainHead: cc_50_80


📝 Commits (2)

  • 681a914 Add support for CUDA 5.2 cards
  • a447a08 Add compute capability 5.0, 7.5, and 8.0

📊 Changes

5 files changed (+15 additions, -6 deletions)

View changed files

📝 docs/development.md (+2 -1)
📝 gpu/gpu.go (+3 -3)
📝 llm/generate/gen_common.sh (+3 -0)
📝 llm/generate/gen_linux.sh (+1 -1)
📝 llm/generate/gen_windows.ps1 (+6 -1)

📄 Description

Building on #2112, this expands back to 5.0 cards, and also adds a few newer targets which theoretically should help performance on the more modern cards. The resulting binary grows a little in size but not significantly

  • 0.1.21 => 263M
  • #2112 => 264M
  • This PR: => 266M

Fixes #1865

I'll keep this draft until we can run more performance testing on modern cards to ensure no significant regression


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/2116 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 1/20/2024 **Status:** ✅ Merged **Merged:** 1/27/2024 **Merged by:** [@dhiltgen](https://github.com/dhiltgen) **Base:** `main` ← **Head:** `cc_50_80` --- ### 📝 Commits (2) - [`681a914`](https://github.com/ollama/ollama/commit/681a91499010be819dd45a1390e668b0817e7338) Add support for CUDA 5.2 cards - [`a447a08`](https://github.com/ollama/ollama/commit/a447a083f2169e2a3c975cb5951d8b0b0dcddb04) Add compute capability 5.0, 7.5, and 8.0 ### 📊 Changes **5 files changed** (+15 additions, -6 deletions) <details> <summary>View changed files</summary> 📝 `docs/development.md` (+2 -1) 📝 `gpu/gpu.go` (+3 -3) 📝 `llm/generate/gen_common.sh` (+3 -0) 📝 `llm/generate/gen_linux.sh` (+1 -1) 📝 `llm/generate/gen_windows.ps1` (+6 -1) </details> ### 📄 Description Building on #2112, this expands back to 5.0 cards, and also adds a few newer targets which theoretically should help performance on the more modern cards. The resulting binary grows a little in size but not significantly * 0.1.21 => 263M * #2112 => 264M * This PR: => 266M Fixes #1865 I'll keep this draft until we can run more performance testing on modern cards to ensure no significant regression --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-16 05:14:52 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#16058