[PR #12260] [CLOSED] cuda: switch to v12.1 and enable JIT #45007

Closed
opened 2026-04-25 00:42:12 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/12260
Author: @dhiltgen
Created: 9/11/2025
Status: Closed

Base: mainHead: v12.1


📝 Commits (1)

  • acfe1f7 cuda: switch to v12.1 and enable JIT

📊 Changes

5 files changed (+9 additions, -9 deletions)

View changed files

📝 .github/workflows/release.yaml (+3 -3)
📝 CMakeLists.txt (+1 -1)
📝 CMakePresets.json (+1 -1)
📝 Dockerfile (+1 -1)
📝 scripts/build_windows.ps1 (+3 -3)

📄 Description

A third option to bring back older driver support. Downgrade to v12.1 and leverage JIT instead of compression for reduced image size. This does create a special case where Blackwell GPUs CC v12.0 must be running driver 580 (Aug 2025) or newer. Today we support them on driver 570 (Jan 2025) or newer.

Alternative to #12258 or #12259

Sizes:

  • 1.4G ollama-linux-amd64.tgz
  • 1.3G ollama-linux-arm64.tgz
  • 1.4G ollama-windows-amd64.zip

Baseline from 0.11.11-rc0:

  • 1.5G ollama-linux-amd64.tgz
  • 1.5G ollama-linux-arm64.tgz
  • 1.5G ollama-windows-amd64.zip

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/12260 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 9/11/2025 **Status:** ❌ Closed **Base:** `main` ← **Head:** `v12.1` --- ### 📝 Commits (1) - [`acfe1f7`](https://github.com/ollama/ollama/commit/acfe1f7837dfdd3c6fbfc44f7ffb44f8189b6069) cuda: switch to v12.1 and enable JIT ### 📊 Changes **5 files changed** (+9 additions, -9 deletions) <details> <summary>View changed files</summary> 📝 `.github/workflows/release.yaml` (+3 -3) 📝 `CMakeLists.txt` (+1 -1) 📝 `CMakePresets.json` (+1 -1) 📝 `Dockerfile` (+1 -1) 📝 `scripts/build_windows.ps1` (+3 -3) </details> ### 📄 Description A third option to bring back older driver support. Downgrade to v12.1 and leverage JIT instead of compression for reduced image size. This does create a special case where Blackwell GPUs CC v12.0 must be running driver 580 (Aug 2025) or newer. Today we support them on driver 570 (Jan 2025) or newer. Alternative to #12258 or #12259 Sizes: - 1.4G ollama-linux-amd64.tgz - 1.3G ollama-linux-arm64.tgz - 1.4G ollama-windows-amd64.zip Baseline from 0.11.11-rc0: - 1.5G ollama-linux-amd64.tgz - 1.5G ollama-linux-arm64.tgz - 1.5G ollama-windows-amd64.zip --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-25 00:42:12 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#45007