github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 08:02:14 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[PR #2279] [MERGED] Add support for libcudart.so for CUDA devices (Adds Jetson support) #73137

New Issue
Closed
opened 2026-05-05 04:48:53 -05:00 by GiteaMirror · 0 comments
GiteaMirror commented 2026-05-05 04:48:53 -05:00
Owner
Copy Link

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/2279
Author: @remy415
Created: 1/30/2024
Status: ✅ Merged
Merged: 3/25/2024
Merged by: @dhiltgen

Base: main ← Head: main

📝 Commits (1)

  • dfc6721 add support for libcudart.so for CUDA devices (adds Jetson support)

📊 Changes

8 files changed (+438 additions, -83 deletions)

View changed files

📝 gpu/gpu.go (+123 -32)
📝 gpu/gpu_info.h (+2 -1)
➕ gpu/gpu_info_cudart.c (+190 -0)
➕ gpu/gpu_info_cudart.h (+59 -0)
📝 gpu/gpu_info_nvml.c (+12 -12)
📝 gpu/gpu_info_nvml.h (+13 -13)
📝 llm/generate/gen_common.sh (+1 -1)
📝 llm/generate/gen_linux.sh (+38 -24)

📄 Description

Added libcudart.so support to gpu.go for CUDA devices that are missing libnvidia-ml.so. CUDA libraries split into nvml (libnvidia-ml.so) and cudart (libcudart.so), can work with either. Tested on Jetson device and on Windows 11 in WSL2.

Devices used to test:
Jetson Orin Nano 8Gb
Jetpack 5.1.2, L4T 35.4.1
CUDA 11-8
CUDA Capability Supported 8.7
Go version 1.26.1
Cmake 3.28.1
nvcc 11.8.89

AMD Ryzen 3950x
NVidia RTX 3090ti
WSL2 running Ubuntu 22.04
WSL CUDA Toolkit v12.3 installed

Edited for updates

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/2279 **Author:** [@remy415](https://github.com/remy415) **Created:** 1/30/2024 **Status:** ✅ Merged **Merged:** 3/25/2024 **Merged by:** [@dhiltgen](https://github.com/dhiltgen) **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (1) - [`dfc6721`](https://github.com/ollama/ollama/commit/dfc6721b203fdf2a91f022f61170d26306dbae63) add support for libcudart.so for CUDA devices (adds Jetson support) ### 📊 Changes **8 files changed** (+438 additions, -83 deletions) <details> <summary>View changed files</summary> 📝 `gpu/gpu.go` (+123 -32) 📝 `gpu/gpu_info.h` (+2 -1) ➕ `gpu/gpu_info_cudart.c` (+190 -0) ➕ `gpu/gpu_info_cudart.h` (+59 -0) 📝 `gpu/gpu_info_nvml.c` (+12 -12) 📝 `gpu/gpu_info_nvml.h` (+13 -13) 📝 `llm/generate/gen_common.sh` (+1 -1) 📝 `llm/generate/gen_linux.sh` (+38 -24) </details> ### 📄 Description Added libcudart.so support to gpu.go for CUDA devices that are missing libnvidia-ml.so. CUDA libraries split into nvml (libnvidia-ml.so) and cudart (libcudart.so), can work with either. Tested on Jetson device and on Windows 11 in WSL2. Devices used to test: Jetson Orin Nano 8Gb Jetpack 5.1.2, L4T 35.4.1 CUDA 11-8 CUDA Capability Supported 8.7 Go version 1.26.1 Cmake 3.28.1 nvcc 11.8.89 AMD Ryzen 3950x NVidia RTX 3090ti WSL2 running Ubuntu 22.04 WSL CUDA Toolkit v12.3 installed Edited for updates --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-05-05 04:48:53 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#73137
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?