[GH-ISSUE #11373] cuda driver library failed #7505

Closed
opened 2026-04-12 19:35:35 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @nicho2 on GitHub (Jul 11, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/11373

What is the issue?

Hello,

Sometimes the Cuda driver library crashes and I don't know the condition that causes this.

To resolve, it simply restart the container.

root@ollama:/# nvidia-smi
Failed to initialize NVML: Unknown Error

cuda driver library failed to get device context 800time=2025-07-11T07:00:00.476Z level=WARN source=gpu.go:434 msg="error looking up nvidia GPU memory"
cuda driver library failed to get device context 800time=2025-07-11T07:00:00.491Z level=WARN source=gpu.go:434 msg="error looking up nvidia GPU memory"
cuda driver library failed to get device context 800time=2025-07-11T07:00:00.505Z level=WARN source=gpu.go:434 msg="error looking up nvidia GPU memory"

ollama GPU fail.txt

Relevant log output


OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.9.1

Originally created by @nicho2 on GitHub (Jul 11, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/11373 ### What is the issue? Hello, Sometimes the Cuda driver library crashes and I don't know the condition that causes this. To resolve, it simply restart the container. root@ollama:/# nvidia-smi Failed to initialize NVML: Unknown Error cuda driver library failed to get device context 800time=2025-07-11T07:00:00.476Z level=WARN source=gpu.go:434 msg="error looking up nvidia GPU memory" cuda driver library failed to get device context 800time=2025-07-11T07:00:00.491Z level=WARN source=gpu.go:434 msg="error looking up nvidia GPU memory" cuda driver library failed to get device context 800time=2025-07-11T07:00:00.505Z level=WARN source=gpu.go:434 msg="error looking up nvidia GPU memory" [ollama GPU fail.txt](https://github.com/user-attachments/files/21181939/ollama.GPU.fail.txt) ### Relevant log output ```shell ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.9.1
GiteaMirror added the bug label 2026-04-12 19:35:35 -05:00
Author
Owner

@CassidyMabey commented on GitHub (Jul 11, 2025):

There could be alot of issues as the is no log so ill pose a few and how to fix it and we will see what can work.

Reinstall your NVIDIA drivers (or at least make sure they are working) - they could be corrupt or just incompatible with the current CUDA toolkit

Run nvidia-smi to make sure your drivers are working. Make sure that the version is compatible with CUDA and Ollama

<!-- gh-comment-id:3061910097 --> @CassidyMabey commented on GitHub (Jul 11, 2025): There could be alot of issues as the is no log so ill pose a few and how to fix it and we will see what can work. Reinstall your NVIDIA drivers (or at least make sure they are working) - they could be corrupt or just incompatible with the current CUDA toolkit Run ```nvidia-smi``` to make sure your drivers are working. Make sure that the version is compatible with CUDA and Ollama
Author
Owner

@rick-github commented on GitHub (Jul 11, 2025):

cudaErrorNotPermitted = 800
This error indicates the attempted operation is not permitted.

https://github.com/ollama/ollama/blob/main/docs/gpu.md#linux-suspend-resume
https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#linux-docker

<!-- gh-comment-id:3061942302 --> @rick-github commented on GitHub (Jul 11, 2025): ``` cudaErrorNotPermitted = 800 This error indicates the attempted operation is not permitted. ``` https://github.com/ollama/ollama/blob/main/docs/gpu.md#linux-suspend-resume https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#linux-docker
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#7505