[GH-ISSUE #4679] have an NVIDIA GPU, but can not use. #2944

Closed
opened 2026-04-12 13:19:05 -05:00 by GiteaMirror · 8 comments
Owner

Originally created by @pengyuxiang1 on GitHub (May 28, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4679

What is the issue?

I have an NVIDIA GPU, but why does running the latest script display: "No NVIDIA/AMD GPU detected. Ollama will run in CPU-only mode."?

The old version of the script had no issues.

I compared the differences between the old and new scripts and found that it might be due to a piece of logic being deleted?

image

OS

Linux

GPU

Nvidia

CPU

No response

Ollama version

0.1.38

Originally created by @pengyuxiang1 on GitHub (May 28, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4679 ### What is the issue? I have an NVIDIA GPU, but why does running the latest script display: "No NVIDIA/AMD GPU detected. Ollama will run in CPU-only mode."? The old version of the script had no issues. I compared the differences between the old and new scripts and found that it might be due to a piece of logic being deleted? ![image](https://github.com/ollama/ollama/assets/38313899/dc6a6dd9-03ce-48a2-bafd-a351274c9a30) ### OS Linux ### GPU Nvidia ### CPU _No response_ ### Ollama version 0.1.38
GiteaMirror added the bug label 2026-04-12 13:19:05 -05:00
Author
Owner

@zimdin12 commented on GitHub (May 28, 2024):

downgrade your drivers. it happens after installing Nvidia driver 555.85

<!-- gh-comment-id:2135255984 --> @zimdin12 commented on GitHub (May 28, 2024): downgrade your drivers. it happens after installing Nvidia driver 555.85
Author
Owner

@pengyuxiang1 commented on GitHub (May 28, 2024):

降级你的驱动程序。安装 Nvidia 驱动程序 555.85 后就会发生这种情况

This is my NVIDIA version, it is lower than 555.85.

image

<!-- gh-comment-id:2135278516 --> @pengyuxiang1 commented on GitHub (May 28, 2024): > 降级你的驱动程序。安装 Nvidia 驱动程序 555.85 后就会发生这种情况 This is my NVIDIA version, it is lower than 555.85. ![image](https://github.com/ollama/ollama/assets/38313899/7dcc437f-f58b-4c47-bf0a-f1a54ba30342)
Author
Owner

@zimdin12 commented on GitHub (May 28, 2024):

Hmm interesting. then it is probably some other case. :/ havent had that jet.

<!-- gh-comment-id:2135318043 --> @zimdin12 commented on GitHub (May 28, 2024): Hmm interesting. then it is probably some other case. :/ havent had that jet.
Author
Owner

@Crokily commented on GitHub (May 28, 2024):

same problem :( . RTX 4060.Nvidia driver 551.78

<!-- gh-comment-id:2135458519 --> @Crokily commented on GitHub (May 28, 2024): same problem :( . RTX 4060.Nvidia driver 551.78
Author
Owner

@lyuehh commented on GitHub (May 28, 2024):

same problem, driver: 525.105.17, NVIDIA L4, CUDA: 12.0

<!-- gh-comment-id:2135506678 --> @lyuehh commented on GitHub (May 28, 2024): same problem, driver: 525.105.17, NVIDIA L4, CUDA: 12.0
Author
Owner

@jmorganca commented on GitHub (May 28, 2024):

This should be fixed now with https://github.com/ollama/ollama/pull/4683, so sorry about that. Re-running the install script should work. Note: Ollama will still use the GPU for you if you ran it previously

<!-- gh-comment-id:2135725720 --> @jmorganca commented on GitHub (May 28, 2024): This should be fixed now with https://github.com/ollama/ollama/pull/4683, so sorry about that. Re-running the install script should work. Note: Ollama will still use the GPU for you if you ran it previously
Author
Owner

@pengyuxiang1 commented on GitHub (May 28, 2024):

THANKS~

<!-- gh-comment-id:2135731068 --> @pengyuxiang1 commented on GitHub (May 28, 2024): THANKS~
Author
Owner

@pengyuxiang1 commented on GitHub (May 29, 2024):

The good news is: the script is functioning normally.
image

The bad news is: the current program still does not utilize the GPU.
image

May it not only be a question of install.sh, but there are still some other questions?

<!-- gh-comment-id:2136404751 --> @pengyuxiang1 commented on GitHub (May 29, 2024): The good news is: the script is functioning normally. ![image](https://github.com/ollama/ollama/assets/38313899/d5716f78-42f9-4a0f-aaf6-3e86877d159f) The bad news is: the current program still does not utilize the GPU. ![image](https://github.com/ollama/ollama/assets/38313899/a063131c-d967-49bf-8bc5-2f9da537dd44) May it not only be a question of install.sh, but there are still some other questions?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#2944