[GH-ISSUE #4708] Nvidia A100 but ollama shows compute capability 1.0 #2967

Closed
opened 2026-04-12 13:20:39 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @ibtsamraza on GitHub (May 29, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4708

I have Nvidia A100 grid graphic card on i am running 4 VM using vGPUs.
on my grid cuda version 11.2 and nvidia drivers 460 are installed.
I am on a virtual machine and on it i have windows 10 enterprise, and cuda tollkit 12.4.
When start ollama by using ollama serve it says your compute capability is 1.0 and it only run my model on CPU.
So is this problem with an older version of cuda drivers on my grid or something else

Originally created by @ibtsamraza on GitHub (May 29, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4708 I have Nvidia A100 grid graphic card on i am running 4 VM using vGPUs. on my grid cuda version 11.2 and nvidia drivers 460 are installed. I am on a virtual machine and on it i have windows 10 enterprise, and cuda tollkit 12.4. When start ollama by using ollama serve it says your compute capability is 1.0 and it only run my model on CPU. So is this problem with an older version of cuda drivers on my grid or something else
Author
Owner

@ibtsamraza commented on GitHub (May 30, 2024):

Screenshot from 2024-05-30 13-45-54
These are the logs from ollama

<!-- gh-comment-id:2139064820 --> @ibtsamraza commented on GitHub (May 30, 2024): ![Screenshot from 2024-05-30 13-45-54](https://github.com/ollama/ollama/assets/138867929/2419c644-855e-4fd0-802a-49f7d8d76953) These are the logs from ollama
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#2967