github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-21 13:11:39 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #13719] Requesting workaround without sudo when Ollama fails to discover NVIDIA GPU #8994

New Issue
Closed
opened 2026-04-12 21:49:18 -05:00 by GiteaMirror · 5 comments
GiteaMirror commented 2026-04-12 21:49:18 -05:00
Owner
Copy Link

Originally created by @samancyrus-eaton on GitHub (Jan 14, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/13719

In the documentation, it is mentioned that

sometimes Ollama will fail to discover your NVIDIA GPU...You can workaround this driver bug by reloading the NVIDIA UVM driver with sudo rmmod nvidia_uvm && sudo modprobe nvidia_uvm

What if sudo is closed to the user (which is the case in many organizations for security reasons)?

It seems that there's not a workaround in this case. Can someone help me with this? Thanks.

Information about the system:

**OS: ** RHEL 8.10
Multi-GPU: Yes

Originally created by @samancyrus-eaton on GitHub (Jan 14, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/13719 In [the documentation](https://docs.ollama.com/gpu), it is mentioned that > sometimes Ollama will fail to discover your NVIDIA GPU...You can workaround this driver bug by reloading the NVIDIA UVM driver with `sudo rmmod nvidia_uvm && sudo modprobe nvidia_uvm` What if `sudo` is closed to the user (which is the case in many organizations for security reasons)? It seems that there's not a workaround in this case. Can someone help me with this? Thanks. **Information about the system:** **OS: ** RHEL 8.10 **Multi-GPU:** Yes
GiteaMirror added the feature request label 2026-04-12 21:49:18 -05:00
GiteaMirror commented 2026-04-12 21:49:19 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jan 14, 2026):

What OS? What hardware? What security policy? Are there security carve outs available, eg withsudoers?

<!-- gh-comment-id:3751919236 --> @rick-github commented on GitHub (Jan 14, 2026): What OS? What hardware? What security policy? Are there security carve outs available, eg with`sudoers`?
GiteaMirror commented 2026-04-12 21:49:20 -05:00
Author
Owner
Copy Link

@samancyrus-eaton commented on GitHub (Jan 14, 2026):

What OS? What hardware? What security policy? Are there security carve outs available, eg withsudoers?

The link I've pasted is talking about Linux. The rest of my question is asking if there is a solution available when we don't have access to sudo. The hardware :NVIDIA H100 NVL.
The security policy is: non-priviledged user (sudo access is restricted by organization policy).
No security carve-outs, driver reload must be performed by an admin.
Thanks

<!-- gh-comment-id:3751988984 --> @samancyrus-eaton commented on GitHub (Jan 14, 2026): > What OS? What hardware? What security policy? Are there security carve outs available, eg with`sudoers`? The link I've pasted is talking about Linux. The rest of my question is asking if there is a solution available when we don't have access to `sudo`. The hardware :`NVIDIA H100 NVL`. The security policy is: non-priviledged user (sudo access is restricted by organization policy). No security carve-outs, driver reload must be performed by an admin. Thanks
GiteaMirror commented 2026-04-12 21:49:21 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jan 15, 2026):

What version of Linux. What machine hardware.

<!-- gh-comment-id:3753038409 --> @rick-github commented on GitHub (Jan 15, 2026): What version of Linux. What machine hardware.
GiteaMirror commented 2026-04-12 21:49:22 -05:00
Author
Owner
Copy Link

@samancyrus-eaton commented on GitHub (Jan 15, 2026):

What version of Linux. What machine hardware.

Please read the link I've sent. Your questions have nothing to do with the post. The question is in general for any Linux machine (that is what Ollama's documentation is saying).

<!-- gh-comment-id:3755324230 --> @samancyrus-eaton commented on GitHub (Jan 15, 2026): > What version of Linux. What machine hardware. Please read the link I've sent. Your questions have nothing to do with the post. The question is in general for any Linux machine (that is what Ollama's documentation is saying).
GiteaMirror commented 2026-04-12 21:49:24 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jan 15, 2026):

I'm trying to get information so that we can work to a solution to your problem. If you are not interested in collaborating, then the answer is that you need administrator privileges.

<!-- gh-comment-id:3755420274 --> @rick-github commented on GitHub (Jan 15, 2026): I'm trying to get information so that we can work to a solution to your problem. If you are not interested in collaborating, then the answer is that you need administrator privileges.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#8994
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?