mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 10:58:17 -05:00
Nvidia GPU in docker doesn't work #492
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#492
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @jynrock on GitHub (Mar 17, 2024).
Hi,
I tried to activate the gpu by adding these lines (as here https://github.com/open-webui/open-webui/discussions/1017 ) to the docker stack:
deploy :
resources :
reservations :
devices :
- driver : nvidia
count : 1
capabilities : [gpu]
But when I deploy the stack, I get this error:
failed to deploy a stack : ollama Pulling ollama Pulled Container ollama Recreate Container ollama Recreated Container open-webui Recreate Container open-webui Recreated Container ollama Starting Error response from daemon : could not select device driver "nvidia" with capabilities : gpu
Ubuntu 22.04
Docker 25.0.4
RTX 3080
Driver Version: 535.161.07
CUDA Version: 12.2
@cjhmdm commented on GitHub (Mar 17, 2024):
Are you using Docker Desktop? If so, it doesn't have gpu support in linux. I had to remove Docker Desktop completely in order to get this working.
@jynrock commented on GitHub (Mar 17, 2024):
If I quit Docker Desktop, all my containers stop too
@justinh-rahb commented on GitHub (Mar 17, 2024):
That is expected behaviour.
@jynrock commented on GitHub (Mar 17, 2024):
Ok, but how the containers start without docker desktop ?
@cjhmdm commented on GitHub (Mar 17, 2024):
command line
@jynrock commented on GitHub (Mar 17, 2024):
Without docker desktop launch I can't access to portainer, openwebui doesn't work, and the command "docker ps -a" show no container.
@justinh-rahb commented on GitHub (Mar 17, 2024):
Jynrock, uninstall Docker Desktop, and install Docker this way instead:
https://docs.docker.com/engine/install/ubuntu/
@jynrock commented on GitHub (Mar 17, 2024):
Thank you very much
Finally everything work
@DavidOrakpo commented on GitHub (Jan 15, 2025):
I deleted docker desktop. I tried running open web ui docker install command for gpus. But I get the error "Cannot connect to the Docker daemon"