github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-03-10 07:43:10 -05:00
Code Issues 308 Packages Projects Releases 100 Wiki Activity

Inconsistency in command line regarding "--gpus" #3497

New Issue
Closed
opened 2025-11-11 15:32:53 -06:00 by GiteaMirror · 3 comments
GiteaMirror commented 2025-11-11 15:32:53 -06:00
Owner
Copy Link

Originally created by @rabinnh on GitHub (Jan 30, 2025).

A note, the READE.md page shows:

To run Open WebUI with Nvidia GPU support, use this command:

docker run -d -p 3000:8080 --gpus all --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:cuda

But under the heading "With bundled Ollama"

With GPU Support: Utilize GPU resources by running the following command:

docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama

So the question is, do I need the '=' sign, will either work, or is it actually different depending on whether or not you're running in the same container as Ollama?

Originally created by @rabinnh on GitHub (Jan 30, 2025). A note, the READE.md page shows: ### To run Open WebUI with Nvidia GPU support, use this command: `docker run -d -p 3000:8080 --gpus all --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:cuda` But under the heading "With bundled Ollama" ### With GPU Support: Utilize GPU resources by running the following command: `docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama` So the question is, do I need the '=' sign, will either work, or is it actually different depending on whether or not you're running in the same container as Ollama?
GiteaMirror commented 2025-11-11 15:32:54 -06:00
Author
Owner
Copy Link

@wxfred commented on GitHub (Feb 11, 2025):

I'm using the

docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama

But only cpu is running.

@wxfred commented on GitHub (Feb 11, 2025): I'm using the > docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama But only cpu is running.
GiteaMirror commented 2025-11-11 15:32:54 -06:00
Author
Owner
Copy Link

@senhao-xu commented on GitHub (Feb 13, 2025):

I'm using the

docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama

But only cpu is running.

I also encountered the same problem

@senhao-xu commented on GitHub (Feb 13, 2025): > I'm using the > > > docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama > > But only cpu is running. I also encountered the same problem
GiteaMirror commented 2025-11-11 15:32:54 -06:00
Author
Owner
Copy Link

@wxfred commented on GitHub (Feb 13, 2025):

I saw the log of the container, compatible gpu is not detected. But running nvidia-smi in the container shows my gpu info correctly.

I installed the windows bundle ollama direclty, it can use my GPU after i install the CUDA toolkits. Then i restarted my container, no magic happened.

@wxfred commented on GitHub (Feb 13, 2025): I saw the log of the container, compatible gpu is not detected. But running nvidia-smi in the container shows my gpu info correctly. I installed the windows bundle ollama direclty, it can use my GPU after i install the CUDA toolkits. Then i restarted my container, no magic happened.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#3497
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?