[GH-ISSUE #12469] issue: cuda 12.8 gpu not supported using docker #32143

Closed
opened 2026-04-25 06:02:07 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @dompri on GitHub (Apr 4, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/12469

Check Existing Issues

  • I have searched the existing issues and discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

v0.6.0

Ollama Version (if applicable)

0.6.3

Operating System

Windows 11

Browser (if applicable)

Chrome 134.0.6998.179

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have listed steps to reproduce the bug in detail.

Expected Behavior

web search functionality does not work using the gpu image having installed the nvidia toolkit 12.8 and the openwebui docker image with gpu support

Actual Behavior

ERROR: CUDA error: no kernel image is available for execution on the device

Steps to Reproduce

enable websearch and go to docker container log

Logs & Screenshots

2025-04-04 232922 Loading WEBUI_SEC.txt

Additional Information

No response

Originally created by @dompri on GitHub (Apr 4, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/12469 ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version v0.6.0 ### Ollama Version (if applicable) 0.6.3 ### Operating System Windows 11 ### Browser (if applicable) Chrome 134.0.6998.179 ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have listed steps to reproduce the bug in detail. ### Expected Behavior web search functionality does not work using the gpu image having installed the nvidia toolkit 12.8 and the openwebui docker image with gpu support ### Actual Behavior ERROR: CUDA error: no kernel image is available for execution on the device ### Steps to Reproduce enable websearch and go to docker container log ### Logs & Screenshots [2025-04-04 232922 Loading WEBUI_SEC.txt](https://github.com/user-attachments/files/19610576/2025-04-04.232922.Loading.WEBUI_SEC.txt) ### Additional Information _No response_
GiteaMirror added the bug label 2026-04-25 06:02:07 -05:00
Author
Owner

@bet0x commented on GitHub (Apr 4, 2025):

@dompri Not a bug. Set USE_CUDA_VER and rebuild the image with your custom version.

<!-- gh-comment-id:2779783280 --> @bet0x commented on GitHub (Apr 4, 2025): @dompri Not a bug. Set USE_CUDA_VER and rebuild the image with your custom version.
Author
Owner

@rgaricano commented on GitHub (Apr 4, 2025):

on 04799f1f95/Dockerfile (L7)
and run-compose.sh

<!-- gh-comment-id:2779900175 --> @rgaricano commented on GitHub (Apr 4, 2025): on https://github.com/open-webui/open-webui/blob/04799f1f95f958674d35ba4854ef62754a4d332e/Dockerfile#L7 and [run-compose.sh](https://github.com/open-webui/open-webui/blob/main/run-compose.sh)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#32143