mirror of
https://github.com/open-webui/open-webui.git
synced 2026-03-11 00:04:08 -05:00
Getting error when trying to use Speech to Text on CUDA container #2395
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @nikito on GitHub (Oct 16, 2024).
Bug Report
Installation Method
Pod in k8s
Environment
Open WebUI Version: 0.3.32
Ollama (if applicable): 0.3.13 (running on separate pod)
Operating System: k8s in Ubuntu 22.04
Browser (if applicable): Chrome
Confirmation:
Expected Behavior:
Speech to Text should successfully process the speech.
Actual Behavior:
Speech to text fails, throwing error in backend, causing app to crash and restart.
Description
Bug Summary:
When using the CUDA enabled container, upon trying to perform speech to text, the app crashes, and I see this error in my logs:
Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.so.8: cannot open shared object file: No such file or directory
Looking in the container, it appears all my libraries are the .9 version, not .8. This is likely due to my cluster using a higher version of CUDA. Is it possible to make the app compatible with the later versions of CUDA as well?
Reproduction Details
Steps to Reproduce:
Install the cuda variant of the container, with latest CUDA enabled container.
Logs and Screenshots
Browser Console Logs:
Docker Container Logs:
<html> 2024-10-16 08:19:39.141 | Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.so.8: cannot open shared object file: No such file or directory | -- | -- | -- | | 2024-10-16 08:19:38.594 | transcribe /app/backend/data/cache/audio/transcriptions/153c6178-0da2-4c9d-9687-68590fda567a.wav </html>