[GH-ISSUE #5906] enh: expose WHISPER_MODEL env to admin settings #52835

Closed
opened 2026-05-05 13:59:08 -05:00 by GiteaMirror · 11 comments
Owner

Originally created by @thiswillbeyourgithub on GitHub (Oct 4, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/5906

Originally assigned to: @tjbck on GitHub.

Hi, Openai just release their latest whisper version. It's not better in ALL languages (heard mixed results about some asian languages but can't evaluate myself) but is faster and more compact. Switching the default to the new v3 version should be very simple. Potentially just switching the model name string and the documentation. Here's an example using faster-whisper-server

Cheers

Originally created by @thiswillbeyourgithub on GitHub (Oct 4, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/5906 Originally assigned to: @tjbck on GitHub. Hi, Openai just release their latest whisper version. It's not better in ALL languages (heard mixed results about some asian languages but can't evaluate myself) but is faster and more compact. Switching the default to the new v3 version should be very simple. Potentially just switching the model name string and the documentation. [Here's an example using faster-whisper-server](https://github.com/fedirz/faster-whisper-server/issues/93) Cheers
Author
Owner

@allansouzasnowfox commented on GitHub (Oct 4, 2024):

I made some tests here, the experience using the turbo model for STT even for portuguese, that is my main language, is very impressive. I can't wait to use it in openwebui

<!-- gh-comment-id:2393687509 --> @allansouzasnowfox commented on GitHub (Oct 4, 2024): I made some tests here, the experience using the turbo model for STT even for portuguese, that is my main language, is very impressive. I can't wait to use it in openwebui
Author
Owner

@tcgumus commented on GitHub (Oct 4, 2024):

i will work on this. i think it should be user selectable.

<!-- gh-comment-id:2393770323 --> @tcgumus commented on GitHub (Oct 4, 2024): i will work on this. i think it should be user selectable.
Author
Owner

@thiswillbeyourgithub commented on GitHub (Oct 4, 2024):

i will work on this. i think it should be user selectable.

I think it already is, sort of, you can change environment variables

<!-- gh-comment-id:2394491854 --> @thiswillbeyourgithub commented on GitHub (Oct 4, 2024): > i will work on this. i think it should be user selectable. I think it already is, sort of, you can change [environment variables](https://docs.openwebui.com/getting-started/env-configuration/)
Author
Owner

@allansouzasnowfox commented on GitHub (Oct 4, 2024):

yeah, I think that only is not possible to set the turbo version because it is using the faster-whisper to manage the model, possibly we only need to wait a new faster whisper version, but curently using the turbo model with transformers lib looks better than using the faster whisper

<!-- gh-comment-id:2394529675 --> @allansouzasnowfox commented on GitHub (Oct 4, 2024): yeah, I think that only is not possible to set the turbo version because it is using the faster-whisper to manage the model, possibly we only need to wait a new faster whisper version, but curently using the turbo model with transformers lib looks better than using the faster whisper
Author
Owner

@thiswillbeyourgithub commented on GitHub (Oct 4, 2024):

Hi, Openai just release their latest whisper version. It's not better in ALL languages (heard mixed results about some asian languages but can't evaluate myself) but is faster and more compact. Switching the default to the new v3 version should be very simple. Potentially just switching the model name string and the documentation. Here's an example using faster-whisper-server

Cheers

As I said there and unless I'm mistaken, it's already available on faster whisper

<!-- gh-comment-id:2394765445 --> @thiswillbeyourgithub commented on GitHub (Oct 4, 2024): > Hi, Openai just release their latest whisper version. It's not better in ALL languages (heard mixed results about some asian languages but can't evaluate myself) but is faster and more compact. Switching the default to the new v3 version should be very simple. Potentially just switching the model name string and the documentation. [Here's an example using faster-whisper-server](https://github.com/fedirz/faster-whisper-server/issues/93) > > Cheers As I said there and unless I'm mistaken, it's already available on faster whisper
Author
Owner

@allansouzasnowfox commented on GitHub (Oct 5, 2024):

Oh, of course! Sorry about that, I have the worst memory. Only just re-read the last message.

<!-- gh-comment-id:2395064990 --> @allansouzasnowfox commented on GitHub (Oct 5, 2024): Oh, of course! Sorry about that, I have the worst memory. Only just re-read the last message.
Author
Owner

@tjbck commented on GitHub (Oct 12, 2024):

Default model will not be changed for the foreseeable future due to the model being much bigger than the current model, however I'll be modifying the audio UI admin settings to allow users to easily change the default whisper model.

<!-- gh-comment-id:2408731683 --> @tjbck commented on GitHub (Oct 12, 2024): Default model will not be changed for the foreseeable future due to the model being much bigger than the current model, however I'll be modifying the audio UI admin settings to allow users to easily change the default whisper model.
Author
Owner

@tjbck commented on GitHub (Oct 21, 2024):

image

Added to dev!

<!-- gh-comment-id:2425571567 --> @tjbck commented on GitHub (Oct 21, 2024): ![image](https://github.com/user-attachments/assets/60696178-ba40-484d-affa-803594de9755) Added to dev!
Author
Owner

@ice6 commented on GitHub (Oct 21, 2024):

@tjbck wonderful feature! just looking forward to it. I test the feature, and wonder how to use gpu to run the whisper model inside open-webui.

<!-- gh-comment-id:2426950363 --> @ice6 commented on GitHub (Oct 21, 2024): @tjbck wonderful feature! just looking forward to it. I test the feature, and wonder how to use gpu to run the whisper model inside `open-webui`.
Author
Owner

@fedirz commented on GitHub (Oct 21, 2024):

@thiswillbeyourgithub FYI, the variable name includes two underscores __ instead of a single one _. So WHISPER__MODEL instead of WHISPER_MODEL. Letting you know since the issue summary only has a single one.

<!-- gh-comment-id:2427037834 --> @fedirz commented on GitHub (Oct 21, 2024): @thiswillbeyourgithub FYI, the variable name includes two underscores `__` instead of a single one `_`. So `WHISPER__MODEL` instead of `WHISPER_MODEL`. Letting you know since the issue summary only has a single one.
Author
Owner

@thiswillbeyourgithub commented on GitHub (Oct 21, 2024):

@thiswillbeyourgithub FYI, the variable name includes two underscores __ instead of a single one _. So WHISPER__MODEL instead of WHISPER_MODEL. Letting you know since the issue summary only has a single one.

Well your repo needs 2 underscores but open-webui only one, as per https://docs.openwebui.com/getting-started/env-configuration/

Or am I missing something?

<!-- gh-comment-id:2427086724 --> @thiswillbeyourgithub commented on GitHub (Oct 21, 2024): > @thiswillbeyourgithub FYI, the variable name includes two underscores `__` instead of a single one `_`. So `WHISPER__MODEL` instead of `WHISPER_MODEL`. Letting you know since the issue summary only has a single one. Well your repo needs 2 underscores but open-webui only one, as per https://docs.openwebui.com/getting-started/env-configuration/ Or am I missing something?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#52835