mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 19:08:59 -05:00
[GH-ISSUE #5906] enh: expose WHISPER_MODEL env to admin settings #14169
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#14169
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @thiswillbeyourgithub on GitHub (Oct 4, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/5906
Originally assigned to: @tjbck on GitHub.
Hi, Openai just release their latest whisper version. It's not better in ALL languages (heard mixed results about some asian languages but can't evaluate myself) but is faster and more compact. Switching the default to the new v3 version should be very simple. Potentially just switching the model name string and the documentation. Here's an example using faster-whisper-server
Cheers
@allansouzasnowfox commented on GitHub (Oct 4, 2024):
I made some tests here, the experience using the turbo model for STT even for portuguese, that is my main language, is very impressive. I can't wait to use it in openwebui
@tcgumus commented on GitHub (Oct 4, 2024):
i will work on this. i think it should be user selectable.
@thiswillbeyourgithub commented on GitHub (Oct 4, 2024):
I think it already is, sort of, you can change environment variables
@allansouzasnowfox commented on GitHub (Oct 4, 2024):
yeah, I think that only is not possible to set the turbo version because it is using the faster-whisper to manage the model, possibly we only need to wait a new faster whisper version, but curently using the turbo model with transformers lib looks better than using the faster whisper
@thiswillbeyourgithub commented on GitHub (Oct 4, 2024):
As I said there and unless I'm mistaken, it's already available on faster whisper
@allansouzasnowfox commented on GitHub (Oct 5, 2024):
Oh, of course! Sorry about that, I have the worst memory. Only just re-read the last message.
@tjbck commented on GitHub (Oct 12, 2024):
Default model will not be changed for the foreseeable future due to the model being much bigger than the current model, however I'll be modifying the audio UI admin settings to allow users to easily change the default whisper model.
@tjbck commented on GitHub (Oct 21, 2024):
Added to dev!
@ice6 commented on GitHub (Oct 21, 2024):
@tjbck wonderful feature! just looking forward to it. I test the feature, and wonder how to use gpu to run the whisper model inside
open-webui.@fedirz commented on GitHub (Oct 21, 2024):
@thiswillbeyourgithub FYI, the variable name includes two underscores
__instead of a single one_. SoWHISPER__MODELinstead ofWHISPER_MODEL. Letting you know since the issue summary only has a single one.@thiswillbeyourgithub commented on GitHub (Oct 21, 2024):
Well your repo needs 2 underscores but open-webui only one, as per https://docs.openwebui.com/getting-started/env-configuration/
Or am I missing something?