feat: Speech-to-Text (OpenAI) - define custom backend #5911

Closed
opened 2025-11-11 16:38:15 -06:00 by GiteaMirror · 3 comments
Owner

Originally created by @markuman on GitHub (Jul 30, 2025).

Check Existing Issues

  • I have searched the existing issues and discussions.

Problem Description

Currently there are only 3 available Speech-to-Text engines.

  • openai
  • deepgram
  • azure

Desired Solution you'd like

It would be cool to define/set a custom (selfhosted) API Endoint.
In our case a selfhosted localai

https://localai.company.de/v1/audio/transcriptions

We've got there different models that run on gpu. e.g. ggml-large-v3-turbo.bin.
Afaik, the localai API is also openai compatible.

Alternatives Considered

No response

Additional Context

No response

Originally created by @markuman on GitHub (Jul 30, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description Currently there are only 3 available Speech-to-Text engines. - openai - deepgram - azure ### Desired Solution you'd like It would be cool to define/set a custom (selfhosted) API Endoint. In our case a selfhosted [localai](https://github.com/mudler/LocalAI) `https://localai.company.de/v1/audio/transcriptions` We've got there different models that run on gpu. e.g. `ggml-large-v3-turbo.bin`. Afaik, the localai API is also openai compatible. ### Alternatives Considered _No response_ ### Additional Context _No response_
Author
Owner

@tjbck commented on GitHub (Jul 30, 2025):

Already implemented!

Image
@tjbck commented on GitHub (Jul 30, 2025): Already implemented! <img width="496" height="184" alt="Image" src="https://github.com/user-attachments/assets/8602b914-cbaa-4c9c-bb3c-e00857854682" />
Author
Owner

@markuman commented on GitHub (Jul 30, 2025):

Ah cool. Didn't see this.
The problem is, that the API key is required, even if no one is defined at localai

Image
@markuman commented on GitHub (Jul 30, 2025): Ah cool. Didn't see this. The problem is, that the API key is required, even if no one is defined at localai <img width="554" height="150" alt="Image" src="https://github.com/user-attachments/assets/67045f1e-8014-4b9c-9742-81908daf929f" />
Author
Owner

@markuman commented on GitHub (Jul 30, 2025):

Ok, in that case I can fill it with any character ...localai will accept it

@markuman commented on GitHub (Jul 30, 2025): Ok, in that case I can fill it with any character ...localai will accept it
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#5911