We've got there different models that run on gpu. e.g. ggml-large-v3-turbo.bin.
Afaik, the localai API is also openai compatible.
Alternatives Considered
No response
Additional Context
No response
Originally created by @markuman on GitHub (Jul 30, 2025).
### Check Existing Issues
- [x] I have searched the existing issues and discussions.
### Problem Description
Currently there are only 3 available Speech-to-Text engines.
- openai
- deepgram
- azure
### Desired Solution you'd like
It would be cool to define/set a custom (selfhosted) API Endoint.
In our case a selfhosted [localai](https://github.com/mudler/LocalAI)
`https://localai.company.de/v1/audio/transcriptions`
We've got there different models that run on gpu. e.g. `ggml-large-v3-turbo.bin`.
Afaik, the localai API is also openai compatible.
### Alternatives Considered
_No response_
### Additional Context
_No response_
Ah cool. Didn't see this.
The problem is, that the API key is required, even if no one is defined at localai
@markuman commented on GitHub (Jul 30, 2025):
Ah cool. Didn't see this.
The problem is, that the API key is required, even if no one is defined at localai
<img width="554" height="150" alt="Image" src="https://github.com/user-attachments/assets/67045f1e-8014-4b9c-9742-81908daf929f" />
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @markuman on GitHub (Jul 30, 2025).
Check Existing Issues
Problem Description
Currently there are only 3 available Speech-to-Text engines.
Desired Solution you'd like
It would be cool to define/set a custom (selfhosted) API Endoint.
In our case a selfhosted localai
https://localai.company.de/v1/audio/transcriptionsWe've got there different models that run on gpu. e.g.
ggml-large-v3-turbo.bin.Afaik, the localai API is also openai compatible.
Alternatives Considered
No response
Additional Context
No response
@tjbck commented on GitHub (Jul 30, 2025):
Already implemented!
@markuman commented on GitHub (Jul 30, 2025):
Ah cool. Didn't see this.
The problem is, that the API key is required, even if no one is defined at localai
@markuman commented on GitHub (Jul 30, 2025):
Ok, in that case I can fill it with any character ...localai will accept it