I have searched the existing issues and discussions.
Problem Description
Currently ANY OpenAPI compatible connection is marked as external, being that other local LLM providers (like mlx_lm) provide a compatible endpoint but still are local. Currently by default all models via OpenAPI connection shows are external
Desired Solution you'd like
There should be a way to still show this models as local and not only as external
Alternatives Considered
No response
Additional Context
Originally created by @martinoturrina on GitHub (May 8, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/13678
Originally assigned to: @tjbck on GitHub.
### Check Existing Issues
- [x] I have searched the existing issues and discussions.
### Problem Description
Currently ANY OpenAPI compatible connection is marked as external, being that other local LLM providers (like mlx_lm) provide a compatible endpoint but still are local. Currently by default all models via OpenAPI connection shows are external
### Desired Solution you'd like
There should be a way to still show this models as local and not only as external
### Alternatives Considered
_No response_
### Additional Context
<!-- gh-comment-id:2862525745 -->
@Azzeo commented on GitHub (May 8, 2025):
There should be an override option, and not be dependent on whether it is in the same local network
For example, the VLLM server can be hosted at
https://vllm.intern.mycompanyproduction.com/v1/chat/completions
While OWU can be hosted at:
https://chat.mycompany.com/
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @martinoturrina on GitHub (May 8, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/13678
Originally assigned to: @tjbck on GitHub.
Check Existing Issues
Problem Description
Currently ANY OpenAPI compatible connection is marked as external, being that other local LLM providers (like mlx_lm) provide a compatible endpoint but still are local. Currently by default all models via OpenAPI connection shows are external
Desired Solution you'd like
There should be a way to still show this models as local and not only as external
Alternatives Considered
No response
Additional Context
@Azzeo commented on GitHub (May 8, 2025):
There should be an override option, and not be dependent on whether it is in the same local network
For example, the VLLM server can be hosted at
https://vllm.intern.mycompanyproduction.com/v1/chat/completions
While OWU can be hosted at:
https://chat.mycompany.com/
@tjbck commented on GitHub (May 8, 2025):
Agreed, investigating.
@imbible commented on GitHub (May 12, 2025):
Bump. Very useful feature.
@tjbck commented on GitHub (May 16, 2025):
Addressed with
08e4c163ea