mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-23 10:02:10 -05:00
[GH-ISSUE #11190] [Feature Request]: Support adding multiple interface configurations compatible with the OpenAI API. #70741
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @hzycn on GitHub (Mar 5, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/11190
Check Existing Issues
Problem Description
Support adding multiple interface configurations compatible with the OpenAI API.
The usage is as follows:
1, ollama run deepseek llm
2, The first: compatible with the OpenAI API to run the rerank model.
3,The second: compatible with the OpenAI API to run the Qwen2.5-VL multimodal model.
Desired Solution you'd like
I hope to add multiple OpenAI API interface addresses so that I can use multiple locally deployed models. For example:
1, Ollama API configuration , run llm.
2, OpenAI API configuration , run the rerank model.
3, Configuration compatible with the OpenAI API , run Qwen2.5-VL multimodal model.
Alternatives Considered
On the basis of Ollama and OpenAI API, add a configuration compatible with the OpenAI API in parallel, with the same functionality as the existing OpenAI API configuration.
Additional Context
No response