I have searched the existing issues and discussions.
Problem Description
VLLM offers OpenAI compatible endpoints, https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#supported-apis. One issue I have seen come up is the missing /v1/completions endpoint. It would be nice if all of them were supported even though some of them are considered legacy endpoints since there are tools that still use them.
Desired Solution you'd like
I would like to be able to access all of the vLLM OpenAI API endpoints.
Alternatives Considered
An alternative would be to not use Open-WebUI's API and only use vLLMs but I would prefer to be able to utilize the former.
Additional Context
No response
Originally created by @matthew-kusz on GitHub (Apr 29, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/13329
### Check Existing Issues
- [x] I have searched the existing issues and discussions.
### Problem Description
VLLM offers OpenAI compatible endpoints, [https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#supported-apis](https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#supported-apis). One issue I have seen come up is the missing `/v1/completions` endpoint. It would be nice if all of them were supported even though some of them are considered legacy endpoints since there are tools that still use them.
### Desired Solution you'd like
I would like to be able to access all of the vLLM OpenAI API endpoints.
### Alternatives Considered
An alternative would be to not use Open-WebUI's API and only use vLLMs but I would prefer to be able to utilize the former.
### Additional Context
_No response_
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @matthew-kusz on GitHub (Apr 29, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/13329
Check Existing Issues
Problem Description
VLLM offers OpenAI compatible endpoints, https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#supported-apis. One issue I have seen come up is the missing
/v1/completionsendpoint. It would be nice if all of them were supported even though some of them are considered legacy endpoints since there are tools that still use them.Desired Solution you'd like
I would like to be able to access all of the vLLM OpenAI API endpoints.
Alternatives Considered
An alternative would be to not use Open-WebUI's API and only use vLLMs but I would prefer to be able to utilize the former.
Additional Context
No response