mirror of
https://github.com/open-webui/open-webui.git
synced 2026-06-03 07:24:59 -05:00
[GH-ISSUE #13329] feat: Add additional OpenAI endpoints for vLLM #16888
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @matthew-kusz on GitHub (Apr 29, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/13329
Check Existing Issues
Problem Description
VLLM offers OpenAI compatible endpoints, https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#supported-apis. One issue I have seen come up is the missing
/v1/completionsendpoint. It would be nice if all of them were supported even though some of them are considered legacy endpoints since there are tools that still use them.Desired Solution you'd like
I would like to be able to access all of the vLLM OpenAI API endpoints.
Alternatives Considered
An alternative would be to not use Open-WebUI's API and only use vLLMs but I would prefer to be able to utilize the former.
Additional Context
No response