Is it possible to integrate a Kserve Inference service as it complies with the openai specifications. Any solid example will help.
Originally created by @thecloudgarage on GitHub (Dec 2, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/7531
# Feature Request
Is it possible to integrate a Kserve Inference service as it complies with the openai specifications. Any solid example will help.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @thecloudgarage on GitHub (Dec 2, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/7531
Feature Request
Is it possible to integrate a Kserve Inference service as it complies with the openai specifications. Any solid example will help.