mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 19:08:59 -05:00
[GH-ISSUE #6821] enh: manual model list for almost-OpenAI-compatible providers #30030
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#30030
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @rndmcnlly on GitHub (Nov 9, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/6821
Originally assigned to: @tjbck on GitHub.
Feature Request
Commercial LLM providers like Google and SambaNova are recently trying to offer OpenAI endpoint compatibility, but they often forget to fully implement the
/modelsendpoint used by OWUI to dynamically list available models. If the Connections admin panel had some sort of optional "model list override", we could start using these providers even was they drag their feet building out fill OpenAI compatibility.When the user clicks the "Verify connection" button when an override list is non-empty, then OWUI would instead try to get information only for the first item on the override list rather than trying to dynamically load the list.
@tjbck commented on GitHub (Nov 9, 2024):
Been on my mind lately, investigating.
@fabigr8 commented on GitHub (Nov 10, 2024):
Had the same issue for LitServe, as they don't implement
/modelsin their openAI-API standard as well :( luckily I could extend their API via a workaround. So 👍🏼 +1 from my side, would be a great feature.@tjbck commented on GitHub (Nov 12, 2024):
Added to dev, Testing wanted here!