mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-07 11:28:35 -05:00
[GH-ISSUE #1227] feat: Model Whitelisting for LiteLLM #12403
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @flyfox666 on GitHub (Mar 20, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/1227
Is your feature request related to a problem? Please describe.
I have both local model and litellm model in use, then when assigning to registered users, I found that I can only use model whistling function for local model, litellm connected model can still be selected in users. Is it possible to limit Model Whitelisting to litellm models as well?
Describe the solution you'd like
Model Whistling function could also be affected in litellm connected model
Describe alternatives you've considered
Set up password for litellm connected model useing
@justinh-rahb commented on GitHub (Mar 20, 2024):
In the Ollama and OpenAI endpoints, you have no control over what the
/api/modelsor/v1/modelsendpoints return, so a whitelist was deemed useful to limit what's displayed to users. In LiteLLM, you control which models you add so it was assumed that admins would only add models they want their users to use. More granular access controls in general are still on the roadmap.@flyfox666 commented on GitHub (Mar 20, 2024):
Oh ,thanks, justinh-rahb,
Appreciate if it is possible to update this fuction in future.
The main reason for my issue is sometimes could only Litellm for my wife and not for my friend.
@justinh-rahb commented on GitHub (Mar 20, 2024):
I agree it would be good to extend the feature to cover LiteLLM as well, just trying to shed light on the possible reasons it was overlooked or deferred.
@flyfox666 commented on GitHub (Mar 20, 2024):
much appreicate