mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-17 08:21:12 -05:00
Feature Request: Include GenericOpenAi LLM Provider #2254
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#2254
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @actus7 on GitHub (Oct 1, 2024).
Is your feature request related to a problem? Please describe.
Currently, the
open-webuiproject does not include support for the GenericOpenAi LLM provider. It would be beneficial for users to have the option to use this provider, especially those who are already familiar with it in other projects such asMintplex-Labs/anything-llm.Describe the solution you'd like
I would like to request the inclusion of the GenericOpenAi LLM provider in the
open-webuiproject. This would include setting environment variables to define the base path (GENERIC_OPEN_AI_BASE_PATH), the API key (GENERIC_OPEN_AI_API_KEY), model preferences (GENERIC_OPEN_AI_MODEL_PREF), and token limits (GENERIC_OPEN_AI_MODEL_TOKEN_LIMIT), as implemented in theMintplex-Labs/anything-llmproject.Describe alternatives you've considered
As an alternative, other LLM providers offering similar functionalities could be considered. However, GenericOpenAi is widely used and its inclusion would enhance the flexibility and usability of
open-webui.Additional context
Implementation references in the
Mintplex-Labs/anything-llmproject:@justinh-rahb commented on GitHub (Oct 1, 2024):
I don't see any explanation for why we need another OpenAI middleware when we already have a functioning one that works with generic OpenAI API specification services? Am I missing something?
@actus7 commented on GitHub (Oct 1, 2024):
@justinh-rahb I would like to explain the new feature we are developing, which focuses on integrating models available on the GitHub Marketplace, similar to the approach used by AnythingLLM. This feature aims to optimize the interaction and use of different machine learning models, providing a more cohesive and efficient experience for users. Read the Issue again carefully and you will understand.
@justinh-rahb commented on GitHub (Oct 1, 2024):
I've read it thrice, I remain unconvinced. Please, elaborate.