[GH-ISSUE #7975] ability to call llm from tool from the model list without adding ollama/openai keys #118258

New Issue

GiteaMirror · 2026-05-20T19:40:09-05:00

GiteaMirror commented

2026-05-20 19:40:09 -05:00

Originally created by @LorenzoBoccaccia on GitHub (Dec 20, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/7975

Feature Request

allow tools to invoke the models that user has configured and available, allow user to select which model is available for tool use.

Is your feature request related to a problem? Please describe.
Retrieval tool may produce a lot of unrelated token, especially web based crawling, having a llm handling summarization or data extraction would allow a more coherent discussion especially with smaller models

Describe the solution you'd like
allow valves to have a model type, with a dropdown of existing models
a model in a valve is callable in streaming or normal mode for production

Describe alternatives you've considered
reading the environment variables and guessing which models are available and where, but the limit here is that the tool wouldn't know which model the user wants to be used

Originally created by @LorenzoBoccaccia on GitHub (Dec 20, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/7975 # Feature Request allow tools to invoke the models that user has configured and available, allow user to select which model is available for tool use. **Is your feature request related to a problem? Please describe.** Retrieval tool may produce a lot of unrelated token, especially web based crawling, having a llm handling summarization or data extraction would allow a more coherent discussion especially with smaller models **Describe the solution you'd like** allow valves to have a model type, with a dropdown of existing models a model in a valve is callable in streaming or normal mode for production **Describe alternatives you've considered** reading the environment variables and guessing which models are available and where, but the limit here is that the tool wouldn't know which model the user wants to be used

GiteaMirror closed this issue

2026-05-20 19:40:09 -05:00

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#118258