feat: openai compatible tool usage #1714

Closed
opened 2025-11-11 14:50:41 -06:00 by GiteaMirror · 3 comments
Owner

Originally created by @CookSleep on GitHub (Aug 7, 2024).

Is your feature request related to a problem? Please describe.
I instructed the model to use a Tool to obtain search engine results, and attempted to have the model call the Tool again after reviewing the search result text returned by the Tool, in order to read the content of specific search result links. However, currently Open WebUI only allows one Tool call per model output, which is quite frustrating...

Describe the solution you'd like
Allow the model to call functions multiple times in a single output

Describe alternatives you've considered
Making multiple requests, but that only makes searching more of a hassle!

Additional context
I know some folks might recommend I use Reader's search engine, but honestly, I feel the quality of content it retrieves is just so-so, and the diversity doesn't really meet my expectations... Plus, I'm sure there are tons of use cases where models need to call functions multiple times in one output.

Originally created by @CookSleep on GitHub (Aug 7, 2024). **Is your feature request related to a problem? Please describe.** I instructed the model to use a Tool to obtain search engine results, and attempted to have the model call the Tool again after reviewing the search result text returned by the Tool, in order to read the content of specific search result links. However, currently Open WebUI only allows one Tool call per model output, which is quite frustrating... **Describe the solution you'd like** Allow the model to call functions multiple times in a single output **Describe alternatives you've considered** Making multiple requests, but that only makes searching more of a hassle! **Additional context** I know some folks might recommend I use Reader's search engine, but honestly, I feel the quality of content it retrieves is just so-so, and the diversity doesn't really meet my expectations... Plus, I'm sure there are tons of use cases where models need to call functions multiple times in one output.
GiteaMirror added the enhancementhelp wantedcore labels 2025-11-11 14:50:41 -06:00
Author
Owner

@justinh-rahb commented on GitHub (Aug 7, 2024):

I believe @michaelpoluektov has been pushing for adding support for this as well. I don't recall if he's already started an issue or PR for it, but he can chime in his thoughts either way.

@justinh-rahb commented on GitHub (Aug 7, 2024): I believe @michaelpoluektov has been pushing for adding support for this as well. I don't recall if he's already started an issue or PR for it, but he can chime in his thoughts either way.
Author
Owner

@michaelpoluektov commented on GitHub (Aug 7, 2024):

I started an issue but no PR yet. Adding this requires quite a major refactor, and I'll most likely submit a draft this weekend. Issue tracked here:

https://github.com/open-webui/open-webui/issues/4219

@michaelpoluektov commented on GitHub (Aug 7, 2024): I started an issue but no PR yet. Adding this requires quite a major refactor, and I'll most likely submit a draft this weekend. Issue tracked here: https://github.com/open-webui/open-webui/issues/4219
Author
Owner

@lee-b commented on GitHub (Aug 11, 2024):

FYI, LocalAI implements the required backend API locally: https://localai.io/features/openai-functions/

@lee-b commented on GitHub (Aug 11, 2024): FYI, LocalAI implements the required backend API locally: https://localai.io/features/openai-functions/
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#1714