Originally created by @CookSleep on GitHub (Aug 7, 2024).
Is your feature request related to a problem? Please describe.
I instructed the model to use a Tool to obtain search engine results, and attempted to have the model call the Tool again after reviewing the search result text returned by the Tool, in order to read the content of specific search result links. However, currently Open WebUI only allows one Tool call per model output, which is quite frustrating...
Describe the solution you'd like
Allow the model to call functions multiple times in a single output
Describe alternatives you've considered
Making multiple requests, but that only makes searching more of a hassle!
Additional context
I know some folks might recommend I use Reader's search engine, but honestly, I feel the quality of content it retrieves is just so-so, and the diversity doesn't really meet my expectations... Plus, I'm sure there are tons of use cases where models need to call functions multiple times in one output.
Originally created by @CookSleep on GitHub (Aug 7, 2024).
**Is your feature request related to a problem? Please describe.**
I instructed the model to use a Tool to obtain search engine results, and attempted to have the model call the Tool again after reviewing the search result text returned by the Tool, in order to read the content of specific search result links. However, currently Open WebUI only allows one Tool call per model output, which is quite frustrating...
**Describe the solution you'd like**
Allow the model to call functions multiple times in a single output
**Describe alternatives you've considered**
Making multiple requests, but that only makes searching more of a hassle!
**Additional context**
I know some folks might recommend I use Reader's search engine, but honestly, I feel the quality of content it retrieves is just so-so, and the diversity doesn't really meet my expectations... Plus, I'm sure there are tons of use cases where models need to call functions multiple times in one output.
I believe @michaelpoluektov has been pushing for adding support for this as well. I don't recall if he's already started an issue or PR for it, but he can chime in his thoughts either way.
@justinh-rahb commented on GitHub (Aug 7, 2024):
I believe @michaelpoluektov has been pushing for adding support for this as well. I don't recall if he's already started an issue or PR for it, but he can chime in his thoughts either way.
@michaelpoluektov commented on GitHub (Aug 7, 2024):
I started an issue but no PR yet. Adding this requires quite a major refactor, and I'll most likely submit a draft this weekend. Issue tracked here:
https://github.com/open-webui/open-webui/issues/4219
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @CookSleep on GitHub (Aug 7, 2024).
Is your feature request related to a problem? Please describe.
I instructed the model to use a Tool to obtain search engine results, and attempted to have the model call the Tool again after reviewing the search result text returned by the Tool, in order to read the content of specific search result links. However, currently Open WebUI only allows one Tool call per model output, which is quite frustrating...
Describe the solution you'd like
Allow the model to call functions multiple times in a single output
Describe alternatives you've considered
Making multiple requests, but that only makes searching more of a hassle!
Additional context
I know some folks might recommend I use Reader's search engine, but honestly, I feel the quality of content it retrieves is just so-so, and the diversity doesn't really meet my expectations... Plus, I'm sure there are tons of use cases where models need to call functions multiple times in one output.
@justinh-rahb commented on GitHub (Aug 7, 2024):
I believe @michaelpoluektov has been pushing for adding support for this as well. I don't recall if he's already started an issue or PR for it, but he can chime in his thoughts either way.
@michaelpoluektov commented on GitHub (Aug 7, 2024):
I started an issue but no PR yet. Adding this requires quite a major refactor, and I'll most likely submit a draft this weekend. Issue tracked here:
https://github.com/open-webui/open-webui/issues/4219
@lee-b commented on GitHub (Aug 11, 2024):
FYI, LocalAI implements the required backend API locally: https://localai.io/features/openai-functions/