mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 19:08:59 -05:00
[GH-ISSUE #11614] feat: Use native web search grounding from LLM providers #54962
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#54962
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @rragundez on GitHub (Mar 12, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/11614
Problem Description
I know there is a web search functionality within Open WebUI which works quite well. There is also for some LLM providers the capability they offer for web search grounding out of the box, which would mean there is no need to mantain the whole process to websearch outside of the LLM context. For example:
I see some difficulties right nor with the Open WebUI web search implementation , sometimes the web loaders hang, I would imagine because of "difficult" pages to load, it handles its own retry mechanism, etc.
If using the native functionality of the LLM providers this could be completly off-boarded from the app and on to the LLMs API calls themselves.
Desired Solution you'd like
Having the capability to utilize the native functionality of LLMs to perform web search grounding like the one I mentioned for Gemini or Azure Open AI.
@cjccjj commented on GitHub (Mar 13, 2025):
To use grounding search, like Gemini grounding, gemini API must be used. Gemini has an OpenAI API mode, but it does not support grounding. So the question is, will Open webui support API other than OpenAI API?
For now, you can use function/PIPE to connect to gemini and use grounding, I have been using it for weeks, real time search is so fast and nice, that I never use the Open webui search since then.
This is the one I am using:
https://github.com/suurt8ll/open_webui_functions/blob/master/gemini_manifold.py
@rragundez commented on GitHub (Mar 13, 2025):
Looks quite nice, thanks. Is there any feature in open webui that by using this function it will be lost?
Do you know if there is something similar for Azure Open ai?
@cjccjj commented on GitHub (Mar 13, 2025):
I didn't notice any. Only issue is, if you restart Open webui, the function is disabled, have to open it, click save and enable it again.
Reason is the fucntion need to import gemini api package, to be able to use it, and that can only be triggered when you "save it".
Never used Azure, I made a few search, Azure bing grounding seems not working the same way as gemini, look like it is working as agent, which if ture, will not work as good as gemini.