[GH-ISSUE #15920] issue: Not able to use gemini grounding in openwebui #137448

Closed
opened 2026-05-25 07:22:26 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @anirugu on GitHub (Jul 21, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/15920

Check Existing Issues

  • I have searched the existing issues and discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

latest

Ollama Version (if applicable)

No response

Operating System

Windows 11

Browser (if applicable)

No response

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided every relevant configuration, setting, and environment variable used in my setup.
  • I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
  • I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
  • Start with the initial platform/version/OS and dependencies used,
  • Specify exact install/launch/configure commands,
  • List URLs visited, user input (incl. example values/emails/passwords if needed),
  • Describe all options and toggles enabled or changed,
  • Include any files or environmental changes,
  • Identify the expected and actual result at each stage,
  • Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

I am using openwebui through litellm and things are running fine. I am trying to use gemini 2.5 pro in postman by passing

"tools": [{"googleSearch": {}}]

I am able to search the internet. Is there a way I can set this in openwebui so whenever I am calling this model, it will pass this in request.

Actual Behavior

not able to search the internet.

Steps to Reproduce

use this in litellm config.yaml

  • model_name: gemini-2.5-pro
    litellm_params:
    model: gemini/gemini-2.5-pro
    api_key: "Testingkeyhere"

Logs & Screenshots

Image

Additional Information

No response

Originally created by @anirugu on GitHub (Jul 21, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/15920 ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version latest ### Ollama Version (if applicable) _No response_ ### Operating System Windows 11 ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior I am using openwebui through litellm and things are running fine. I am trying to use gemini 2.5 pro in postman by passing `"tools": [{"googleSearch": {}}]` I am able to search the internet. Is there a way I can set this in openwebui so whenever I am calling this model, it will pass this in request. ### Actual Behavior not able to search the internet. ### Steps to Reproduce use this in litellm config.yaml - model_name: gemini-2.5-pro litellm_params: model: gemini/gemini-2.5-pro api_key: "Testingkeyhere" ### Logs & Screenshots <img width="1495" height="591" alt="Image" src="https://github.com/user-attachments/assets/e1bdde56-1434-45a7-b925-946805dec7c9" /> ### Additional Information _No response_
GiteaMirror added the bug label 2026-05-25 07:22:26 -05:00
Author
Owner

@almajo commented on GitHub (Jul 22, 2025):

You have the option to pass custom parameters to each model (see the model parameters like temperature etc. and scroll all the way down). As tools is a special keyword, I'm not sure how this is being handled, though. Maybe it works.

<!-- gh-comment-id:3101841182 --> @almajo commented on GitHub (Jul 22, 2025): You have the option to pass custom parameters to each model (see the model parameters like temperature etc. and scroll all the way down). As tools is a special keyword, I'm not sure how this is being handled, though. Maybe it works.
Author
Owner

@rgaricano commented on GitHub (Jul 22, 2025):

you can use this tool: https://openwebui.com/t/sgpsonnet/gemini_search

<!-- gh-comment-id:3101917562 --> @rgaricano commented on GitHub (Jul 22, 2025): you can use this tool: https://openwebui.com/t/sgpsonnet/gemini_search
Author
Owner

@athoik commented on GitHub (Jul 23, 2025):

@anirugu you can always enable google search on LiteLLM config as seen here https://github.com/BerriAI/litellm/issues/8205#issuecomment-2905003919

  - model_name: Google/gemini-2.5-flash-with-search
    litellm_params:
      model: gemini/gemini-2.5-flash-preview-05-20
      api_key: os.environ/GEMINI_API_KEY
      merge_reasoning_content_in_choices: true
      allowed_openai_params: ["reasoning_effort"]
      reasoning_effort: "low"
      tools:
        - googleSearch: {}
      cache_control_injection_points:
        - location: message
<!-- gh-comment-id:3105233265 --> @athoik commented on GitHub (Jul 23, 2025): @anirugu you can always enable google search on LiteLLM config as seen here https://github.com/BerriAI/litellm/issues/8205#issuecomment-2905003919 ``` - model_name: Google/gemini-2.5-flash-with-search litellm_params: model: gemini/gemini-2.5-flash-preview-05-20 api_key: os.environ/GEMINI_API_KEY merge_reasoning_content_in_choices: true allowed_openai_params: ["reasoning_effort"] reasoning_effort: "low" tools: - googleSearch: {} cache_control_injection_points: - location: message ```
Author
Owner

@anirugu commented on GitHub (Jul 23, 2025):

@athoik

I tried this one and with only "tools" part too, I am still not getting the result, I created a issue in litellm as well.

<!-- gh-comment-id:3108841196 --> @anirugu commented on GitHub (Jul 23, 2025): @athoik I tried this one and with only "tools" part too, I am still not getting the result, I created a issue in litellm as well.
Author
Owner

@athoik commented on GitHub (Jul 25, 2025):

@athoik

I tried this one and with only "tools" part too, I am still not getting the result, I created a issue in litellm as well.

It works with Gemini 2.0 Flash, but it fails with Gemini 2.5 Flash or Gemini 2.5 Pro.

Please note that you can set tools using Advanced Params on model, without changes on LiteLLM config.

Image Image Image
<!-- gh-comment-id:3117844664 --> @athoik commented on GitHub (Jul 25, 2025): > [@athoik](https://github.com/athoik) > > I tried this one and with only "tools" part too, I am still not getting the result, I created a issue in litellm as well. It works with Gemini 2.0 Flash, but it fails with Gemini 2.5 Flash or Gemini 2.5 Pro. Please note that you can set tools using Advanced Params on model, without changes on LiteLLM config. <img width="694" height="84" alt="Image" src="https://github.com/user-attachments/assets/8fae7d59-3050-4202-be38-51c459d6da31" /> <img width="1135" height="545" alt="Image" src="https://github.com/user-attachments/assets/ef167d7d-d3d0-4279-9a9e-e580bbda862f" /> <img width="700" height="89" alt="Image" src="https://github.com/user-attachments/assets/570c3f2a-cf77-43ea-a883-2af9236e50d7" />
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#137448