[GH-ISSUE #18659] issue: RAG not working with Hybrid Search

Originally created by @bborowin on GitHub (Oct 27, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/18659 ### Reported in Discussions: https://github.com/open-webui/open-webui/discussions/13221, https://github.com/open-webui/open-webui/discussions/7194 ### Check Existing Issues - [x] I have searched for any existing and/or related issues. - [x] I have searched for any existing and/or related discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version v0.6.34 ### Ollama Version (if applicable) vLLM v0.11.0 ### Operating System Ubuntu 25.04 ### Browser (if applicable) Brave ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior Query results with relevant content from context (Knowledge or attached file) ### Actual Behavior Generic results generated by LLM ### Steps to Reproduce - enable hybrid search with default params, any choice of reranking model / service - use model with knowledge base attached OR upload file to a new chat - query referring to something specific from KB / file content There are two discussions documenting this issue, since version 0.4.2 https://github.com/open-webui/open-webui/discussions/13221, https://github.com/open-webui/open-webui/discussions/7194 Please refer to linked discussions for all the relevant detail. ### Logs & Screenshots When using an external reranker (eg, vLLM in a container in the same cluster) the reranker logs show valid queries: 200 OK (meaning the payload is in the right format and the correct model was specified) The one relevant line from the OWU logs is: > open_webui.retrieval.utils:query_doc_with_hybrid_search:168 - query_doc_with_hybrid_search:result [[]] [[]] - {}atches: 100% ### Additional Information There are two discussions documenting this issue, since version 0.4.2 https://github.com/open-webui/open-webui/discussions/13221, https://github.com/open-webui/open-webui/discussions/7194 Please refer to linked discussions for detailed logs.

GiteaMirror commented

2026-05-05 20:51:35 -05:00

Owner

Originally created by @bborowin on GitHub (Oct 27, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/18659

Reported in Discussions:

https://github.com/open-webui/open-webui/discussions/13221, https://github.com/open-webui/open-webui/discussions/7194

Check Existing Issues

I have searched for any existing and/or related issues.
I have searched for any existing and/or related discussions.
I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

v0.6.34

Ollama Version (if applicable)

vLLM v0.11.0

Operating System

Ubuntu 25.04

Browser (if applicable)

Brave

Confirmation

I have read and followed all instructions in README.md.
I am using the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
I have included the Docker container logs.
I have provided every relevant configuration, setting, and environment variable used in my setup.
I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
Start with the initial platform/version/OS and dependencies used,
Specify exact install/launch/configure commands,
List URLs visited, user input (incl. example values/emails/passwords if needed),
Describe all options and toggles enabled or changed,
Include any files or environmental changes,
Identify the expected and actual result at each stage,
Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

Query results with relevant content from context (Knowledge or attached file)

Actual Behavior

Generic results generated by LLM

Steps to Reproduce

enable hybrid search with default params, any choice of reranking model / service
use model with knowledge base attached OR upload file to a new chat
query referring to something specific from KB / file content

There are two discussions documenting this issue, since version 0.4.2

Please refer to linked discussions for all the relevant detail.

Logs & Screenshots

When using an external reranker (eg, vLLM in a container in the same cluster) the reranker logs show valid queries: 200 OK (meaning the payload is in the right format and the correct model was specified)

The one relevant line from the OWU logs is:

open_webui.retrieval.utils:query_doc_with_hybrid_search:168 - query_doc_with_hybrid_search:result - {}atches: 100%

Additional Information

Please refer to linked discussions for detailed logs.

GiteaMirror added the bug label 2026-05-05 20:51:35 -05:00

GiteaMirror closed this issue

2026-05-05 20:51:36 -05:00

[GH-ISSUE #18659] issue: RAG not working with Hybrid Search #57329