github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-08-30 17:25:30 -05:00
Code Issues 2.4k Packages Projects Releases 129 Wiki Activity

Web search broken on 0.5.15? #3999

New Issue
Closed
opened 2025-11-11 15:44:02 -06:00 by GiteaMirror · 21 comments
GiteaMirror commented 2025-11-11 15:44:02 -06:00
Owner
Copy Link
Copy Source

Originally created by @ProjectMoon on GitHub (Feb 20, 2025).

Bug Report

Installation Method

Docker

Environment

  • Open WebUI Version: 0.5.15

  • Ollama (if applicable): 0.5.11

  • Operating System: Linux

  • Browser (if applicable): Firefox

Expected Behavior:

Web search works.

Actual Behavior:

OpenWebUI goes through the whole search process, but the results are never given to the LLM for context.

I assume it's because of this error:

Traceback (most recent call last):
  File "/app/backend/open_webui/retrieval/utils.py", line 436, in get_sources_from_files
    context = query_collection(
              ^^^^^^^^^^^^^^^^^
  File "/app/backend/open_webui/retrieval/utils.py", line 275, in query_collection
    return merge_and_sort_query_results(results, k=k, reverse=False)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/backend/open_webui/retrieval/utils.py", line 189, in merge_and_sort_query_results
    [
  File "/app/backend/open_webui/retrieval/utils.py", line 190, in <listcomp>
    f"{id}-{meta['file_id']}"
            ~~~~^^^^^^^^^^^
KeyError: 'file_id'

This happens right after seeing INFO [open_webui.retrieval.utils] query_doc:result in the logs.

Description

Bug Summary:
Web search results are not delivered to the LLM.

Reproduction Details

Steps to Reproduce:
Toggle on search when chatting with LLM. SearxNG was used in this case.

Originally created by @ProjectMoon on GitHub (Feb 20, 2025). # Bug Report ## Installation Method Docker ## Environment - **Open WebUI Version:** 0.5.15 - **Ollama (if applicable):** 0.5.11 - **Operating System:** Linux - **Browser (if applicable):** Firefox ## Expected Behavior: Web search works. ## Actual Behavior: OpenWebUI goes through the whole search process, but the results are never given to the LLM for context. I assume it's because of this error: ``` Traceback (most recent call last): File "/app/backend/open_webui/retrieval/utils.py", line 436, in get_sources_from_files context = query_collection( ^^^^^^^^^^^^^^^^^ File "/app/backend/open_webui/retrieval/utils.py", line 275, in query_collection return merge_and_sort_query_results(results, k=k, reverse=False) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/backend/open_webui/retrieval/utils.py", line 189, in merge_and_sort_query_results [ File "/app/backend/open_webui/retrieval/utils.py", line 190, in <listcomp> f"{id}-{meta['file_id']}" ~~~~^^^^^^^^^^^ KeyError: 'file_id' ``` This happens right after seeing `INFO [open_webui.retrieval.utils] query_doc:result` in the logs. ## Description **Bug Summary:** Web search results are not delivered to the LLM. ## Reproduction Details **Steps to Reproduce:** Toggle on search when chatting with LLM. SearxNG was used in this case.
GiteaMirror commented 2025-11-11 15:44:03 -06:00
Author
Owner
Copy Link
Copy Source

@ProjectMoon commented on GitHub (Feb 20, 2025):

Also, not using full context injection. When full context is enabled, search works. So this only affects the vector search.

@ProjectMoon commented on GitHub (Feb 20, 2025): Also, not using full context injection. When full context is enabled, search works. So this only affects the vector search.
GiteaMirror commented 2025-11-11 15:44:04 -06:00
Author
Owner
Copy Link
Copy Source

@907739769 commented on GitHub (Feb 20, 2025):

I am the same too.

@907739769 commented on GitHub (Feb 20, 2025): I am the same too.
GiteaMirror commented 2025-11-11 15:44:04 -06:00
Author
Owner
Copy Link
Copy Source

@Classic298 commented on GitHub (Feb 20, 2025):

For me it works. Odd. I use google-pse btw. Works both in full context mode ON and OFF. Works always for me.

Debian 12, pip installation

@Classic298 commented on GitHub (Feb 20, 2025): For me it works. Odd. I use google-pse btw. Works both in full context mode ON and OFF. Works always for me. Debian 12, pip installation
GiteaMirror commented 2025-11-11 15:44:04 -06:00
Author
Owner
Copy Link
Copy Source

@ProjectMoon commented on GitHub (Feb 20, 2025):

Is it a new installation? Or did you reset vector storage? Wondering if it's related to that.

@ProjectMoon commented on GitHub (Feb 20, 2025): Is it a new installation? Or did you reset vector storage? Wondering if it's related to that.
GiteaMirror commented 2025-11-11 15:44:04 -06:00
Author
Owner
Copy Link
Copy Source

@krittaprot commented on GitHub (Feb 20, 2025):

+1 for this issue, I got the same error using SearXNG.

@krittaprot commented on GitHub (Feb 20, 2025): +1 for this issue, I got the same error using SearXNG.
GiteaMirror commented 2025-11-11 15:44:04 -06:00
Author
Owner
Copy Link
Copy Source

@eaiu commented on GitHub (Feb 20, 2025):

The same issue, can't use vector search.

@eaiu commented on GitHub (Feb 20, 2025): The same issue, can't use vector search.
GiteaMirror commented 2025-11-11 15:44:04 -06:00
Author
Owner
Copy Link
Copy Source

@karllee830 commented on GitHub (Feb 20, 2025):

Same problem with using DuckDuckGo.

If full context mode is enabled, this issue does not occur; if disabled, this issue arises.

@karllee830 commented on GitHub (Feb 20, 2025): Same problem with using DuckDuckGo. ### **If full context mode is enabled, this issue does not occur; if disabled, this issue arises.**
GiteaMirror commented 2025-11-11 15:44:05 -06:00
Author
Owner
Copy Link
Copy Source

@EMjetrot commented on GitHub (Feb 20, 2025):

Struggling as well and using Azure Bing Search API for websearch, which worked before.

@EMjetrot commented on GitHub (Feb 20, 2025): Struggling as well and using Azure Bing Search API for websearch, which worked before.
GiteaMirror commented 2025-11-11 15:44:05 -06:00
Author
Owner
Copy Link
Copy Source

@Classic298 commented on GitHub (Feb 20, 2025):

Is everyone here using docker, who is struggling with it? I am, from the comments so far, the only one using pip installation. And for me it works perfectly fine with full context on or off.

@Classic298 commented on GitHub (Feb 20, 2025): Is everyone here using docker, who is struggling with it? I am, from the comments so far, the only one using pip installation. And for me it works perfectly fine with full context on or off.
GiteaMirror commented 2025-11-11 15:44:05 -06:00
Author
Owner
Copy Link
Copy Source

@EMjetrot commented on GitHub (Feb 20, 2025):

@Classic298 - Yes, docker on ubuntu here.

@EMjetrot commented on GitHub (Feb 20, 2025): @Classic298 - Yes, docker on ubuntu here.
GiteaMirror commented 2025-11-11 15:44:06 -06:00
Author
Owner
Copy Link
Copy Source

@karuko24 commented on GitHub (Feb 20, 2025):

Same issue, running on Kubernetes

@karuko24 commented on GitHub (Feb 20, 2025): Same issue, running on Kubernetes
GiteaMirror commented 2025-11-11 15:44:06 -06:00
Author
Owner
Copy Link
Copy Source

@cdmusic2019 commented on GitHub (Feb 20, 2025):

Is everyone here using docker, who is struggling with it? I am, from the comments so far, the only one using pip installation. And for me it works perfectly fine with full context on or off.

And me, too. PIP

@cdmusic2019 commented on GitHub (Feb 20, 2025): > Is everyone here using docker, who is struggling with it? I am, from the comments so far, the only one using pip installation. And for me it works perfectly fine with full context on or off. And me, too. PIP
GiteaMirror commented 2025-11-11 15:44:06 -06:00
Author
Owner
Copy Link
Copy Source

@Haervwe commented on GitHub (Feb 20, 2025):

On Ubuntu, dockerized, searnxg and facing the same issue.

@Haervwe commented on GitHub (Feb 20, 2025): On Ubuntu, dockerized, searnxg and facing the same issue.
GiteaMirror commented 2025-11-11 15:44:06 -06:00
Author
Owner
Copy Link
Copy Source

@DamilolaDecarls commented on GitHub (Feb 20, 2025):

I'm also having this issue. I don't have web search enabled. Docker and debian host.

@DamilolaDecarls commented on GitHub (Feb 20, 2025): I'm also having this issue. I don't have web search enabled. Docker and debian host.
GiteaMirror commented 2025-11-11 15:44:06 -06:00
Author
Owner
Copy Link
Copy Source

@ProjectMoon commented on GitHub (Feb 20, 2025):

I'm also having this issue. I don't have web search enabled. Docker and debian host.

Issue with vector search as a whole?

@ProjectMoon commented on GitHub (Feb 20, 2025): > I'm also having this issue. I don't have web search enabled. Docker and debian host. Issue with vector search as a whole?
GiteaMirror commented 2025-11-11 15:44:07 -06:00
Author
Owner
Copy Link
Copy Source

@DamilolaDecarls commented on GitHub (Feb 20, 2025):

I'm also having this issue. I don't have web search enabled. Docker and debian host.

Issue with vector search as a whole?

I just carried out further checks. It works on the local host. It seems to only break when I forward it to a nginx webserver. Accessing vial local host works as expected.

@DamilolaDecarls commented on GitHub (Feb 20, 2025): > > I'm also having this issue. I don't have web search enabled. Docker and debian host. > > Issue with vector search as a whole? I just carried out further checks. It works on the local host. It seems to only break when I forward it to a nginx webserver. Accessing vial local host works as expected.
GiteaMirror commented 2025-11-11 15:44:07 -06:00
Author
Owner
Copy Link
Copy Source

@xmcp commented on GitHub (Feb 20, 2025):

It seems that https://github.com/open-webui/open-webui/commit/925bfe840b46df424360f230a93e748289df0139 is causing this trouble, since documents in RAG mode don't have file_ids.

Current we are using this as a hotfix:

diff --git a/backend/open_webui/retrieval/utils.py b/backend/open_webui/retrieval/utils.py
index 5f181fba0..5ee628799 100644
--- a/backend/open_webui/retrieval/utils.py
+++ b/backend/open_webui/retrieval/utils.py
@@ -187,7 +187,7 @@ def merge_and_sort_query_results(
         # DISTINCT(chunk_id,file_id) - in case if id (chunk_ids) become ordinals
         combined_ids.extend(
             [
-                f"{id}-{meta['file_id']}"
+                f"{id}-{meta.get('file_id', '')}"
                 for id, meta in zip(data["ids"][0], data["metadatas"][0])
             ]
         )
@xmcp commented on GitHub (Feb 20, 2025): It seems that https://github.com/open-webui/open-webui/commit/925bfe840b46df424360f230a93e748289df0139 is causing this trouble, since documents in RAG mode don't have `file_id`s. Current we are using this as a hotfix: ```python diff --git a/backend/open_webui/retrieval/utils.py b/backend/open_webui/retrieval/utils.py index 5f181fba0..5ee628799 100644 --- a/backend/open_webui/retrieval/utils.py +++ b/backend/open_webui/retrieval/utils.py @@ -187,7 +187,7 @@ def merge_and_sort_query_results( # DISTINCT(chunk_id,file_id) - in case if id (chunk_ids) become ordinals combined_ids.extend( [ - f"{id}-{meta['file_id']}" + f"{id}-{meta.get('file_id', '')}" for id, meta in zip(data["ids"][0], data["metadatas"][0]) ] ) ```
GiteaMirror commented 2025-11-11 15:44:07 -06:00
Author
Owner
Copy Link
Copy Source

@tjbck commented on GitHub (Feb 20, 2025):

@mkhludnev

@tjbck commented on GitHub (Feb 20, 2025): @mkhludnev
GiteaMirror commented 2025-11-11 15:44:08 -06:00
Author
Owner
Copy Link
Copy Source

@tjbck commented on GitHub (Feb 20, 2025):

The entire deduplication logic should be replaced and is faulty, 0.5.16 will be released soon.

@tjbck commented on GitHub (Feb 20, 2025): The entire deduplication logic should be replaced and is faulty, 0.5.16 will be released soon.
GiteaMirror commented 2025-11-11 15:44:08 -06:00
Author
Owner
Copy Link
Copy Source

@tjbck commented on GitHub (Feb 20, 2025):

Should be resolved with 0.5.16, Thanks everyone!

@tjbck commented on GitHub (Feb 20, 2025): Should be resolved with 0.5.16, Thanks everyone!
GiteaMirror commented 2025-11-11 15:44:08 -06:00
Author
Owner
Copy Link
Copy Source

@mkhludnev commented on GitHub (Feb 20, 2025):

pardon

@mkhludnev commented on GitHub (Feb 20, 2025): pardon
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
GiteaMirror ninjasurge (Kaehlen Rog)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#3999