[GH-ISSUE #4064] Feat: Be able to select Chat Files/Websearch/Websites for RAG #13485

Closed
opened 2026-04-19 20:12:38 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @mr-gepardas on GitHub (Jul 23, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/4064

Is your feature request related to a problem? Please describe.
It appears since Open WebUI 0.2.5 and Ollama 0.2.2 updates, the way RAG works has changed, and no longer works like it used to. It seems now, most of the time, only the first LLM message uses the upload of a file or a websearch, consecutive QnA from LLM are ignoring the file/websearch context in the same chat. It's almost like after the first message LLM is completely unaware of RAG of the uploaded file. The only solution for now I found is re-uploading the same file, which unfortunately will quickly fill up my storage with a great number of duplicate files.

Describe the solution you'd like
Just like normally we can reference uploaded documents by Main Admin in a model with "#", it would be very useful to be able to reference already uploaded files into a chat using '#' shortcut, that way would save on space as would no longer need to re-upload the same file or website/websearch.

Describe alternatives you've considered
Another solution could possibly be a user file library that could be used to reference any user uploaded files in any chat.

And another solution would be some toggle on the chat, to always reference uploaded files to a chat, just like it used to be pre-0.2.5 version of Open WebUI.

Additional context
N/A

Originally created by @mr-gepardas on GitHub (Jul 23, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/4064 **Is your feature request related to a problem? Please describe.** It appears since Open WebUI 0.2.5 and Ollama 0.2.2 updates, the way RAG works has changed, and no longer works like it used to. It seems now, most of the time, only the first LLM message uses the upload of a file or a websearch, consecutive QnA from LLM are ignoring the file/websearch context in the same chat. It's almost like after the first message LLM is completely unaware of RAG of the uploaded file. The only solution for now I found is re-uploading the same file, which unfortunately will quickly fill up my storage with a great number of duplicate files. **Describe the solution you'd like** Just like normally we can reference uploaded documents by Main Admin in a model with "#", it would be very useful to be able to reference already uploaded files into a chat using '#' shortcut, that way would save on space as would no longer need to re-upload the same file or website/websearch. **Describe alternatives you've considered** Another solution could possibly be a user file library that could be used to reference any user uploaded files in any chat. And another solution would be some toggle on the chat, to always reference uploaded files to a chat, just like it used to be pre-0.2.5 version of Open WebUI. **Additional context** N/A
Author
Owner

@justinh-rahb commented on GitHub (Jul 23, 2024):

This has been addressed as of WebUI 0.3.10. All chat messages will reference RAG documents unless they're removed from the Chat Settings side panel now.

<!-- gh-comment-id:2246443528 --> @justinh-rahb commented on GitHub (Jul 23, 2024): This has been addressed as of WebUI 0.3.10. All chat messages will reference RAG documents unless they're removed from the Chat Settings side panel now.
Author
Owner

@mr-gepardas commented on GitHub (Jul 23, 2024):

This has been addressed as of WebUI 0.3.10. All chat messages will reference RAG documents unless they're removed from the Chat Settings side panel now.

@justinh-rahb
I have the 0.3.10, and can see that with files that does appear to be the case, even though sometimes there are occasions where it stops referencing the file, but with any Web Search (using Searxng) it seems it does not reference them as files, so those are always only mentioned on the first response, after which the only option would be to add searched websites manually in the next message

<!-- gh-comment-id:2246455359 --> @mr-gepardas commented on GitHub (Jul 23, 2024): > This has been addressed as of WebUI 0.3.10. All chat messages will reference RAG documents unless they're removed from the Chat Settings side panel now. @justinh-rahb I have the 0.3.10, and can see that with files that does appear to be the case, even though sometimes there are occasions where it stops referencing the file, but with any Web Search (using Searxng) it seems it does not reference them as files, so those are always only mentioned on the first response, after which the only option would be to add searched websites manually in the next message
Author
Owner

@justinh-rahb commented on GitHub (Jul 24, 2024):

Depends on which SearXNG method you're using. The Tool available on openwebui.com and installed in Workspace indeed does not RAG results, whereas the built-in function that's setup through Admin Settings does.

<!-- gh-comment-id:2246693267 --> @justinh-rahb commented on GitHub (Jul 24, 2024): Depends on which SearXNG method you're using. The **Tool** available on openwebui.com and installed in **Workspace** indeed does not RAG results, whereas the built-in function that's setup through **Admin Settings** does.
Author
Owner

@mr-gepardas commented on GitHub (Jul 24, 2024):

Depends on which SearXNG method you're using. The Tool available on openwebui.com and installed in Workspace indeed does not RAG results, whereas the built-in function that's setup through Admin Settings does.

Would it be possible to explain more about the difference between the two? As I am currently using the setup through Admin Settings -> Web Search -> Web Search Engine -> searxng. And from the chats I had it does not appear to use the results at all after the first message.

<!-- gh-comment-id:2248668419 --> @mr-gepardas commented on GitHub (Jul 24, 2024): > Depends on which SearXNG method you're using. The **Tool** available on openwebui.com and installed in **Workspace** indeed does not RAG results, whereas the built-in function that's setup through **Admin Settings** does. Would it be possible to explain more about the difference between the two? As I am currently using the setup through Admin Settings -> Web Search -> Web Search Engine -> searxng. And from the chats I had it does not appear to use the results at all after the first message.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#13485