RAG does not see work at all. #1927

Closed
opened 2025-11-11 14:56:41 -06:00 by GiteaMirror · 0 comments
Owner

Originally created by @qiulang on GitHub (Aug 29, 2024).

Bug Report

I initially asked the question here https://github.com/open-webui/open-webui/discussions/5002 but now I am inclined to believe this is a bug.

Installation Method

pip on mac m2

Environment

  • Open WebUI Version: [v0.3.15]

  • Ollama (if applicable): [v0.3.8]

  • Operating System: [macOS Big Sur]

  • Browser (if applicable): [Chrome 127.0]

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • [] I have included the Docker container logs.
  • I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Description

I upload some documents to the Workspace. After I clicked the scan button, from the console log I can see all documents were scanned so I clicked the save button and start a new chat.

But RAG does not work at all. I ask a question that I know the answer lies in one of the document I uploaded but it still said I don't know.

Then I specified that document and asked the question again, RAG gave the correct answer. But from the console I can see the server scan the document again.

I then specified "All Documents" and asked the question again, I see from the console, the server scan all documents again, but this time gave an incomplete answer.

Please refer to the following screenshot. I asked the question "Has that particular company ever obtained some patents ?" and I happened to know there was a pdf document specifically talked about that

  1. Without specifying any document RAG said I don't know

RAG does not work

  1. RAG gave the correct answer if I specify the document. But why scan the document again ?
    The correct answer

  2. But if I specify 'ALL Documents" it gave an incomplete answer and scan all documents again.

The answer said the company obtained two patents, which is correct. But it said "the documents did not give the detailed information about these two patents”. This is wrong. The screenshot above gave the correct answer with the patent details.

incomplete answer

Originally created by @qiulang on GitHub (Aug 29, 2024). # Bug Report I initially asked the question here https://github.com/open-webui/open-webui/discussions/5002 but now I am inclined to believe this is a bug. ## Installation Method pip on mac m2 ## Environment - **Open WebUI Version:** [v0.3.15] - **Ollama (if applicable):** [v0.3.8] - **Operating System:** [macOS Big Sur] - **Browser (if applicable):** [Chrome 127.0] **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [x] I am on the latest version of both Open WebUI and Ollama. - [x] I have included the browser console logs. - [] I have included the Docker container logs. - [x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below. ## Description I upload some documents to the Workspace. After I clicked the scan button, from the console log I can see all documents were scanned so I clicked the save button and start a new chat. But RAG does not work at all. I ask a question that I know the answer lies in one of the document I uploaded but it still said I don't know. Then I specified that document and asked the question again, RAG gave the correct answer. But from the console I can see the server scan the document again. I then specified "All Documents" and asked the question again, I see from the console, the server scan all documents again, but this time gave an incomplete answer. Please refer to the following screenshot. I asked the question "Has that particular company ever obtained some patents ?" and I happened to know there was a pdf document specifically talked about that 1. Without specifying any document RAG said I don't know ![RAG does not work](https://github.com/user-attachments/assets/950d2922-b672-4b59-b8ef-5b3d0d205d37) 2. RAG gave the correct answer if I specify the document. But why scan the document again ? ![The correct answer](https://github.com/user-attachments/assets/e5366c71-c7d5-4251-8fe1-beaee2a560ee) 3. But if I specify 'ALL Documents" it gave an incomplete answer and scan all documents again. The answer said the company obtained two patents, which is correct. But it said "the documents did not give the detailed information about these two patents”. This is wrong. The screenshot above gave the correct answer with the patent details. ![incomplete answer](https://github.com/user-attachments/assets/b8b9595c-375f-4bcf-a801-1da3c0cd1e5d)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#1927