mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-08 04:16:03 -05:00
[GH-ISSUE #3200] Slow RAG #51840
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @http403 on GitHub (Jun 15, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3200
Bug Report
Description
Bug Summary:
Extremely slow RAG when having 100+ documents.
Steps to Reproduce:
docker-docsor something make sense)#docker-docs)Expected Behavior:
Finish RAG search in seconds
Actual Behavior:
Waiting 30 minutes+ for it to iterate every single collection
Environment
Open WebUI Version: 0.3.2
Ollama (if applicable): 0.1.39
Operating System: Linux Mint w/ Docker
Browser (if applicable): Firefox 126
Reproduction Details
Confirmation:
Logs and Screenshots
Browser Console Logs:
N/A
Docker Container Logs:
N/A
Screenshots (if applicable):
N/A
Installation Method
Docker Compose
Additional Information
Discord Discussion
Alternative Solution
Manually concatenate all the documents into one single file to force it into a single collection.
Note
It is a design overlook more than a bug. The design of RAG doesn't consider scaling issue. For a complete set of documents, there isn't a need to have separate collections by each documents.
@tjbck commented on GitHub (Jun 16, 2024):
Duplicate #2044