[GH-ISSUE #841] feat: use haystack for the RAG backend #12231

Closed
opened 2026-04-19 19:06:33 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @Jbollenbacher on GitHub (Feb 22, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/841

I'd like to suggest using haystack as the backend for the RAG system. It's quickly becoming the industry standard and is well maintained. I figured now would be a good time to suggest it while the RAG system is still mostly in beta.

Haystack solves a lot of the basic problems like providing flexibility for swapping out embedding models and chunking strategies. It's also robust and comes with a lot of good default options. Basically it offloads the task of engineering a SOTA RAG system to another group of open source developers.

Originally created by @Jbollenbacher on GitHub (Feb 22, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/841 I'd like to suggest using [haystack](https://github.com/deepset-ai/haystack) as the backend for the RAG system. It's quickly becoming the industry standard and is well maintained. I figured now would be a good time to suggest it while the RAG system is still mostly in beta. Haystack solves a lot of the basic problems like providing flexibility for swapping out embedding models and chunking strategies. It's also robust and comes with a lot of good default options. Basically it offloads the task of engineering a SOTA RAG system to another group of open source developers.
Author
Owner

@tjbck commented on GitHub (Mar 28, 2024):

Merging this issue with open-webui/pipelines#15, let's continue our discussion there!

<!-- gh-comment-id:2026173338 --> @tjbck commented on GitHub (Mar 28, 2024): Merging this issue with open-webui/pipelines#15, let's continue our discussion there!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#12231