mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 19:08:59 -05:00
[GH-ISSUE #19732] Open WebUI API Works with normal models but fails with RAG/Knowledge Database on OpenAI-Compatible Clients #18972
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @R-Bower on GitHub (Dec 4, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/19732
This original issue was converted into a discussion, but this is definitely a bug:
I’m currently setting up Open-WebUI’s API and running into an issue. The API works perfectly with normal models when accessed through other OpenAI-compatible clients (such as Cline or ChatboxAI). However, when I attach a knowledge/RAG database to the API, I encounter the following error:
This error occurs consistently across multiple client applications (except Open-WebUI itself), suggesting an issue with how the API handles the knowledge/RAG database in non-Open-WebUI clients.
To reproduce:
I’ve confirmed that the API works fine with
curlin the terminal and can connect to other Open-WebUI instances without issues, even with the knowledge/RAG database attached.Has anyone else experienced this or have any insights into why this might be happening? Any suggestions or potential solutions would be greatly appreciated!
Thank you in advance for your help!
Originally posted by @bpawnzZ in https://github.com/open-webui/open-webui/discussions/8466
@owui-terminator[bot] commented on GitHub (Dec 4, 2025):
🔍 Similar Issues Found
I found some existing issues that might be related to this one. Please check if any of these are duplicates or contain helpful solutions:
#8465 Open-WebUI API Works with Normal Models but Fails with Knowledge/RAG Database on Other OpenAI-Compatible Clients
by bpawnzZ • Jan 10, 2025
#17407 issue: generated RAG queries not visible when using a model with attached knowledge base
by vaclcer • Sep 12, 2025 •
bug#4348 Bug: v0.3.11 - Load models from OpenAI-compatible API without auth
by av • Aug 04, 2024
#7037 bug: problem handling Perplexity Online models via OpenRouter
by neuromechanist • Nov 19, 2024
#10411 ❗ Bug: ModelModel Not JSON Serializable in OpenWebUI v0.5.14
by samuelpetermoshi • Feb 20, 2025
Show 5 more related issues
#1105 bug: RAG loses context on model response regeneration with Groq models via API key
by silentoplayz • Mar 08, 2024
#3349 OpenAI Network Problem on OpenWebUI
by whateverzpy • Jun 21, 2024
#6298 Models not working with RAG UNLESS imported via Openwebui's experimental feature (but broken response)
by antonio-lamberti • Oct 20, 2024
#18272 issue: Knowledge Collection RAG not working -> Model Conext Length Overrun
by rahepler2 • Oct 13, 2025 •
bug#1826 Custom OpenAI API Endpoints Do Not Load
by jmstacey • Apr 28, 2024
💡 Tips:
This comment was generated automatically by a bot. Please react with a 👍 if this comment was helpful, or a 👎 if it was not.