enh: confusing LLM feedback when no retrieval happened because of high RAG_RELEVANCE_THRESHOLD #1398

Closed
opened 2025-11-11 14:44:18 -06:00 by GiteaMirror · 0 comments
Owner

Originally created by @Robinsane on GitHub (Jun 29, 2024).

Is your feature request related to a problem? Please describe.
When no RAG context is used because all results were lower than the value in RAG_RELEVANCE_THRESHOLD, the user is made to think no file is provided (based on how the LLMs respond).

Describe the solution you'd like
I think it would be very nice to provide a hard coded context that explains the situation in these cases, so the LLM's response will be adjusted and relevant.
hard coded context example.:
"No context was added to this prompt. It's possible that a file was added correctly, but no text was relevant enough according to the setting RAG_RELEVANCE_THRESHOLD."

Additional context
openwebui_relevance_treshold_too_high

Originally created by @Robinsane on GitHub (Jun 29, 2024). **Is your feature request related to a problem? Please describe.** When no RAG context is used because all results were lower than the value in RAG_RELEVANCE_THRESHOLD, the user is made to think no file is provided (based on how the LLMs respond). **Describe the solution you'd like** I think it would be very nice to provide a hard coded context that explains the situation in these cases, so the LLM's response will be adjusted and relevant. hard coded context example.: "No context was added to this prompt. It's possible that a file was added correctly, but no text was relevant enough according to the setting RAG_RELEVANCE_THRESHOLD." **Additional context** ![openwebui_relevance_treshold_too_high](https://github.com/open-webui/open-webui/assets/43806560/39e7a022-0904-43f1-b07e-c10ed49a934b)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#1398