mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-07 19:38:46 -05:00
[GH-ISSUE #17034] feat: Current RAG and Memory Behaviour breaks caching of LLM Providers and should be more flexible #56812
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#56812
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Podden on GitHub (Aug 29, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/17034
Check Existing Issues
Problem Description
I'm currently developing my own Anthropic Pipe and want to use Promt caching and I noticed the current behaviour of appending RAG content and memory into the system promt is suboptimal as it completely invalidates the promt cache when system promt is changed.
Desired Solution you'd like
Multiple System Messages with IDs (Model_System_Promt, User_System_Promt, User_Memory, RAG) would be nice so I can handle them differently. Also, I want to clearly differentiate between RAG from knowledge or notes or RAG from files which I uploaded to this Conversation. Anthropic puts documents right besides the message to which there belong, which I find much more intuitivly that putting everything in the System Promt. How does the AI know which knowledge is currently important and which one is multiple messages old?
Currently I have to Regex for "User Context: " for Memory and a Custom RAG Template with Tags at Start and End, not optimal.
Alternatives Considered
No response
Additional Context
No response