I have searched the existing issues and discussions.
Problem Description
When using a knowledge base with a model, the listed sources contain all seen document (chunks). However, even with k=5 we get 15 sources that have been given to the LLM. As most of these sources are not really relevant and the LLM only cites some of them, we should not confuse the enduser with a long list of sources, that are not related to the answer.
One additional problem I faced is that with 15 sources with 1000 tokens per chunk, loading the chat becomes slow. I'm not 100% sure it's related to this but it came up together.
Desired Solution you'd like
Only sources that are referenced by the llm should come up as sources. When writing a paper I would also only cite information I used, not everything I've read.
Alternatives Considered
No response
Additional Context
No response
Originally created by @almajo on GitHub (Mar 31, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/12231
### Check Existing Issues
- [x] I have searched the existing issues and discussions.
### Problem Description
When using a knowledge base with a model, the listed sources contain all seen document (chunks). However, even with k=5 we get 15 sources that have been given to the LLM. As most of these sources are not really relevant and the LLM only cites some of them, we should not confuse the enduser with a long list of sources, that are not related to the answer.
One additional problem I faced is that with 15 sources with 1000 tokens per chunk, loading the chat becomes slow. I'm not 100% sure it's related to this but it came up together.
### Desired Solution you'd like
Only sources that are referenced by the llm should come up as sources. When writing a paper I would also only cite information I used, not everything I've read.
### Alternatives Considered
_No response_
### Additional Context
_No response_
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @almajo on GitHub (Mar 31, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/12231
Check Existing Issues
Problem Description
When using a knowledge base with a model, the listed sources contain all seen document (chunks). However, even with k=5 we get 15 sources that have been given to the LLM. As most of these sources are not really relevant and the LLM only cites some of them, we should not confuse the enduser with a long list of sources, that are not related to the answer.
One additional problem I faced is that with 15 sources with 1000 tokens per chunk, loading the chat becomes slow. I'm not 100% sure it's related to this but it came up together.
Desired Solution you'd like
Only sources that are referenced by the llm should come up as sources. When writing a paper I would also only cite information I used, not everything I've read.
Alternatives Considered
No response
Additional Context
No response