Chat with Files using project id(s) in chat completion payload
Originally created by @tjbck on GitHub (Jun 29, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3527
Originally assigned to: @tjbck on GitHub.
#3521 #3231 #2044 #3110 #3464 #1096
- [x] Refactor Collection handling -> Rename it to project
- [x] Deprecate current tags in favour of project groupping
- [x] Each project should be able to handle multiple files (save all embeddings to same collection)
- [x] Should be team-agnostic and should allow inter-team project use case
- [x] Project notes (#3231)
- [ ] Provide clear guidance on API usage
- Upload file via Files API
- Process and link file to project(s) using file id
- Chat with Files using project id(s) in chat completion payload
In addition to my suggestion in #3231 , have seen what Claude has done with their "agent workspaces" (a space/doc an agent can read & write to), that is a great idea, what if we could get our agents/chats to have read-write memory/notes. I have seen the concept of "memory" in Open WebUI but haven't found docs or how to use it. Could that be incorporated, maybe as a separate ticket but considered here.
If this is done already or in some other way please let me know.
<!-- gh-comment-id:2198389960 -->
@joelmnz commented on GitHub (Jun 30, 2024):
In addition to my suggestion in #3231 , have seen what Claude has done with their "agent workspaces" (a space/doc an agent can read & write to), that is a great idea, what if we could get our agents/chats to have read-write memory/notes. I have seen the concept of "memory" in Open WebUI but haven't found docs or how to use it. Could that be incorporated, maybe as a separate ticket but considered here.
If this is done already or in some other way please let me know.
@antonio-lamberti commented on GitHub (Oct 3, 2024):
Hi! Does anybody now if the upload docs (as in the workspace - documents) is available in the API? #5886
<!-- gh-comment-id:2391842884 -->
@antonio-lamberti commented on GitHub (Oct 3, 2024):
Hi! Does anybody now if the upload docs (as in the workspace - documents) is available in the API? #5886
@antonio-lamberti Existing documents section has been deprecated in dev, but detailed knowledge API usage tutorial will be provided shortly!
<!-- gh-comment-id:2394356234 -->
@tjbck commented on GitHub (Oct 4, 2024):
@antonio-lamberti Existing documents section has been deprecated in dev, but detailed knowledge API usage tutorial will be provided shortly!
@antonio-lamberti commented on GitHub (Oct 6, 2024):
@antonio-lamberti Existing documents section has been deprecated in dev, but detailed knowledge API usage tutorial will be provided shortly!
@tjbck Thanks! So does this mean that right now, the upload via API feature it's not working, right? I saw other people complaining the same...
Also, I would know the API usage tutorial will be updated when the new version is released, right?
Thanks for the great job!!
<!-- gh-comment-id:2395489959 -->
@antonio-lamberti commented on GitHub (Oct 6, 2024):
> @antonio-lamberti Existing documents section has been deprecated in dev, but detailed knowledge API usage tutorial will be provided shortly!
@tjbck Thanks! So does this mean that right now, the upload via API feature it's not working, right? I saw other people [complaining ](https://github.com/open-webui/open-webui/discussions/4692) the same...
Also, I would know the API usage tutorial will be updated when the new version is released, right?
Thanks for the great job!!
Several issues has been closed referencing this one as the original post. I am experiencing extremely slow RAG on UI. I upload a relatively large Markdown file and it takes too long to get uploaded and saved to the vector database. Is this the normal behavior? I am not experiencing this when working with PDFs.
<!-- gh-comment-id:2888875183 -->
@okaeiz commented on GitHub (May 18, 2025):
Several issues has been closed referencing this one as the original post. I am experiencing extremely slow RAG on UI. I upload a relatively large Markdown file and it takes too long to get uploaded and saved to the vector database. Is this the normal behavior? I am not experiencing this when working with PDFs.
@okaeiz I am experiencing the exact same - my OWUI RAG only has 1 CSV file and 1 (quite small) Markdown file. Lookups take 60+ seconds per question. Anyone has any ideas?
<!-- gh-comment-id:2890688106 -->
@jnko266 commented on GitHub (May 19, 2025):
@okaeiz I am experiencing the exact same - my OWUI RAG only has 1 CSV file and 1 (quite small) Markdown file. Lookups take 60+ seconds per question. Anyone has any ideas?
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @tjbck on GitHub (Jun 29, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3527
Originally assigned to: @tjbck on GitHub.
#3521 #3231 #2044 #3110 #3464 #1096
@joelmnz commented on GitHub (Jun 30, 2024):
In addition to my suggestion in #3231 , have seen what Claude has done with their "agent workspaces" (a space/doc an agent can read & write to), that is a great idea, what if we could get our agents/chats to have read-write memory/notes. I have seen the concept of "memory" in Open WebUI but haven't found docs or how to use it. Could that be incorporated, maybe as a separate ticket but considered here.
If this is done already or in some other way please let me know.
@jannikstdl commented on GitHub (Aug 19, 2024):
Very exited!
@antonio-lamberti commented on GitHub (Oct 3, 2024):
Hi! Does anybody now if the upload docs (as in the workspace - documents) is available in the API? #5886
@tjbck commented on GitHub (Oct 4, 2024):
@antonio-lamberti Existing documents section has been deprecated in dev, but detailed knowledge API usage tutorial will be provided shortly!
@antonio-lamberti commented on GitHub (Oct 6, 2024):
@tjbck Thanks! So does this mean that right now, the upload via API feature it's not working, right? I saw other people complaining the same...
Also, I would know the API usage tutorial will be updated when the new version is released, right?
Thanks for the great job!!
@okaeiz commented on GitHub (May 18, 2025):
Several issues has been closed referencing this one as the original post. I am experiencing extremely slow RAG on UI. I upload a relatively large Markdown file and it takes too long to get uploaded and saved to the vector database. Is this the normal behavior? I am not experiencing this when working with PDFs.
@jnko266 commented on GitHub (May 19, 2025):
@okaeiz I am experiencing the exact same - my OWUI RAG only has 1 CSV file and 1 (quite small) Markdown file. Lookups take 60+ seconds per question. Anyone has any ideas?
@shc443 commented on GitHub (Jun 5, 2025):
@jnko266 Same issue! did you figure it out why?? =[