feat: knowledge/projects (revamped documents section) #1402

Closed
opened 2025-11-11 14:44:22 -06:00 by GiteaMirror · 8 comments
Owner

Originally created by @tjbck on GitHub (Jun 29, 2024).

Originally assigned to: @tjbck on GitHub.

#3521 #3231 #2044 #3110 #3464 #1096

  • Refactor Collection handling -> Rename it to project
  • Deprecate current tags in favour of project groupping
  • Each project should be able to handle multiple files (save all embeddings to same collection)
  • Should be team-agnostic and should allow inter-team project use case
  • Project notes (#3231)
  • Provide clear guidance on API usage
  • Upload file via Files API
  • Process and link file to project(s) using file id
  • Chat with Files using project id(s) in chat completion payload
Originally created by @tjbck on GitHub (Jun 29, 2024). Originally assigned to: @tjbck on GitHub. #3521 #3231 #2044 #3110 #3464 #1096 - [x] Refactor Collection handling -> Rename it to project - [x] Deprecate current tags in favour of project groupping - [x] Each project should be able to handle multiple files (save all embeddings to same collection) - [x] Should be team-agnostic and should allow inter-team project use case - [x] Project notes (#3231) - [ ] Provide clear guidance on API usage - Upload file via Files API - Process and link file to project(s) using file id - Chat with Files using project id(s) in chat completion payload
Author
Owner

@joelmnz commented on GitHub (Jun 30, 2024):

In addition to my suggestion in #3231 , have seen what Claude has done with their "agent workspaces" (a space/doc an agent can read & write to), that is a great idea, what if we could get our agents/chats to have read-write memory/notes. I have seen the concept of "memory" in Open WebUI but haven't found docs or how to use it. Could that be incorporated, maybe as a separate ticket but considered here.

If this is done already or in some other way please let me know.

@joelmnz commented on GitHub (Jun 30, 2024): In addition to my suggestion in #3231 , have seen what Claude has done with their "agent workspaces" (a space/doc an agent can read & write to), that is a great idea, what if we could get our agents/chats to have read-write memory/notes. I have seen the concept of "memory" in Open WebUI but haven't found docs or how to use it. Could that be incorporated, maybe as a separate ticket but considered here. If this is done already or in some other way please let me know.
Author
Owner

@jannikstdl commented on GitHub (Aug 19, 2024):

Very exited!

@jannikstdl commented on GitHub (Aug 19, 2024): Very exited!
Author
Owner

@antonio-lamberti commented on GitHub (Oct 3, 2024):

Hi! Does anybody now if the upload docs (as in the workspace - documents) is available in the API? #5886

@antonio-lamberti commented on GitHub (Oct 3, 2024): Hi! Does anybody now if the upload docs (as in the workspace - documents) is available in the API? #5886
Author
Owner

@tjbck commented on GitHub (Oct 4, 2024):

@antonio-lamberti Existing documents section has been deprecated in dev, but detailed knowledge API usage tutorial will be provided shortly!

@tjbck commented on GitHub (Oct 4, 2024): @antonio-lamberti Existing documents section has been deprecated in dev, but detailed knowledge API usage tutorial will be provided shortly!
Author
Owner

@antonio-lamberti commented on GitHub (Oct 6, 2024):

@antonio-lamberti Existing documents section has been deprecated in dev, but detailed knowledge API usage tutorial will be provided shortly!

@tjbck Thanks! So does this mean that right now, the upload via API feature it's not working, right? I saw other people complaining the same...

Also, I would know the API usage tutorial will be updated when the new version is released, right?

Thanks for the great job!!

@antonio-lamberti commented on GitHub (Oct 6, 2024): > @antonio-lamberti Existing documents section has been deprecated in dev, but detailed knowledge API usage tutorial will be provided shortly! @tjbck Thanks! So does this mean that right now, the upload via API feature it's not working, right? I saw other people [complaining ](https://github.com/open-webui/open-webui/discussions/4692) the same... Also, I would know the API usage tutorial will be updated when the new version is released, right? Thanks for the great job!!
Author
Owner

@merrime-n commented on GitHub (May 18, 2025):

Several issues has been closed referencing this one as the original post. I am experiencing extremely slow RAG on UI. I upload a relatively large Markdown file and it takes too long to get uploaded and saved to the vector database. Is this the normal behavior? I am not experiencing this when working with PDFs.

@merrime-n commented on GitHub (May 18, 2025): Several issues has been closed referencing this one as the original post. I am experiencing extremely slow RAG on UI. I upload a relatively large Markdown file and it takes too long to get uploaded and saved to the vector database. Is this the normal behavior? I am not experiencing this when working with PDFs.
Author
Owner

@jnko266 commented on GitHub (May 19, 2025):

@okaeiz I am experiencing the exact same - my OWUI RAG only has 1 CSV file and 1 (quite small) Markdown file. Lookups take 60+ seconds per question. Anyone has any ideas?

@jnko266 commented on GitHub (May 19, 2025): @okaeiz I am experiencing the exact same - my OWUI RAG only has 1 CSV file and 1 (quite small) Markdown file. Lookups take 60+ seconds per question. Anyone has any ideas?
Author
Owner

@shc443 commented on GitHub (Jun 5, 2025):

@jnko266 Same issue! did you figure it out why?? =[

@shc443 commented on GitHub (Jun 5, 2025): @jnko266 Same issue! did you figure it out why?? =[
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#1402