feat: File size limit for knowledge base #4488

Closed
opened 2025-11-11 15:55:17 -06:00 by GiteaMirror · 4 comments
Owner

Originally created by @valckmir on GitHub (Mar 19, 2025).

Check Existing Issues

  • I have searched the existing issues and discussions.

Problem Description

Hello,

My colleagues and I really like this project; you did a tremendous amount of good work!

My colleagues like it so much that they try to upload huge files (10-1000 MB) into the knowledge base which often crashes our Chroma DB instance.

I find the RAG_FILE_MAX_SIZE configuration very useful but unfortunately, there is no such variable for the knowledge base.

Desired Solution you'd like

Would it be possible to introduce independent configuration variable for file max size uploaded to the knowledge base? Something like KNOWLEDGE_FILE_MAX_SIZE?

Alternatives Considered

No response

Additional Context

I'm looking forward to hearing what others think about this.

Originally created by @valckmir on GitHub (Mar 19, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description Hello, My colleagues and I really like this project; you did a tremendous amount of good work! My colleagues like it so much that they try to upload huge files (10-1000 MB) into the knowledge base which often crashes our Chroma DB instance. I find the `RAG_FILE_MAX_SIZE` configuration very useful but unfortunately, there is no such variable for the knowledge base. ### Desired Solution you'd like Would it be possible to introduce **independent configuration variable** for file max size uploaded to the knowledge base? Something like `KNOWLEDGE_FILE_MAX_SIZE`? ### Alternatives Considered _No response_ ### Additional Context I'm looking forward to hearing what others think about this.
Author
Owner

@wertrigone commented on GitHub (Mar 19, 2025):

use another model

Image

@wertrigone commented on GitHub (Mar 19, 2025): use another model ![Image](https://github.com/user-attachments/assets/5769dbdf-293e-45c4-8edc-362efde91003)
Author
Owner

@valckmir commented on GitHub (Mar 19, 2025):

Model is not a problem, we use an embedding model through API.

@valckmir commented on GitHub (Mar 19, 2025): Model is not a problem, we use an embedding model through API.
Author
Owner

@tjbck commented on GitHub (Mar 19, 2025):

Addressed with c69d1c86fe

@tjbck commented on GitHub (Mar 19, 2025): Addressed with c69d1c86fe8d0a827515f5018af8dbc2c6457edd
Author
Owner

@valckmir commented on GitHub (Mar 19, 2025):

Thank you for your quick response!

I'm checking the commit but not sure about the variable name, is it the new KNOWLEDGE_FILE_MAX_SIZE or is the RAG_FILE_MAX_SIZE used there too?

@valckmir commented on GitHub (Mar 19, 2025): Thank you for your quick response! I'm checking the commit but not sure about the variable name, is it the new `KNOWLEDGE_FILE_MAX_SIZE` or is the `RAG_FILE_MAX_SIZE` used there too?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#4488