RAG_EMBEDDING_OPENAI_BATCH_SIZE where it is used? #1655

Closed
opened 2025-11-11 14:49:27 -06:00 by GiteaMirror · 0 comments
Owner

Originally created by @sir3mat on GitHub (Aug 1, 2024).

I have an embedding model exposed with TEI but i don't know how RAG_EMBEDDING_OPENAI_BATCH_SIZE impact on the performance.

This is where the function of openwebui call the generate batch embedding model code but i don't see where the params is loaded.

Any tips?

Originally created by @sir3mat on GitHub (Aug 1, 2024). I have an embedding model exposed with TEI but i don't know how RAG_EMBEDDING_OPENAI_BATCH_SIZE impact on the performance. This is where the function of openwebui call the generate batch embedding model [code](https://github.com/open-webui/open-webui/blob/82079e644a291349926008adffe8fe2fc3b33566/backend/apps/rag/utils.py#L375) but i don't see where the params is loaded. Any tips?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#1655