github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-05-06 19:08:59 -05:00
Code Issues 1.3k Packages Projects Releases 126 Wiki Activity

[PR #20096] [CLOSED] fix: pass batch_size to sentence-transformers encode method #64319

New Issue
Closed
opened 2026-05-06 09:49:16 -05:00 by GiteaMirror · 0 comments
GiteaMirror commented 2026-05-06 09:49:16 -05:00
Owner
Copy Link

📋 Pull Request Information

Original PR: https://github.com/open-webui/open-webui/pull/20096
Author: @majiayu000
Created: 12/22/2025
Status: ❌ Closed

Base: main ← Head: fix/embedding-batch-size-20053

📝 Commits (1)

  • b440a95 fix: pass batch_size to sentence-transformers encode method

📊 Changes

3 files changed (+101 additions, -1 deletions)

View changed files

📝 backend/open_webui/retrieval/utils.py (+3 -1)
➕ backend/open_webui/test/retrieval/__init__.py (+0 -0)
➕ backend/open_webui/test/retrieval/test_utils.py (+98 -0)

📄 Description

Summary

  • Passes batch_size parameter to embedding_function.encode() for SentenceTransformers
  • Allows users to control memory usage by configuring Embedding Batch Size in Admin Settings

Fixes #20053

Test plan

  • Added unit tests to verify batch_size is correctly passed to encode method
  • Manual test: Configure Embedding Batch Size in Admin Settings > Documents
  • Manual test: Upload large document and monitor RAM/VRAM usage

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/open-webui/pull/20096 **Author:** [@majiayu000](https://github.com/majiayu000) **Created:** 12/22/2025 **Status:** ❌ Closed **Base:** `main` ← **Head:** `fix/embedding-batch-size-20053` --- ### 📝 Commits (1) - [`b440a95`](https://github.com/open-webui/open-webui/commit/b440a951a5fd369f4d4bc60679349d0ab753d812) fix: pass batch_size to sentence-transformers encode method ### 📊 Changes **3 files changed** (+101 additions, -1 deletions) <details> <summary>View changed files</summary> 📝 `backend/open_webui/retrieval/utils.py` (+3 -1) ➕ `backend/open_webui/test/retrieval/__init__.py` (+0 -0) ➕ `backend/open_webui/test/retrieval/test_utils.py` (+98 -0) </details> ### 📄 Description ## Summary - Passes `batch_size` parameter to `embedding_function.encode()` for SentenceTransformers - Allows users to control memory usage by configuring Embedding Batch Size in Admin Settings Fixes #20053 ## Test plan - [x] Added unit tests to verify batch_size is correctly passed to encode method - [ ] Manual test: Configure Embedding Batch Size in Admin Settings > Documents - [ ] Manual test: Upload large document and monitor RAM/VRAM usage --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-05-06 09:49:16 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#64319
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?