mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 10:58:17 -05:00
[GH-ISSUE #13080] feat: Updating Sentence Transformers and enable new backends (onnx, openvino) #16803
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#16803
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @DrZoidberg09 on GitHub (Apr 20, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/13080
Check Existing Issues
Problem Description
Sentence Transformers has introduced several new features: https://github.com/UKPLab/sentence-transformers/releases/tag/v4.1.0
Especially, the ability to use onnx and openvino to speed up inference is highly interesting.
Desired Solution you'd like
Hence, I will open a PR updating sentence transformers and adding ENV to configure backend and kwargs separately for sentence transformer and cross encoder.
Alternatives Considered
No response
Additional Context
No response