mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 14:39:31 -05:00
[GH-ISSUE #3965] parallel embedding on ollama embedding #13446
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @codeMonkey-shin on GitHub (Jul 18, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3965
In the case of openai embedding, it is very fast because requests are made in parallel. However, when performing embedding through ollama, it is very slow because it waits until one embedding is finished before performing the next one. We therefore request the ability to perform embedding in parallel.