[PR #21662] [CLOSED] feat: Add config to limit the concurrency for async embedding #65046

New Issue

GiteaMirror · 2026-05-06T10:48:23-05:00

GiteaMirror commented

2026-05-06 10:48:23 -05:00

📋 Pull Request Information

Original PR: https://github.com/open-webui/open-webui/pull/21662
Author: @Classic298
Created: 2/20/2026
Status: ❌ Closed

Base: dev ← Head: async-embedding-concurrency

📝 Commits (1)

1df20a8 enh

📊 Changes

5 files changed (+71 additions, -8 deletions)

View changed files

📝 backend/open_webui/config.py (+6 -0)
📝 backend/open_webui/main.py (+3 -0)
📝 backend/open_webui/retrieval/utils.py (+23 -8)
📝 backend/open_webui/routers/retrieval.py (+11 -0)
📝 src/lib/components/admin/Settings/Documents.svelte (+28 -0)

📄 Description

Users have asked for this multiple times, so I decided to make a PR for it.

This is tested locally

Tests made:

change config, refresh page, check for the persistence of config
test embedding, if semaphore value is applied correctly (worked perfectly)
defaults to zero which means unlimited (old existing behaviour)
only displays in the UI, if async embedding is on at all
tested OpenAI embedding with 0, 1, 5 and 10 set as the value - speed adjusted accordingly, worked perfectly.
values persisted

Contributor License Agreement

By submitting this pull request, I confirm that I have read and fully agree to the Contributor License Agreement (CLA), and I am providing my contributions under its terms.

Note

Deleting the CLA section will lead to immediate closure of your PR and it will not be merged in.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/open-webui/pull/21662 **Author:** [@Classic298](https://github.com/Classic298) **Created:** 2/20/2026 **Status:** ❌ Closed **Base:** `dev` ← **Head:** `async-embedding-concurrency` --- ### 📝 Commits (1) - [`1df20a8`](https://github.com/open-webui/open-webui/commit/1df20a88efca2157937532d78fe7a4e0167d77eb) enh ### 📊 Changes **5 files changed** (+71 additions, -8 deletions) <details> <summary>View changed files</summary> 📝 `backend/open_webui/config.py` (+6 -0) 📝 `backend/open_webui/main.py` (+3 -0) 📝 `backend/open_webui/retrieval/utils.py` (+23 -8) 📝 `backend/open_webui/routers/retrieval.py` (+11 -0) 📝 `src/lib/components/admin/Settings/Documents.svelte` (+28 -0) </details> ### 📄 Description Users have asked for this multiple times, so I decided to make a PR for it. This <ins>**is tested locally**</ins> Tests made: - change config, refresh page, check for the persistence of config - test embedding, if semaphore value is applied correctly (worked perfectly) - defaults to zero which means unlimited (old existing behaviour) - only displays in the UI, if async embedding is on at all - tested OpenAI embedding with 0, 1, 5 and 10 set as the value - speed adjusted accordingly, worked perfectly. - values persisted ### Contributor License Agreement  By submitting this pull request, I confirm that I have read and fully agree to the [Contributor License Agreement (CLA)](https://github.com/open-webui/open-webui/blob/main/CONTRIBUTOR_LICENSE_AGREEMENT), and I am providing my contributions under its terms. > [!NOTE] > Deleting the CLA section will lead to immediate closure of your PR and it will not be merged in. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

GiteaMirror added the pull-request label 2026-05-06 10:48:23 -05:00

GiteaMirror closed this issue

2026-05-06 10:48:25 -05:00

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#65046