github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-05-06 19:08:59 -05:00
Code Issues 1.3k Packages Projects Releases 126 Wiki Activity

[GH-ISSUE #7026] The RAG_WEB_SEARCH_CONCURRENT_REQUESTS environment variable is not working, making it very slow. #30101

New Issue
Closed
opened 2026-04-25 04:24:23 -05:00 by GiteaMirror · 3 comments
GiteaMirror commented 2026-04-25 04:24:23 -05:00
Owner
Copy Link

Originally created by @yeounhak on GitHub (Nov 19, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/7026

Bug Report

Installation Method

git clone

Environment

  • Open WebUI Version: v0.3.35
  • Operating System: Ubuntu 22.04

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Expected Behavior:

Setting the RAG_WEB_SEARCH_CONCURRENT_REQUESTS environment variable should make loading websites run concurrently, which should be much faster.

Actual Behavior:

since RAG_WEB_SEARCH_CONCURRENT_REQUESTS is not working, it is very slow.

Description

Bug Summary:
Since RAG_WEB_SEARCH_CONCURRENT_REQUESTS is not working, loading 10 websites takes 13.9 seconds, which is very slow.

Reproduction Details

Steps to Reproduce:
[Outline the steps to reproduce the bug. Be as detailed as possible.]ff

Logs and Screenshots

Screenshot_20241118_205844_Chrome

Additional Information

The get_web_loader code here did not take the environment variable RAG_WEB_SEARCH_CONCURRENT_REQUESTS as the parameter for requests_per_second.

Originally created by @yeounhak on GitHub (Nov 19, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/7026 # Bug Report ## Installation Method git clone ## Environment - **Open WebUI Version:** v0.3.35 - **Operating System:** Ubuntu 22.04 **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [x] I am on the latest version of both Open WebUI and Ollama. - [ ] I have included the browser console logs. - [ ] I have included the Docker container logs. - [ ] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below. ## Expected Behavior: Setting the RAG_WEB_SEARCH_CONCURRENT_REQUESTS environment variable should make loading websites run concurrently, which should be much faster. ## Actual Behavior: since RAG_WEB_SEARCH_CONCURRENT_REQUESTS is not working, it is very slow. ## Description **Bug Summary:** Since RAG_WEB_SEARCH_CONCURRENT_REQUESTS is not working, loading 10 websites takes 13.9 seconds, which is very slow. ## Reproduction Details **Steps to Reproduce:** [Outline the steps to reproduce the bug. Be as detailed as possible.]ff ## Logs and Screenshots ![Screenshot_20241118_205844_Chrome](https://github.com/user-attachments/assets/949e9582-18d9-482c-8172-1fe0ea82f588) ## Additional Information The get_web_loader code [here](https://github.com/open-webui/open-webui/blob/96c865404d36637eafadb6d2dd2365c85d452648/backend/open_webui/apps/retrieval/main.py#L1165) did not take the environment variable RAG_WEB_SEARCH_CONCURRENT_REQUESTS as the parameter for requests_per_second.
GiteaMirror commented 2026-04-25 04:24:25 -05:00
Author
Owner
Copy Link

@Yimi81 commented on GitHub (Feb 11, 2025):

In my environment, I set the concurrency to 10 to search for 3 web pages, but it still takes 18 seconds. What is the reason for this?

<!-- gh-comment-id:2649830858 --> @Yimi81 commented on GitHub (Feb 11, 2025): In my environment, I set the concurrency to 10 to search for 3 web pages, but it still takes 18 seconds. What is the reason for this?
GiteaMirror commented 2026-04-25 04:24:25 -05:00
Author
Owner
Copy Link

@yeounhak commented on GitHub (Feb 11, 2025):

My pull request was reverted. Was there a reason for it, or was it mistakenly reverted? @tjbck

Origin : loader.load()
My PR : loader.aload()
Now : loader.load()

<!-- gh-comment-id:2650032375 --> @yeounhak commented on GitHub (Feb 11, 2025): My pull request was reverted. Was there a reason for it, or was it mistakenly reverted? @tjbck Origin : loader.load() [My PR](https://github.com/open-webui/open-webui/pull/7025#issue-2670470439) : loader.aload() [Now](https://github.com/open-webui/open-webui/blob/96c865404d36637eafadb6d2dd2365c85d452648/backend/open_webui/apps/retrieval/main.py#L999) : loader.load()
GiteaMirror commented 2026-04-25 04:24:26 -05:00
Author
Owner
Copy Link

@Yimi81 commented on GitHub (Feb 11, 2025):

This code is very slow Image

<!-- gh-comment-id:2650035918 --> @Yimi81 commented on GitHub (Feb 11, 2025): This code is very slow ![Image](https://github.com/user-attachments/assets/e99db49d-86a6-4a61-a4d0-3526b00fe796)
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#30101
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?