[GH-ISSUE #15986] issue: Reranker does not release RAM! #33272

Closed
opened 2026-04-25 07:11:48 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @frenzybiscuit on GitHub (Jul 24, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/15986

Check Existing Issues

  • I have searched the existing issues and discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

0.6.18

Ollama Version (if applicable)

No response

Operating System

Debian 12

Browser (if applicable)

No response

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided every relevant configuration, setting, and environment variable used in my setup.
  • I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
  • I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
  • Start with the initial platform/version/OS and dependencies used,
  • Specify exact install/launch/configure commands,
  • List URLs visited, user input (incl. example values/emails/passwords if needed),
  • Describe all options and toggles enabled or changed,
  • Include any files or environmental changes,
  • Identify the expected and actual result at each stage,
  • Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

RAM is released when reranker is finished

Actual Behavior

RAM continues to increase every time reranker is used and is not released by OpenWebUI.

(Web Search -> Embedding (external/OpenAI) -> ReRanker(Local, SentenceTransformers))

Image

Steps to Reproduce

Image

Logs & Screenshots

N/A

Additional Information

N/A

Originally created by @frenzybiscuit on GitHub (Jul 24, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/15986 ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version 0.6.18 ### Ollama Version (if applicable) _No response_ ### Operating System Debian 12 ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior RAM is released when reranker is finished ### Actual Behavior RAM continues to increase every time reranker is used and is not released by OpenWebUI. (Web Search -> Embedding (external/OpenAI) -> ReRanker(Local, SentenceTransformers)) <img width="1380" height="84" alt="Image" src="https://github.com/user-attachments/assets/fa026620-2f0a-40cf-ac02-371d86f53057" /> ### Steps to Reproduce <img width="3162" height="1922" alt="Image" src="https://github.com/user-attachments/assets/346bfac7-84a8-4ef9-8426-6aa117d0f6d5" /> ### Logs & Screenshots N/A ### Additional Information N/A
GiteaMirror added the bug label 2026-04-25 07:11:48 -05:00
Author
Owner

@frenzybiscuit commented on GitHub (Jul 24, 2025):

As a quick update, seems to be a bug specifically with qwen3 reranker. Do the local sentence transformers support it?

<!-- gh-comment-id:3113305673 --> @frenzybiscuit commented on GitHub (Jul 24, 2025): As a quick update, seems to be a bug specifically with qwen3 reranker. Do the local sentence transformers support it?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#33272