[GH-ISSUE #14875] issue: Containers seem to be hanging on usage pool cleanup or afterwards #32919

Closed
opened 2026-04-25 06:46:01 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @Ithanil on GitHub (Jun 11, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/14875

Originally assigned to: @jackthgu on GitHub.

Check Existing Issues

  • I have searched the existing issues and discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Git Clone

Open WebUI Version

0.6.14

Ollama Version (if applicable)

No response

Operating System

Debian Bookworm

Browser (if applicable)

No response

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided every relevant configuration, setting, and environment variable used in my setup.
  • I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
  • I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
  • Start with the initial platform/version/OS and dependencies used,
  • Specify exact install/launch/configure commands,
  • List URLs visited, user input (incl. example values/emails/passwords if needed),
  • Describe all options and toggles enabled or changed,
  • Include any files or environmental changes,
  • Identify the expected and actual result at each stage,
  • Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

Container doesn't hang on log line "Running periodic_usage_pool_cleanup".

Actual Behavior

Container hangs on log line "Running periodic_usage_pool_cleanup". Had this issue before (https://github.com/open-webui/open-webui/issues/14813), but usually I could resolve it with multiple restart tries. Now my luck seems to have run out.

Steps to Reproduce

  1. Start with Docker 0.6.13 in multi-replica Docker Swarm (although the effect still happens when only 1 replica is active/wants to start), using Redis (Sentinel) and PG/Pgvector.
  2. Deploy 0.6.14 image with docker stack deploy
  3. See booted containers stay unresponsive (e.g. curl hangs)
  4. Scale down to 0 containers
  5. Start single container again
  6. Problem persists on multiple restarts
  7. After the 6th retry or so it works

Logs & Screenshots

INFO: Started server process [1]
INFO: Waiting for application startup.

██████╗ ██████╗ ███████╗███╗ ██╗ ██╗ ██╗███████╗██████╗ ██╗ ██╗██╗
██╔═══██╗██╔══██╗██╔════╝████╗ ██║ ██║ ██║██╔════╝██╔══██╗██║ ██║██║
██║ ██║██████╔╝█████╗ ██╔██╗ ██║ ██║ █╗ ██║█████╗ ██████╔╝██║ ██║██║
██║ ██║██╔═══╝ ██╔══╝ ██║╚██╗██║ ██║███╗██║██╔══╝ ██╔══██╗██║ ██║█���║
╚██████╔╝██║ ███████╗██║ ╚████║ ╚███╔███╔╝███████╗██████╔╝╚██████╔╝██║
╚═════╝ ╚═╝ ╚══════╝╚═╝ ╚═══╝ ╚══╝╚══╝ ╚══════╝╚═════╝ ╚═════╝ ╚═╝

v0.6.14 - building the best AI user interface.

https://github.com/open-webui/open-webui

2025-06-11 07:20:53.793 | INFO | open_webui.utils.logger:start_logger:140 - GLOBAL_LOG_LEVEL: DEBUG - {}
2025-06-11 07:20:53.793 | INFO | open_webui.main:lifespan:505 - Installing external dependencies of functions and tools... - {}
2025-06-11 07:20:53.854 | INFO | open_webui.utils.plugin:install_frontmatter_requirements:241 - No requirements found in frontmatter. - {}
2025-06-11 07:20:53.901 | DEBUG | open_webui.socket.main:periodic_usage_pool_cleanup:111 - Running periodic_usage_pool_cleanup - {}

Additional Information

Previous issue, where I thought this happened only with multiple replicas and then also struggled to reproduce: https://github.com/open-webui/open-webui/issues/14813

And before it didn't take that many restarts to finally boot. I think there was a regression already in some 0.6.1x version.

Potentially the same issue, albeit with older versions:
https://github.com/open-webui/open-webui/issues/13848
https://github.com/open-webui/open-webui/issues/11354

Originally created by @Ithanil on GitHub (Jun 11, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/14875 Originally assigned to: @jackthgu on GitHub. ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Git Clone ### Open WebUI Version 0.6.14 ### Ollama Version (if applicable) _No response_ ### Operating System Debian Bookworm ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior Container doesn't hang on log line "Running periodic_usage_pool_cleanup". ### Actual Behavior Container hangs on log line "Running periodic_usage_pool_cleanup". Had this issue before (https://github.com/open-webui/open-webui/issues/14813), but usually I could resolve it with multiple restart tries. Now my luck seems to have run out. ### Steps to Reproduce 1. Start with Docker 0.6.13 in multi-replica Docker Swarm (although the effect still happens when only 1 replica is active/wants to start), using Redis (Sentinel) and PG/Pgvector. 2. Deploy 0.6.14 image with `docker stack deploy` 3. See booted containers stay unresponsive (e.g. curl hangs) 4. Scale down to 0 containers 5. Start single container again 6. Problem persists on multiple restarts 7. After the 6th retry or so it works ### Logs & Screenshots INFO: Started server process [1] INFO: Waiting for application startup. ██████╗ ██████╗ ███████╗███╗ ██╗ ██╗ ██╗███████╗██████╗ ██╗ ██╗██╗ ██╔═══██╗██╔══██╗██╔════╝████╗ ██║ ██║ ██║██╔════╝██╔══██╗██║ ██║██║ ██║ ██║██████╔╝█████╗ ██╔██╗ ██║ ██║ █╗ ██║█████╗ ██████╔╝██║ ██║██║ ██║ ██║██╔═══╝ ██╔══╝ ██║╚██╗██║ ██║███╗██║██╔══╝ ██╔══██╗██║ ██║█���║ ╚██████╔╝██║ ███████╗██║ ╚████║ ╚███╔███╔╝███████╗██████╔╝╚██████╔╝██║ ╚═════╝ ╚═╝ ╚══════╝╚═╝ ╚═══╝ ╚══╝╚══╝ ╚══════╝╚═════╝ ╚═════╝ ╚═╝ v0.6.14 - building the best AI user interface. https://github.com/open-webui/open-webui 2025-06-11 07:20:53.793 | INFO | open_webui.utils.logger:start_logger:140 - GLOBAL_LOG_LEVEL: DEBUG - {} 2025-06-11 07:20:53.793 | INFO | open_webui.main:lifespan:505 - Installing external dependencies of functions and tools... - {} 2025-06-11 07:20:53.854 | INFO | open_webui.utils.plugin:install_frontmatter_requirements:241 - No requirements found in frontmatter. - {} 2025-06-11 07:20:53.901 | DEBUG | open_webui.socket.main:periodic_usage_pool_cleanup:111 - Running periodic_usage_pool_cleanup - {} ### Additional Information Previous issue, where I thought this happened only with multiple replicas and then also struggled to reproduce: https://github.com/open-webui/open-webui/issues/14813 And before it didn't take that many restarts to finally boot. I think there was a regression already in some 0.6.1x version. Potentially the same issue, albeit with older versions: https://github.com/open-webui/open-webui/issues/13848 https://github.com/open-webui/open-webui/issues/11354
GiteaMirror added the bug label 2026-04-25 06:46:01 -05:00
Author
Owner

@tjbck commented on GitHub (Jun 11, 2025):

Could you share all of your env vars?

<!-- gh-comment-id:2962029747 --> @tjbck commented on GitHub (Jun 11, 2025): Could you share all of your env vars?
Author
Owner

@tjbck commented on GitHub (Jun 11, 2025):

@Ithanil We definitely cannot reproduce this issue, could you also try to isolate the issue and test pure redis configuration instead of sentinel?

<!-- gh-comment-id:2962037428 --> @tjbck commented on GitHub (Jun 11, 2025): @Ithanil We definitely cannot reproduce this issue, could you also try to isolate the issue and test pure redis configuration instead of sentinel?
Author
Owner

@tjbck commented on GitHub (Jun 11, 2025):

This definitely seems very unlikely to be related to redis, I'd suggest you share every single detail regarding your deployment so that we can actually reproduce as mentioned in the template. Have you also tested and reproduced the issue in an entirely separate environment and made any attempts to isolate the issue?

#13848 #11354 both point to user error fyi

<!-- gh-comment-id:2962046332 --> @tjbck commented on GitHub (Jun 11, 2025): This definitely seems very unlikely to be related to redis, I'd suggest you share every single detail regarding your deployment so that we can actually reproduce as mentioned in the template. Have you also tested and reproduced the issue in an entirely separate environment and made any attempts to isolate the issue? #13848 #11354 both point to user error fyi
Author
Owner

@Ithanil commented on GitHub (Jun 11, 2025):

@tjbck I have made progress and have to apologize, because this is indeed totally unrelated to Open WebUI. I suspect a regression in a recent update of Docker, affecting Docker Swarm networking.

Why I come to this conclusion:

  1. Running curl from within the container works
  2. Running curl from another container in the same Docker network works
  3. Running curl from the host against localhost:exposed_port does not work.

Sorry for the noise again. I didn't expect something Docker-related to be the reason here, but it fits problems I have with another application since a recent update of Docker packages.

<!-- gh-comment-id:2962095622 --> @Ithanil commented on GitHub (Jun 11, 2025): @tjbck I have made progress and have to apologize, because this is indeed totally unrelated to Open WebUI. I suspect a regression in a recent update of Docker, affecting Docker Swarm networking. Why I come to this conclusion: 1) Running curl from within the container works 2) Running curl from another container in the same Docker network works 3) Running curl from the host against localhost:exposed_port does not work. Sorry for the noise *again*. I didn't expect something Docker-related to be the reason here, but it fits problems I have with another application since a recent update of Docker packages.
Author
Owner

@Ithanil commented on GitHub (Jun 11, 2025):

Nevertheless, if other people run into similar issues this will hopefully serve as a pointer.

<!-- gh-comment-id:2962098001 --> @Ithanil commented on GitHub (Jun 11, 2025): Nevertheless, if other people run into similar issues this will hopefully serve as a pointer.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#32919