github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-05-23 18:41:28 -05:00
Code Issues 2.4k Packages Projects Releases 129 Wiki Activity

[GH-ISSUE #1750] enhancement: litellm opt-out support #99621

New Issue
Closed
opened 2026-05-17 21:37:55 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-05-17 21:37:55 -05:00
Owner
Copy Link

Originally created by @imkebe on GitHub (Apr 25, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/1750

Bug Report

Description

Bug Summary:
Frontend seems to fail because of the /itellm/api/v1/models timeout.

Steps to Reproduce:
Updated to v0.1.121

Expected Behavior:
There shouldn't be any hard LiteLLM deps.

Actual Behavior:
After login page the screen is empty. Pending llm models api fetch, while the service has never started.

Environment

  • Open WebUI Version:
    0.1.121

  • Ollama (if applicable):
    0.1.30, 0.1.32

  • Browser (if applicable):
    Brave 1.65.114 Chromium: 124.0.6367.60 , Firefox 125.0.2

Reproduction Details

ERROR:apps.litellm.main:Failed to start subprocess: [Errno 12] Cannot allocate memory
ERROR:asyncio:Task exception was never retrieved
future: <Task finished name='Task-3' coro=<start_litellm_background() done, defined at /app/backend/apps/litellm/main.py:98> exception=OSError(12, 'Cannot allocate memory')>
Traceback (most recent call last):
  File "/app/backend/apps/litellm/main.py", line 113, in start_litellm_background
    await run_background_process(command)
  File "/app/backend/apps/litellm/main.py", line 74, in run_background_process
    process = await asyncio.create_subprocess_exec(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/asyncio/subprocess.py", line 223, in create_subprocess_exec
    transport, protocol = await loop.subprocess_exec(
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "uvloop/loop.pyx", line 2820, in subprocess_exec
  File "uvloop/loop.pyx", line 2778, in __subprocess_run
  File "uvloop/handles/process.pyx", line 611, in uvloop.loop.UVProcessTransport.new
  File "uvloop/handles/process.pyx", line 112, in uvloop.loop.UVProcess._init
OSError: [Errno 12] Cannot allocate memory
Originally created by @imkebe on GitHub (Apr 25, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/1750 # Bug Report ## Description **Bug Summary:** Frontend seems to fail because of the `/itellm/api/v1/models` timeout. **Steps to Reproduce:** Updated to v0.1.121 **Expected Behavior:** There shouldn't be any hard LiteLLM deps. **Actual Behavior:** After login page the screen is empty. Pending llm models api fetch, while the service has never started. ## Environment - **Open WebUI Version:** 0.1.121 - **Ollama (if applicable):** 0.1.30, 0.1.32 - **Browser (if applicable):** Brave 1.65.114 Chromium: 124.0.6367.60 , Firefox 125.0.2 ## Reproduction Details ```INFO:apps.litellm.main:Executing command: ['litellm', '--port', '14365', '--host', '127.0.0.1', '--telemetry', 'False', '--config', '/app/backend/data/litellm/config.yaml'] ERROR:apps.litellm.main:Failed to start subprocess: [Errno 12] Cannot allocate memory ERROR:asyncio:Task exception was never retrieved future: <Task finished name='Task-3' coro=<start_litellm_background() done, defined at /app/backend/apps/litellm/main.py:98> exception=OSError(12, 'Cannot allocate memory')> Traceback (most recent call last): File "/app/backend/apps/litellm/main.py", line 113, in start_litellm_background await run_background_process(command) File "/app/backend/apps/litellm/main.py", line 74, in run_background_process process = await asyncio.create_subprocess_exec( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/asyncio/subprocess.py", line 223, in create_subprocess_exec transport, protocol = await loop.subprocess_exec( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "uvloop/loop.pyx", line 2820, in subprocess_exec File "uvloop/loop.pyx", line 2778, in __subprocess_run File "uvloop/handles/process.pyx", line 611, in uvloop.loop.UVProcessTransport.new File "uvloop/handles/process.pyx", line 112, in uvloop.loop.UVProcess._init OSError: [Errno 12] Cannot allocate memory ```
GiteaMirror commented 2026-05-17 21:37:56 -05:00
Author
Owner
Copy Link

@imkebe commented on GitHub (Apr 26, 2024):

Why this is an enhancement and no bug related? That was working fine with 0.1.120.

<!-- gh-comment-id:2079250786 --> @imkebe commented on GitHub (Apr 26, 2024): Why this is an enhancement and no bug related? That was working fine with 0.1.120.
GiteaMirror commented 2026-05-17 21:37:57 -05:00
Author
Owner
Copy Link

@imkebe commented on GitHub (Apr 26, 2024):

Also I noticed that the issue is in fact not having a timeout. When I block the URI of that endpoint in browser the Frontend is rendering. So in fact it waits forever trying to fetch the data and blocks the rendering of the Frontend.

<!-- gh-comment-id:2079254183 --> @imkebe commented on GitHub (Apr 26, 2024): Also I noticed that the issue is in fact not having a timeout. When I block the URI of that endpoint in browser the Frontend is rendering. So in fact it waits forever trying to fetch the data and blocks the rendering of the Frontend.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#99621
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?