LiteLLM 1.31.10 release breaks open-webui #476

New Issue

Closed

opened 2025-11-11 14:22:30 -06:00 by GiteaMirror · 3 comments

GiteaMirror commented 2025-11-11 14:22:30 -06:00

Owner

Copy Link

Originally created by @jfernandrezj on GitHub (Mar 14, 2024).

Bug Report

Description

Bug Summary:
open-webui | Traceback (most recent call last):
open-webui | File "/usr/local/bin/uvicorn", line 8, in
open-webui | sys.exit(main())
open-webui | ^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1157, in call
open-webui | return self.main(*args, **kwargs)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1078, in main
open-webui | rv = self.invoke(ctx)
open-webui | ^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
open-webui | return ctx.invoke(self.callback, **ctx.params)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke
open-webui | return __callback(*args, **kwargs)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 409, in main
open-webui | run(
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 575, in run
open-webui | server.run()
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 62, in run
open-webui | return asyncio.run(self.serve(sockets=sockets))
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
open-webui | return runner.run(main)
open-webui | ^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
open-webui | return self._loop.run_until_complete(task)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 69, in serve
open-webui | config.load()
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/config.py", line 433, in load
open-webui | self.loaded_app = import_from_string(self.app)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 22, in import_from_string
open-webui | raise exc from None
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 19, in import_from_string
open-webui | module = importlib.import_module(module_str)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module
open-webui | return _bootstrap._gcd_import(name[level:], package, level)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "", line 1204, in _gcd_import
open-webui | File "", line 1176, in _find_and_load
open-webui | File "", line 1147, in _find_and_load_unlocked
open-webui | File "", line 690, in _load_unlocked
open-webui | File "", line 940, in exec_module
open-webui | File "", line 241, in _call_with_frames_removed
open-webui | File "/app/backend/main.py", line 18, in
open-webui | from litellm.proxy.proxy_server import ProxyConfig, initialize
open-webui | File "/usr/local/lib/python3.11/site-packages/litellm/proxy/proxy_server.py", line 150, in
open-webui | import enterprise # type: ignore
open-webui | ^^^^^^^^^^^^^^^^^

Steps to Reproduce:
Run the Docker Compose

Expected Behavior:
It should work

Actual Behavior:
Errors out

Environment

Ubuntu 22.04

Reproduction Details

Confirmation:

• I have read and followed all the instructions provided in the README.md.
• I am on the latest version of both Open WebUI and Ollama.
• I have included the browser console logs.
• I have included the Docker container logs.

Logs and Screenshots

Browser Console Logs:
[Include relevant browser console logs, if applicable]

Docker Container Logs:
open-webui | Traceback (most recent call last):
open-webui | File "/usr/local/bin/uvicorn", line 8, in
open-webui | sys.exit(main())
open-webui | ^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1157, in call
open-webui | return self.main(*args, **kwargs)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1078, in main
open-webui | rv = self.invoke(ctx)
open-webui | ^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
open-webui | return ctx.invoke(self.callback, **ctx.params)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke
open-webui | return __callback(*args, **kwargs)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 409, in main
open-webui | run(
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 575, in run
open-webui | server.run()
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 62, in run
open-webui | return asyncio.run(self.serve(sockets=sockets))
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
open-webui | return runner.run(main)
open-webui | ^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
open-webui | return self._loop.run_until_complete(task)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 69, in serve
open-webui | config.load()
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/config.py", line 433, in load
open-webui | self.loaded_app = import_from_string(self.app)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 22, in import_from_string
open-webui | raise exc from None
open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 19, in import_from_string
open-webui | module = importlib.import_module(module_str)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module
open-webui | return _bootstrap._gcd_import(name[level:], package, level)
open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
open-webui | File "", line 1204, in _gcd_import
open-webui | File "", line 1176, in _find_and_load
open-webui | File "", line 1147, in _find_and_load_unlocked
open-webui | File "", line 690, in _load_unlocked
open-webui | File "", line 940, in exec_module
open-webui | File "", line 241, in _call_with_frames_removed
open-webui | File "/app/backend/main.py", line 18, in
open-webui | from litellm.proxy.proxy_server import ProxyConfig, initialize
open-webui | File "/usr/local/lib/python3.11/site-packages/litellm/proxy/proxy_server.py", line 150, in
open-webui | import enterprise # type: ignore
open-webui | ^^^^^^^^^^^^^^^^^

Screenshots (if applicable):
[Attach any relevant screenshots to help illustrate the issue]

Installation Method

Docker Compose

Additional Information

https://github.com/BerriAI/litellm/releases/tag/v1.31.10
Using LiteLLM v1.30.2 works

Note

If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!

Originally created by @jfernandrezj on GitHub (Mar 14, 2024). # Bug Report ## Description **Bug Summary:** open-webui | Traceback (most recent call last): open-webui | File "/usr/local/bin/uvicorn", line 8, in <module> open-webui | sys.exit(main()) open-webui | ^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1157, in __call__ open-webui | return self.main(*args, **kwargs) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1078, in main open-webui | rv = self.invoke(ctx) open-webui | ^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke open-webui | return ctx.invoke(self.callback, **ctx.params) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke open-webui | return __callback(*args, **kwargs) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 409, in main open-webui | run( open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 575, in run open-webui | server.run() open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 62, in run open-webui | return asyncio.run(self.serve(sockets=sockets)) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run open-webui | return runner.run(main) open-webui | ^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run open-webui | return self._loop.run_until_complete(task) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 69, in serve open-webui | config.load() open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/config.py", line 433, in load open-webui | self.loaded_app = import_from_string(self.app) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 22, in import_from_string open-webui | raise exc from None open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 19, in import_from_string open-webui | module = importlib.import_module(module_str) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/importlib/__init__.py", line 126, in import_module open-webui | return _bootstrap._gcd_import(name[level:], package, level) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "<frozen importlib._bootstrap>", line 1204, in _gcd_import open-webui | File "<frozen importlib._bootstrap>", line 1176, in _find_and_load open-webui | File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked open-webui | File "<frozen importlib._bootstrap>", line 690, in _load_unlocked open-webui | File "<frozen importlib._bootstrap_external>", line 940, in exec_module open-webui | File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed open-webui | File "/app/backend/main.py", line 18, in <module> open-webui | from litellm.proxy.proxy_server import ProxyConfig, initialize open-webui | File "/usr/local/lib/python3.11/site-packages/litellm/proxy/proxy_server.py", line 150, in <module> open-webui | import enterprise # type: ignore open-webui | ^^^^^^^^^^^^^^^^^ **Steps to Reproduce:** Run the Docker Compose **Expected Behavior:** It should work **Actual Behavior:** Errors out ## Environment Ubuntu 22.04 ## Reproduction Details **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [x] I am on the latest version of both Open WebUI and Ollama. - [ ] I have included the browser console logs. - [x] I have included the Docker container logs. ## Logs and Screenshots **Browser Console Logs:** [Include relevant browser console logs, if applicable] **Docker Container Logs:** open-webui | Traceback (most recent call last): open-webui | File "/usr/local/bin/uvicorn", line 8, in <module> open-webui | sys.exit(main()) open-webui | ^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1157, in __call__ open-webui | return self.main(*args, **kwargs) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1078, in main open-webui | rv = self.invoke(ctx) open-webui | ^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke open-webui | return ctx.invoke(self.callback, **ctx.params) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke open-webui | return __callback(*args, **kwargs) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 409, in main open-webui | run( open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/main.py", line 575, in run open-webui | server.run() open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 62, in run open-webui | return asyncio.run(self.serve(sockets=sockets)) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run open-webui | return runner.run(main) open-webui | ^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run open-webui | return self._loop.run_until_complete(task) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/server.py", line 69, in serve open-webui | config.load() open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/config.py", line 433, in load open-webui | self.loaded_app = import_from_string(self.app) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 22, in import_from_string open-webui | raise exc from None open-webui | File "/usr/local/lib/python3.11/site-packages/uvicorn/importer.py", line 19, in import_from_string open-webui | module = importlib.import_module(module_str) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "/usr/local/lib/python3.11/importlib/__init__.py", line 126, in import_module open-webui | return _bootstrap._gcd_import(name[level:], package, level) open-webui | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ open-webui | File "<frozen importlib._bootstrap>", line 1204, in _gcd_import open-webui | File "<frozen importlib._bootstrap>", line 1176, in _find_and_load open-webui | File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked open-webui | File "<frozen importlib._bootstrap>", line 690, in _load_unlocked open-webui | File "<frozen importlib._bootstrap_external>", line 940, in exec_module open-webui | File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed open-webui | File "/app/backend/main.py", line 18, in <module> open-webui | from litellm.proxy.proxy_server import ProxyConfig, initialize open-webui | File "/usr/local/lib/python3.11/site-packages/litellm/proxy/proxy_server.py", line 150, in <module> open-webui | import enterprise # type: ignore open-webui | ^^^^^^^^^^^^^^^^^ **Screenshots (if applicable):** [Attach any relevant screenshots to help illustrate the issue] ## Installation Method Docker Compose ## Additional Information https://github.com/BerriAI/litellm/releases/tag/v1.31.10 Using LiteLLM v1.30.2 works ## Note If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!

GiteaMirror closed this issue 2025-11-11 14:22:30 -06:00

GiteaMirror commented 2025-11-11 14:22:31 -06:00

Author

Owner

Copy Link

@justinh-rahb commented on GitHub (Mar 14, 2024):

Should be easy to resolve by constraining the allowable versions to install in requirements.txt

EDIT: It's already pinned to 1.30.7 which doesn't seem to be causing issues for anyone:

litellm==1.30.7

7ae4669f35/backend/requirements.txt (L19C1-L19C8)

So now I have to wonder how/why you forced it to a newer version?

@justinh-rahb commented on GitHub (Mar 14, 2024): Should be easy to resolve by constraining the allowable versions to install in `requirements.txt` **EDIT:** It's already pinned to `1.30.7` which doesn't seem to be causing issues for anyone: ``` litellm==1.30.7 ``` https://github.com/open-webui/open-webui/blob/7ae4669f350ad30b44594c5e76759db445d9bf5d/backend/requirements.txt#L19C1-L19C8 So now I have to wonder how/why you forced it to a newer version?

GiteaMirror commented 2025-11-11 14:22:32 -06:00

Author

Owner

Copy Link

@jfernandrezj commented on GitHub (Mar 14, 2024):

Nevermind, resolved in latest release

@jfernandrezj commented on GitHub (Mar 14, 2024): Nevermind, resolved in latest release

GiteaMirror commented 2025-11-11 14:22:32 -06:00

Author

Owner

Copy Link

@jfernandrezj commented on GitHub (Mar 14, 2024):

Had a previous release where it was not constrained

@jfernandrezj commented on GitHub (Mar 14, 2024): Had a previous release where it was not constrained

GiteaMirror referenced this issue 2026-04-19 18:51:53 -05:00

[GH-ISSUE #476] Proxy support for downloading the models #12080

GiteaMirror referenced this issue 2026-04-25 02:20:05 -05:00

[GH-ISSUE #476] Proxy support for downloading the models #27608

GiteaMirror referenced this issue 2026-05-05 11:03:46 -05:00

[GH-ISSUE #476] Proxy support for downloading the models #50745

GiteaMirror referenced this issue 2026-05-12 22:54:11 -05:00

[GH-ISSUE #476] Proxy support for downloading the models #66684

GiteaMirror referenced this issue 2026-05-15 07:38:16 -05:00

[GH-ISSUE #476] Proxy support for downloading the models #82820

GiteaMirror referenced this issue 2026-05-17 20:51:33 -05:00

[GH-ISSUE #476] Proxy support for downloading the models #99075

GiteaMirror referenced this issue 2026-05-20 17:07:57 -05:00

[GH-ISSUE #476] Proxy support for downloading the models #115390

GiteaMirror referenced this issue 2026-05-24 19:03:46 -05:00

[GH-ISSUE #476] Proxy support for downloading the models #131807

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

dev

v0.9.6

v0.9.5

v0.9.4

v0.9.3

v0.9.2

v0.9.1

v0.9.0

v0.8.12

v0.8.11

v0.8.10

v0.8.9

v0.8.8

v0.8.7

v0.8.6

v0.8.5

v0.8.4

v0.8.3

v0.8.2

v0.8.1

v0.8.0

v0.7.2

v0.7.1

v0.7.0

v0.6.43

v0.6.42

v0.6.41

v0.6.40

v0.6.39

v0.6.38

v0.6.37

v0.6.36

v0.6.35

v0.6.34

v0.6.33

v0.6.32

v0.6.31

v0.6.30

v0.6.29

v0.6.28

v0.6.27

v0.6.26

v0.6.25

v0.6.24

v0.6.23

v0.6.22

v0.6.21

v0.6.20

v0.6.19

v0.6.18

v0.6.17

v0.6.16

v0.6.15

v0.6.14

v0.6.13

v0.6.12

v0.6.11

v0.6.10

v0.6.9

v0.6.8

v0.6.7

v0.6.6

v0.6.5

v0.6.4

v0.6.3

v0.6.2

v0.6.1

v0.6.0

v0.5.20

v0.5.19

v0.5.18

v0.5.17

v0.5.16

v0.5.15

v0.5.14

v0.5.13

v0.5.12

v0.5.11

v0.5.10

v0.5.9

v0.5.8

v0.5.7

v0.5.6

v0.5.5

v0.5.4

v0.5.3

v0.5.2

v0.5.1

v0.5.0

v0.4.8

v0.4.7

v0.4.6

v0.4.5

v0.4.4

v0.4.3

v0.4.2

v0.4.1

v0.4.0

v0.3.35

v0.3.34

v0.3.33

v0.3.32

v0.3.31

v0.3.30

v0.3.29

v0.3.28

v0.3.27

v0.3.26

v0.3.25

v0.3.24

v0.3.23

v0.3.22

v0.3.21

v0.3.20

v0.3.19

v0.3.18

v0.3.17

v0.3.16

v0.3.15

v0.3.14

v0.3.13

v0.3.12

v0.3.11

v0.3.10

v0.3.9

v0.3.8

v0.3.7

v0.3.6

v0.3.5

v0.3.4

v0.3.3

v0.3.2

v0.3.1

v0.3.0

v0.2.5

v0.2.4

v0.2.3

v0.2.2

v0.2.1

v0.2.0

v0.1.125

v0.1.124

v0.1.123

v0.1.122

v0.1.121

v0.1.120

v0.1.119

v0.1.118

v0.1.117

v0.1.116

v0.1.115

v0.1.114

v0.1.113

v0.1.112

v0.1.111

v0.1.110

v0.1.109

v0.1.108

v0.1.107

v0.1.106

v0.1.105

v0.1.104

v0.1.103

v0.1.102

Labels

Clear labels

bug

confirmed

confirmed issue

core

documentation

enhancement

good first issue

help wanted

non-core

pull-request

Mirrored from GitHub Pull Request

python

question

testing wanted

No Label

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

GiteaMirror ninjasurge

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#476