mirror of
https://github.com/open-webui/open-webui.git
synced 2026-03-13 18:44:23 -05:00
try openwebui api----- KeyError: 'llava-llama3:8b' #1031
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#1031
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @mrguo6221 on GitHub (May 24, 2024).
Bug Report
{
"model": "llava-llama3:8b",
"prompt": "tell me a story!",
"stream": false
} this is the post body url:http://192.168.1.160:4300/openai/api/ Authorization: Bearer sk-e10fd4637fa147b5ae5b1752dff55f31 Content-Type: application/json im try the api then 2024-05-24 22:46:09 KeyError: 'llava-llama3:8b' ,the model is this name,and i use it in the web ofen,but i cant use the api ,i dont know why,could u help me?
Description
Bug Summary:
{
"model": "llava-llama3:8b",
"prompt": "tell me a story!",
"stream": false
} this is the post body url:http://192.168.1.160:4300/openai/api/ Authorization: Bearer sk-e10fd4637fa147b5ae5b1752dff55f31 Content-Type: application/json im try the api then 2024-05-24 22:46:09 KeyError: 'llava-llama3:8b' ,the model is this name,and i use it in the web ofen,but i cant use the api ,i dont know why,could u help me?
Steps to Reproduce:
2024-05-24 23:11:36 INFO:apps.openai.main:get_all_models()
2024-05-24 23:11:36 INFO: 172.17.0.1:38848 - "POST /openai/api/ HTTP/1.1" 500 Internal Server Error
2024-05-24 23:11:36 ERROR: Exception in ASGI application
2024-05-24 23:11:36 + Exception Group Traceback (most recent call last):
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 192, in call
2024-05-24 23:11:36 | await response(scope, wrapped_receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 257, in call
2024-05-24 23:11:36 | async with anyio.create_task_group() as task_group:
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 678, in aexit
2024-05-24 23:11:36 | raise BaseExceptionGroup(
2024-05-24 23:11:36 | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
2024-05-24 23:11:36 +-+---------------- 1 ----------------
2024-05-24 23:11:36 | Traceback (most recent call last):
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 435, in run_asgi
2024-05-24 23:11:36 | result = await app( # type: ignore[func-returns-value]
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 78, in call
2024-05-24 23:11:36 | return await self.app(scope, receive, send)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
2024-05-24 23:11:36 | await super().call(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
2024-05-24 23:11:36 | await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
2024-05-24 23:11:36 | await self.app(scope, receive, _send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 | with collapse_excgroups():
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 | self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 260, in wrap
2024-05-24 23:11:36 | await func()
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
2024-05-24 23:11:36 | return await super().stream_response(send)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 249, in stream_response
2024-05-24 23:11:36 | async for chunk in self.body_iterator:
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
2024-05-24 23:11:36 | raise app_exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 | await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 | with collapse_excgroups():
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 | self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 260, in wrap
2024-05-24 23:11:36 | await func()
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
2024-05-24 23:11:36 | return await super().stream_response(send)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 249, in stream_response
2024-05-24 23:11:36 | async for chunk in self.body_iterator:
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
2024-05-24 23:11:36 | raise app_exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 | await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in call
2024-05-24 23:11:36 | await self.app(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 | with collapse_excgroups():
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 | self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 260, in wrap
2024-05-24 23:11:36 | await func()
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
2024-05-24 23:11:36 | return await super().stream_response(send)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 249, in stream_response
2024-05-24 23:11:36 | async for chunk in self.body_iterator:
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
2024-05-24 23:11:36 | raise app_exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 | await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
2024-05-24 23:11:36 | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
2024-05-24 23:11:36 | await app(scope, receive, sender)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 758, in call
2024-05-24 23:11:36 | await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 778, in app
2024-05-24 23:11:36 | await route.handle(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 487, in handle
2024-05-24 23:11:36 | await self.app(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
2024-05-24 23:11:36 | await super().call(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
2024-05-24 23:11:36 | await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
2024-05-24 23:11:36 | await self.app(scope, receive, _send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 | with collapse_excgroups():
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 | self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in call
2024-05-24 23:11:36 | response = await self.dispatch_func(request, call_next)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/app/backend/apps/openai/main.py", line 71, in check_url
2024-05-24 23:11:36 | response = await call_next(request)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next
2024-05-24 23:11:36 | raise app_exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 | await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in call
2024-05-24 23:11:36 | await self.app(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
2024-05-24 23:11:36 | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
2024-05-24 23:11:36 | await app(scope, receive, sender)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 758, in call
2024-05-24 23:11:36 | await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 778, in app
2024-05-24 23:11:36 | await route.handle(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 299, in handle
2024-05-24 23:11:36 | await self.app(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 79, in app
2024-05-24 23:11:36 | await wrap_app_handling_exceptions(app, request)(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
2024-05-24 23:11:36 | await app(scope, receive, sender)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 74, in app
2024-05-24 23:11:36 | response = await func(request)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 299, in app
2024-05-24 23:11:36 | raise e
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 294, in app
2024-05-24 23:11:36 | raw_response = await run_endpoint_function(
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
2024-05-24 23:11:36 | return await dependant.call(**values)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/app/backend/apps/openai/main.py", line 317, in proxy
2024-05-24 23:11:36 | idx = app.state.MODELS[body.get("model")]["urlIdx"]
2024-05-24 23:11:36 | ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | KeyError: 'llava-llama3:8b'
2024-05-24 23:11:36 +------------------------------------
2024-05-24 23:11:36
2024-05-24 23:11:36 During handling of the above exception, another exception occurred:
2024-05-24 23:11:36
2024-05-24 23:11:36 + Exception Group Traceback (most recent call last):
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 87, in collapse_excgroups
2024-05-24 23:11:36 | yield
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 190, in call
2024-05-24 23:11:36 | async with anyio.create_task_group() as task_group:
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 678, in aexit
2024-05-24 23:11:36 | raise BaseExceptionGroup(
2024-05-24 23:11:36 | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
2024-05-24 23:11:36 +-+---------------- 1 ----------------
2024-05-24 23:11:36 | Traceback (most recent call last):
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 264, in call
2024-05-24 23:11:36 | await wrap(partial(self.listen_for_disconnect, receive))
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 260, in wrap
2024-05-24 23:11:36 | await func()
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 237, in listen_for_disconnect
2024-05-24 23:11:36 | message = await receive()
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 52, in wrapped_receive
2024-05-24 23:11:36 | msg = await self.receive()
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 596, in receive
2024-05-24 23:11:36 | await self.message_event.wait()
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/asyncio/locks.py", line 213, in wait
2024-05-24 23:11:36 | await fut
2024-05-24 23:11:36 | asyncio.exceptions.CancelledError: Cancelled by cancel scope 7ff9cdd01790
2024-05-24 23:11:36 |
2024-05-24 23:11:36 | During handling of the above exception, another exception occurred:
2024-05-24 23:11:36 |
2024-05-24 23:11:36 | Exception Group Traceback (most recent call last):
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 192, in call
2024-05-24 23:11:36 | await response(scope, wrapped_receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 257, in call
2024-05-24 23:11:36 | async with anyio.create_task_group() as task_group:
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 678, in aexit
2024-05-24 23:11:36 | raise BaseExceptionGroup(
2024-05-24 23:11:36 | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
2024-05-24 23:11:36 +-+---------------- 1 ----------------
2024-05-24 23:11:36 | Traceback (most recent call last):
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 435, in run_asgi
2024-05-24 23:11:36 | result = await app( # type: ignore[func-returns-value]
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 78, in call
2024-05-24 23:11:36 | return await self.app(scope, receive, send)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
2024-05-24 23:11:36 | await super().call(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
2024-05-24 23:11:36 | await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
2024-05-24 23:11:36 | await self.app(scope, receive, _send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 | with collapse_excgroups():
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 | self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 260, in wrap
2024-05-24 23:11:36 | await func()
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
2024-05-24 23:11:36 | return await super().stream_response(send)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 249, in stream_response
2024-05-24 23:11:36 | async for chunk in self.body_iterator:
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
2024-05-24 23:11:36 | raise app_exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 | await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 | with collapse_excgroups():
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 | self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 260, in wrap
2024-05-24 23:11:36 | await func()
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
2024-05-24 23:11:36 | return await super().stream_response(send)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 249, in stream_response
2024-05-24 23:11:36 | async for chunk in self.body_iterator:
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
2024-05-24 23:11:36 | raise app_exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 | await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in call
2024-05-24 23:11:36 | await self.app(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 | with collapse_excgroups():
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 | self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 260, in wrap
2024-05-24 23:11:36 | await func()
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
2024-05-24 23:11:36 | return await super().stream_response(send)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 249, in stream_response
2024-05-24 23:11:36 | async for chunk in self.body_iterator:
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
2024-05-24 23:11:36 | raise app_exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 | await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
2024-05-24 23:11:36 | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
2024-05-24 23:11:36 | await app(scope, receive, sender)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 758, in call
2024-05-24 23:11:36 | await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 778, in app
2024-05-24 23:11:36 | await route.handle(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 487, in handle
2024-05-24 23:11:36 | await self.app(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
2024-05-24 23:11:36 | await super().call(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
2024-05-24 23:11:36 | await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
2024-05-24 23:11:36 | await self.app(scope, receive, _send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 | with collapse_excgroups():
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 | self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in call
2024-05-24 23:11:36 | response = await self.dispatch_func(request, call_next)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/app/backend/apps/openai/main.py", line 71, in check_url
2024-05-24 23:11:36 | response = await call_next(request)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next
2024-05-24 23:11:36 | raise app_exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 | await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in call
2024-05-24 23:11:36 | await self.app(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
2024-05-24 23:11:36 | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
2024-05-24 23:11:36 | await app(scope, receive, sender)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 758, in call
2024-05-24 23:11:36 | await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 778, in app
2024-05-24 23:11:36 | await route.handle(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 299, in handle
2024-05-24 23:11:36 | await self.app(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 79, in app
2024-05-24 23:11:36 | await wrap_app_handling_exceptions(app, request)(scope, receive, send)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
2024-05-24 23:11:36 | raise exc
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
2024-05-24 23:11:36 | await app(scope, receive, sender)
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 74, in app
2024-05-24 23:11:36 | response = await func(request)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 299, in app
2024-05-24 23:11:36 | raise e
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 294, in app
2024-05-24 23:11:36 | raw_response = await run_endpoint_function(
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
2024-05-24 23:11:36 | return await dependant.call(**values)
2024-05-24 23:11:36 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | File "/app/backend/apps/openai/main.py", line 317, in proxy
2024-05-24 23:11:36 | idx = app.state.MODELS[body.get("model")]["urlIdx"]
2024-05-24 23:11:36 | ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 | KeyError: 'llava-llama3:8b'
2024-05-24 23:11:36 +------------------------------------
2024-05-24 23:11:36
2024-05-24 23:11:36 During handling of the above exception, another exception occurred:
2024-05-24 23:11:36
2024-05-24 23:11:36 Traceback (most recent call last):
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 435, in run_asgi
2024-05-24 23:11:36 result = await app( # type: ignore[func-returns-value]
2024-05-24 23:11:36 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 78, in call
2024-05-24 23:11:36 return await self.app(scope, receive, send)
2024-05-24 23:11:36 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
2024-05-24 23:11:36 await super().call(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
2024-05-24 23:11:36 await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
2024-05-24 23:11:36 raise exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
2024-05-24 23:11:36 await self.app(scope, receive, _send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 with collapse_excgroups():
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 raise exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 260, in wrap
2024-05-24 23:11:36 await func()
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
2024-05-24 23:11:36 return await super().stream_response(send)
2024-05-24 23:11:36 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 249, in stream_response
2024-05-24 23:11:36 async for chunk in self.body_iterator:
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
2024-05-24 23:11:36 raise app_exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 with collapse_excgroups():
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 raise exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 260, in wrap
2024-05-24 23:11:36 await func()
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
2024-05-24 23:11:36 return await super().stream_response(send)
2024-05-24 23:11:36 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 249, in stream_response
2024-05-24 23:11:36 async for chunk in self.body_iterator:
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
2024-05-24 23:11:36 raise app_exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in call
2024-05-24 23:11:36 await self.app(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 with collapse_excgroups():
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 raise exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 260, in wrap
2024-05-24 23:11:36 await func()
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 217, in stream_response
2024-05-24 23:11:36 return await super().stream_response(send)
2024-05-24 23:11:36 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/responses.py", line 249, in stream_response
2024-05-24 23:11:36 async for chunk in self.body_iterator:
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 181, in body_stream
2024-05-24 23:11:36 raise app_exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
2024-05-24 23:11:36 await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
2024-05-24 23:11:36 raise exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
2024-05-24 23:11:36 await app(scope, receive, sender)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 758, in call
2024-05-24 23:11:36 await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 778, in app
2024-05-24 23:11:36 await route.handle(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 487, in handle
2024-05-24 23:11:36 await self.app(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
2024-05-24 23:11:36 await super().call(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
2024-05-24 23:11:36 await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
2024-05-24 23:11:36 raise exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
2024-05-24 23:11:36 await self.app(scope, receive, _send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
2024-05-24 23:11:36 with collapse_excgroups():
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
2024-05-24 23:11:36 self.gen.throw(typ, value, traceback)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
2024-05-24 23:11:36 raise exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in call
2024-05-24 23:11:36 response = await self.dispatch_func(request, call_next)
2024-05-24 23:11:36 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 File "/app/backend/apps/openai/main.py", line 71, in check_url
2024-05-24 23:11:36 response = await call_next(request)
2024-05-24 23:11:36 ^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next
2024-05-24 23:11:36 raise app_exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
2024-05-24 23:11:36 await self.app(scope, receive_or_disconnect, send_no_error)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 83, in call
2024-05-24 23:11:36 await self.app(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
2024-05-24 23:11:36 await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
2024-05-24 23:11:36 raise exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
2024-05-24 23:11:36 await app(scope, receive, sender)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 758, in call
2024-05-24 23:11:36 await self.middleware_stack(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 778, in app
2024-05-24 23:11:36 await route.handle(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 299, in handle
2024-05-24 23:11:36 await self.app(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 79, in app
2024-05-24 23:11:36 await wrap_app_handling_exceptions(app, request)(scope, receive, send)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
2024-05-24 23:11:36 raise exc
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
2024-05-24 23:11:36 await app(scope, receive, sender)
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 74, in app
2024-05-24 23:11:36 response = await func(request)
2024-05-24 23:11:36 ^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 299, in app
2024-05-24 23:11:36 raise e
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 294, in app
2024-05-24 23:11:36 raw_response = await run_endpoint_function(
2024-05-24 23:11:36 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
2024-05-24 23:11:36 return await dependant.call(**values)
2024-05-24 23:11:36 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 File "/app/backend/apps/openai/main.py", line 317, in proxy
2024-05-24 23:11:36 idx = app.state.MODELS[body.get("model")]["urlIdx"]
2024-05-24 23:11:36 ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^
2024-05-24 23:11:36 KeyError: 'llava-llama3:8b'
Expected Behavior:
[Describe what you expected to happen.]
Actual Behavior:
[Describe what actually happened.]
Environment
Open WebUI Version: [e.g., 0.1.120]
Ollama (if applicable): [e.g., 0.1.30, 0.1.32-rc1]
Operating System: [e.g., Windows 10, macOS Big Sur, Ubuntu 20.04]
Browser (if applicable): [e.g., Chrome 100.0, Firefox 98.0]
Reproduction Details
Confirmation:
Logs and Screenshots
Browser Console Logs:
[Include relevant browser console logs, if applicable]
Docker Container Logs:
[Include relevant Docker container logs, if applicable]
Screenshots (if applicable):
[Attach any relevant screenshots to help illustrate the issue]
Installation Method
[Describe the method you used to install the project, e.g., manual installation, Docker, package manager, etc.]
Additional Information
[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]
Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
@justinh-rahb commented on GitHub (May 24, 2024):
@mrguo6221 you exposed your API key, you better expire that quickly.
@mrguo6221 commented on GitHub (May 24, 2024):
“No impact, just the local network port.”