mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 02:48:13 -05:00
[GH-ISSUE #10505] Add cache for /api/models endpoint
#15918
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @AstralFlare-owo on GitHub (Feb 21, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/10505
Is your feature request related to a problem? Please describe.
My API provider is under attack and it has poor network connection now. Because of that, when I send
GET /api/modelsto Open WebUI, it will stuck on requesting the API provider's/v1/models, so the website will keep waiting with a blank page..Describe the solution you'd like
Cache the model list, and response with cached model list when Open WebUI is stuck for more than a configurable time.
Describe alternatives you've considered
IDK
Additional context
Nothing