[GH-ISSUE #10505] Add cache for /api/models endpoint #15918

Closed
opened 2026-04-19 21:59:41 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @AstralFlare-owo on GitHub (Feb 21, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/10505

Is your feature request related to a problem? Please describe.
My API provider is under attack and it has poor network connection now. Because of that, when I send GET /api/models to Open WebUI, it will stuck on requesting the API provider's /v1/models, so the website will keep waiting with a blank page..

Describe the solution you'd like
Cache the model list, and response with cached model list when Open WebUI is stuck for more than a configurable time.

Describe alternatives you've considered
IDK

Additional context
Nothing

Originally created by @AstralFlare-owo on GitHub (Feb 21, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/10505 **Is your feature request related to a problem? Please describe.** My API provider is under attack and it has poor network connection now. Because of that, when I send `GET /api/models` to Open WebUI, it will stuck on requesting the API provider's `/v1/models`, so the website will keep waiting with a blank page.. **Describe the solution you'd like** Cache the model list, and response with cached model list when Open WebUI is stuck for more than a configurable time. **Describe alternatives you've considered** IDK **Additional context** Nothing
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#15918