mirror of
https://github.com/open-webui/open-webui.git
synced 2026-03-10 07:43:10 -05:00
feat: set limit/cache for repetitive /models calls
#5744
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#5744
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @steveepreston on GitHub (Jul 12, 2025).
Check Existing Issues
Problem Description
Problem explained here: https://github.com/open-webui/open-webui/issues/15662
Which leads to models list breakdown due 429 or another unsuccessful fetch among spam calls
and this leads to chat page breakdown and need to refresh page.
Desired Solution you'd like
please set a limit for this calls as cache, or let the call turned off, for conditions that models list is constant and user-defined
Alternatives Considered
No response
Additional Context
No response
@rgaricano commented on GitHub (Jul 12, 2025):
I commented in https://github.com/open-webui/open-webui/issues/15662#issuecomment-3064937168
@tjbck commented on GitHub (Jul 12, 2025):
Model Cache feature already exists in dev, and calling
/modelsmultiple times should NOT break the system and this has been already battle tested with deployments over 50k+ users. I'd suggest you check for your reverse proxy configuration.@steveepreston commented on GitHub (Jul 12, 2025):
@tjbck Thanks for note 🙏
will
devmerged with main for next version?agree, but it break in other way: third-party endpoint server rate limit because of calling an api multiple time at once, this leads that one of
/modelsresponses is not ok, then open-webui clears the models menu, and page need refresh to load models again after 429 state