[GH-ISSUE #23402] Enhancement: Update "Cache Base Model List" description to warn about increased API requests #58638

New Issue

GiteaMirror · 2026-05-05T23:36:41-05:00

GiteaMirror commented

2026-05-05 23:36:41 -05:00

Originally created by @copperblu on GitHub (Apr 4, 2026).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/23402

Is your feature request related to a problem? Please describe.
More an enhancement...

When the "Cache Base Model List" setting is toggled off, Open WebUI seems to frequently poll connected API endpoints (like /v1/models) to fetch available models on page loads/refreshes. For users connecting to external APIs (ex. Perplexit/LiteLLM proxy), this results in a spike in API requests. This can inadvertently trigger rate limits or cause unexpected spikes in API usage dashboards, and the current UI description doesn't make this consequence clear.

Describe the solution you'd like
Update the subtext/description of the "Cache Base Model List" toggle to include a brief warning. Maybe only when it's disabled to lessen UI clutter?

Something along the lines of:
"Warning: Disabling this will query connected APIs for available models on every load, potentially increasing external API requests."

Describe alternatives you've considered
N/A

Additional context
This is especially problematic when users temporarily disable the cache to debug missing models, forget to turn it back on, and later discover thousands of unnecessary /v1/models requests hitting their upstream providers.

Originally created by @copperblu on GitHub (Apr 4, 2026). Original GitHub issue: https://github.com/open-webui/open-webui/issues/23402 **Is your feature request related to a problem? Please describe.** More an enhancement... When the "Cache Base Model List" setting is toggled off, Open WebUI seems to frequently poll connected API endpoints (like `/v1/models`) to fetch available models on page loads/refreshes. For users connecting to external APIs (ex. Perplexit/LiteLLM proxy), this results in a spike in API requests. This can inadvertently trigger rate limits or cause unexpected spikes in API usage dashboards, and the current UI description doesn't make this consequence clear. **Describe the solution you'd like** Update the subtext/description of the "Cache Base Model List" toggle to include a brief warning. Maybe only when it's disabled to lessen UI clutter? Something along the lines of: *"Warning: Disabling this will query connected APIs for available models on every load, potentially increasing external API requests."* **Describe alternatives you've considered** N/A **Additional context** This is especially problematic when users temporarily disable the cache to debug missing models, forget to turn it back on, and later discover thousands of unnecessary `/v1/models` requests hitting their upstream providers.

GiteaMirror closed this issue

2026-05-05 23:36:44 -05:00

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#58638