github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-05-07 11:28:35 -05:00
Code Issues 1.3k Packages Projects Releases 126 Wiki Activity

feat: Set a different system model #3648

New Issue
Closed
opened 2025-11-11 15:36:09 -06:00 by GiteaMirror · 2 comments
GiteaMirror commented 2025-11-11 15:36:09 -06:00
Owner
Copy Link

Originally created by @brodieferguson on GitHub (Feb 6, 2025).

Is your feature request related to a problem? Please describe.
When I use a paid API, every message I send can cost multiples the message cost due to the Title Generation, Tags, etc. 1 message = 4 requests. This is extra bad using openrouter with :online as even with a free model it will use 4x the search token cost.

Describe the solution you'd like
The ability to set a system wide model to handle the titles, tagging etc as those features are nice but don't require using thinking models or paying for search queries over API. Currently using :online on openrouter is way more reliable and faster for me than using local exa search. This could also be useful with local models as potentially running the extra requests to a CPU 1.5b model would be faster than making the requests to a gigantic model that may not fit fully in VRAM.

Originally created by @brodieferguson on GitHub (Feb 6, 2025). **Is your feature request related to a problem? Please describe.** When I use a paid API, every message I send can cost multiples the message cost due to the Title Generation, Tags, etc. 1 message = 4 requests. This is extra bad using openrouter with :online as even with a free model it will use 4x the search token cost. **Describe the solution you'd like** The ability to set a system wide model to handle the titles, tagging etc as those features are nice but don't require using thinking models or paying for search queries over API. Currently using :online on openrouter is way more reliable and faster for me than using local exa search. This could also be useful with local models as potentially running the extra requests to a CPU 1.5b model would be faster than making the requests to a gigantic model that may not fit fully in VRAM.
GiteaMirror commented 2025-11-11 15:36:10 -06:00
Author
Owner
Copy Link

@binxn commented on GitHub (Feb 6, 2025):

I believe what you're asking for is already available at "Settings" -> "Interface". You can set an external and internal model to perform the title generation, image prompt generation, tag generation, etc.

@binxn commented on GitHub (Feb 6, 2025): I believe what you're asking for is already available at "Settings" -> "Interface". You can set an external and internal model to perform the title generation, image prompt generation, tag generation, etc.
GiteaMirror commented 2025-11-11 15:36:10 -06:00
Author
Owner
Copy Link

@brodieferguson commented on GitHub (Feb 6, 2025):

Thank you, don't know how I missed that

@brodieferguson commented on GitHub (Feb 6, 2025): Thank you, don't know how I missed that
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#3648
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?