mirror of
https://github.com/open-webui/open-webui.git
synced 2026-06-03 23:38:13 -05:00
[GH-ISSUE #206] feat: For title generation allow to specify a separate model. #27503
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#27503
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @malteneuss on GitHub (Dec 11, 2023).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/206
Is your feature request related to a problem? Please describe.
The chat title seems to be generated withe the same model that was used in the a chat, which can be unnecessarily slow when chatting with large models like llama2:70B, which takes a lot of resources and time just to summarize a chat.
Describe the solution you'd like
Allow to select a separate (e.g. smaller <7B) model to do the summarization for the title (could be set globally) to speed up the title generation. Maybe even autoload/predefine a small model like neural-chat, llama:7B or similar.
@tjbck commented on GitHub (Jan 3, 2024):
Just added with the latest release, please try it out and let me know if you encounter any issues, Thanks!
@Shadowfita commented on GitHub (Mar 5, 2024):
Specifying the title auto-generation model seems to default to the current chats model, and ignores (nor saves) my specified model.
@newptcai commented on GitHub (Mar 21, 2025):
Where is this? I could not find it in settings.
@fivecanal5 commented on GitHub (May 8, 2025):
looks like the setting has been moved to /admin/settings under Interface