mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 06:03:26 -05:00
[GH-ISSUE #13055] feat: Customizable API Model for Title Generation #71402
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#71402
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Amamiya23 on GitHub (Apr 19, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/13055
Check Existing Issues
Problem Description
I would like to propose the ability to use a customizable API model specifically for generating titles. The idea is to allow users to set up a lightweight model (e.g., a 3B parameter model) dedicated solely to generating conversation titles.
Currently, it seems that the title generation process relies on the same model being used for the main conversation or reasoning tasks. This can lead to inefficiencies, especially when using more complex models that involve chain-of-thought reasoning. For example, as shown in the red box in the attached image, generating a title with such models takes significantly longer than necessary.
Desired Solution you'd like
Customizable Model Selection: Allow users to specify a smaller, lightweight model for title generation tasks. This would reduce the computational overhead and speed up the process.
API Integration: Provide an API endpoint where users can define which model they want to use for title generation, separate from the main conversational or reasoning model.
Alternatives Considered
No response
Additional Context
No response
@tjbck commented on GitHub (Apr 19, 2025):
Task model exists.