feat: Option to use first few words of prompt as title (no AI) #5509

New Issue

GiteaMirror · 2025-11-11T16:23:07-06:00

GiteaMirror commented

2025-11-11 16:23:07 -06:00

Originally created by @VanceVagell on GitHub (Jun 11, 2025).

Check Existing Issues

I have searched the existing issues and discussions.

Problem Description

I run local LLMs and serve them through Open WebUI. Because some of my LLMs are slower CPU inference systems, I turn off title generation because I don't want it to waste time having to generate that, I'd prefer it be quicker to respond to my second query immediately.

Desired Solution you'd like

It would be very helpful to have an option like:

Settings > Interface > Title generation style

with two options (maybe a drop-down?):

Use task model
Use start of prompt

The start of the prompt would be good enough if many cases to jog my memory about what a conversation was (far better than the "New Chat" that they all have right now with title generation off), without incurring the non-trivial cost of summarization for slower local models.

Alternatives Considered

For now I just turn off title generation, which isn't optimal because it's hard to then find a specific conversation in the history.

Additional Context

No response

Originally created by @VanceVagell on GitHub (Jun 11, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description I run local LLMs and serve them through Open WebUI. Because some of my LLMs are slower CPU inference systems, I turn off title generation because I don't want it to waste time having to generate that, I'd prefer it be quicker to respond to my second query immediately. ### Desired Solution you'd like It would be very helpful to have an option like: Settings > Interface > Title generation style with two options (maybe a drop-down?): 1) Use task model 2) Use start of prompt The start of the prompt would be good enough if many cases to jog my memory about what a conversation was (far better than the "New Chat" that they all have right now with title generation off), without incurring the non-trivial cost of summarization for slower local models. ### Alternatives Considered For now I just turn off title generation, which isn't optimal because it's hard to then find a specific conversation in the history. ### Additional Context _No response_

GiteaMirror closed this issue

2025-11-11 16:23:07 -06:00

GiteaMirror commented

2025-11-11 16:23:08 -06:00

@sreesdas commented on GitHub (Jun 16, 2025):

While the development team works on implementing the feature, you can meanwhile use this title generation prompt as a workaround. Even a lighter model like Ollama (LLaMA 3.2:1B) running on a CPU can achieve this relatively quickly.

Task:

Extract the first 4-6 words generated by the assistant

Guidelines:

The title should be the first 4-6 words of the response from assistant as it is
Extract only the first 4-6 words, depending on their length and clarity.
If the response starts with many words like "The", "is", "a", you can extract the first 6 words
End the title with an ellipsis (...)

Output:

JSON format: { "title": "your extracted title here ..." }

Examples:

{ "title": "Stock Market Trends ..." }
{ "title": "Perfect Chocolate Chip Recipe ..." }
{ "title": "Evolution of Music Streaming ..." }

Chat History:

<chat_history>
{{MESSAGES:END:2}}
</chat_history>

@sreesdas commented on GitHub (Jun 16, 2025): While the development team works on implementing the feature, you can meanwhile use this title generation prompt as a workaround. Even a lighter model like Ollama (LLaMA 3.2:1B) running on a CPU can achieve this relatively quickly. ### Task: Extract the first 4-6 words generated by the assistant ### Guidelines: - The title should be the first 4-6 words of the response from assistant as it is - Extract only the first 4-6 words, depending on their length and clarity. - If the response starts with many words like "The", "is", "a", you can extract the first 6 words - End the title with an ellipsis (...) ### Output: JSON format: { "title": "your extracted title here ..." } ### Examples: - { "title": "Stock Market Trends ..." } - { "title": "Perfect Chocolate Chip Recipe ..." } - { "title": "Evolution of Music Streaming ..." } ### Chat History: <chat_history> {{MESSAGES:END:2}} </chat_history>

GiteaMirror commented

2025-11-11 16:23:08 -06:00

@tjbck commented on GitHub (Jun 16, 2025):

Addressed with ea578af45f

@tjbck commented on GitHub (Jun 16, 2025): Addressed with ea578af45f6b350bce79b5af471201a0d96307a9

GiteaMirror referenced this issue

2025-11-11 17:57:57 -06:00

[PR #5509] [MERGED] feat: playback controls #8492

Sign in to join this conversation.