mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-11 00:13:40 -05:00
[GH-ISSUE #4507] Pass Tool Use Context to Title Generation #13637
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @ekatiyar on GitHub (Aug 9, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/4507
Is your feature request related to a problem? Please describe.
Currently title generation is based only on the user's initial input prompt. While this works for most cases, it isn't as effective when the prompt requires the model to use a tool (e.g. webscraping) in order to obtain a more full context to answer the prompt. An example use case would be summarizing a webpage - in this case the model hallucinates the contents of the webpage when generating a title, often resulting in a totally off-topic title.
Describe the solution you'd like
Provide the context/output of any tool calls resulting from the initial prompt before generating the title. This will result in better, more informed conversation titles.
Describe alternatives you've considered
Another option is to wait till the model has sent an initial reply in the conversation, like what OpenAI does in their ChatGPT interface, but this is largely unnecessary for most conversations without tool use, and just including tool outputs should get us most of the way there in terms of correctness, and would maintain current performance for non-tool conversations.