feat: persist tool calling & outputs in conversation memory #6174

Open
opened 2025-11-11 16:46:58 -06:00 by GiteaMirror · 6 comments
Owner

Originally created by @ralungei on GitHub (Aug 22, 2025).

Check Existing Issues

  • I have searched the existing issues and discussions.

Problem Description

Open WebUI conversation memory only stores the LLM responses, but not the outputs from tools (e.g., web search results, API calls, calculator results). This causes the assistant to "forget" tool outputs, breaking the conversation flow and forcing redundant tool calls.

Desired Solution you'd like

Persist tool outputs in memory together with the LLM messages. When resuming or continuing a conversation, the assistant should have access to both the model text and tool responses, ensuring coherent and consistent interactions.

Alternatives Considered

No response

Additional Context

No response

Originally created by @ralungei on GitHub (Aug 22, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description Open WebUI conversation memory only stores the LLM responses, but not the outputs from tools (e.g., web search results, API calls, calculator results). This causes the assistant to "forget" tool outputs, breaking the conversation flow and forcing redundant tool calls. ### Desired Solution you'd like Persist tool outputs in memory together with the LLM messages. When resuming or continuing a conversation, the assistant should have access to both the model text and tool responses, ensuring coherent and consistent interactions. ### Alternatives Considered _No response_ ### Additional Context _No response_
Author
Owner

@RodolfoCastanheira commented on GitHub (Aug 22, 2025):

This also breaks caching of most providers.

@RodolfoCastanheira commented on GitHub (Aug 22, 2025): This also breaks caching of most providers.
Author
Owner

@jsweetzer-ea commented on GitHub (Aug 22, 2025):

For OpenAI models, the right solution is to support the Responses API.

@jsweetzer-ea commented on GitHub (Aug 22, 2025): For OpenAI models, the right solution is to support the Responses API.
Author
Owner

@ralungei commented on GitHub (Aug 25, 2025):

For me breaks so many use cases or makes me ask the LLM to print internal ids

@ralungei commented on GitHub (Aug 25, 2025): For me breaks so many use cases or makes me ask the LLM to print internal ids
Author
Owner

@johnnyasantoss commented on GitHub (Sep 25, 2025):

This still relevant and affects writing tools on open web ui as well.

@johnnyasantoss commented on GitHub (Sep 25, 2025): This still relevant and affects writing tools on open web ui as well.
Author
Owner

@brandco commented on GitHub (Sep 25, 2025):

Could you use event_emitter to put tool call responses (or whatever you want) into the message content during the tool execution?
https://docs.openwebui.com/features/plugin/events/

@brandco commented on GitHub (Sep 25, 2025): Could you use **__event_emitter__** to put tool call responses (or whatever you want) into the message content during the tool execution? https://docs.openwebui.com/features/plugin/events/
Author
Owner

@rgaricano commented on GitHub (Sep 25, 2025):

With Default Function Calling mode yes, with Native Function Calling mode no (no directly, but model can be prompted for add the results of the tool to message)

@rgaricano commented on GitHub (Sep 25, 2025): With Default Function Calling mode yes, with Native Function Calling mode no (no directly, but model can be prompted for add the results of the tool to message)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#6174