feat: Additional Merged Response with custom prompt #6888

Closed
opened 2025-11-11 17:08:44 -06:00 by GiteaMirror · 0 comments
Owner

Originally created by @lingster on GitHub (Nov 11, 2025).

Check Existing Issues

  • I have searched for all existing open AND closed issues and discussions for similar requests. I have found none that is comparable to my request.

Verify Feature Scope

  • I have read through and understood the scope definition for feature requests in the Issues section. I believe my feature request meets the definition and belongs in the Issues section instead of the Discussions.

Problem Description

Currently I can run the same prompt on multiple LLMs, then there is a button to merge the reponses into one.

Could we add to the chat prompt a feature to provide our own prompts against the results of the 2+ responses. For example, it would be great to be able to ask:

Given the responses from LLM A/B/C, please give me the points that they agree/disagree  or are unique to each other"

Desired Solution you'd like

Perhaps we could use something like a jinja/mustatache/svelte template in the prompt like:
{llm.1.name} {llm.1.response} which could be replaced with the model name from response 1 and it's response.

Alternatives Considered

Current solution is to copy / paste the results into a new prompt which is somewhat clunky.

Additional Context

No response

Originally created by @lingster on GitHub (Nov 11, 2025). ### Check Existing Issues - [x] I have searched for all existing **open AND closed** issues and discussions for similar requests. I have found none that is comparable to my request. ### Verify Feature Scope - [x] I have read through and understood the scope definition for feature requests in the Issues section. I believe my feature request meets the definition and belongs in the Issues section instead of the Discussions. ### Problem Description Currently I can run the same prompt on multiple LLMs, then there is a button to merge the reponses into one. Could we add to the chat prompt a feature to provide our own prompts against the results of the 2+ responses. For example, it would be great to be able to ask: ``` Given the responses from LLM A/B/C, please give me the points that they agree/disagree or are unique to each other" ``` ### Desired Solution you'd like Perhaps we could use something like a jinja/mustatache/svelte template in the prompt like: {llm.1.name} {llm.1.response} which could be replaced with the model name from response 1 and it's response. ### Alternatives Considered Current solution is to copy / paste the results into a new prompt which is somewhat clunky. ### Additional Context _No response_
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#6888