mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-15 21:19:39 -05:00
Aggregate responses from multiple LLMs #1958
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @odefta on GitHub (Sep 1, 2024).
Current Situation
In a chat session, we can select multiple LLMs to respond to a prompt. Each LLM provides its own response, so we end up with multiple separate answers.
Proposal
It would be great to have the option to use another LLM model to automatically aggregate these responses into a single, unified answer. This would be particularly useful for tackling complex logical problems, even though it may result in higher token usage.
Background
I’ve tested the "Mixture of Agents" function, but it seems to only work with local models, limiting its flexibility.
@cheahjs commented on GitHub (Sep 1, 2024):
Already a feature introduced in v0.3.14.
@odefta commented on GitHub (Sep 1, 2024):
Thanks, awesome! I had an earlier version 0.3.12. Do you know which model will be used to display the (aggregated) final answer?
@odefta commented on GitHub (Sep 1, 2024):
Can we choose which model is used for aggregation and / or which prompt is used for instructions?