mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 10:58:17 -05:00
[GH-ISSUE #6972] 'Fluidly stream large external response chunks' breaks Arena model functionality #53219
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#53219
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @kernelpanic19 on GitHub (Nov 15, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/6972
Bug Report
Installation Method
Docker Compose
Environment
Confirmation:
Expected Behavior:
Arena model should reveal the underlying model when rated on the chat screen and should appear on the evaluations page as the underlying model and be recorded in the leaderboard.
Actual Behavior:
Arena model does not reveal the underlying model when rated and does not appear on the evaluation page as the underlying unmasked model and is not recorded in the leaderboard rankings.
Description
Bug Summary:
When the arena model is not unmasked nor contributes to the leaderboard, it removes the utility of the feature.
Reproduction Details
Steps to Reproduce:
Enable 'Fluidly stream large external response chunks' under settings > interface
In a new chat, select two arena models to generate a sibling response.
Submit the prompt.
Give a thumbs up/down to one of the responses.
Note there the masked model is not revealed.
Go to the evaluation page and note the feedback lists the arena model name, not the unmasked model name.
Also on the evaluation page, note that the feedback is not reflected on the leaderboard.
Additional Information
It appears that 'Fluidly stream large external response chunks' under settings > interface being enabled is the root cause of this behavior. Returning this setting to its default setting of disabled resolves the issue.