issue: Feedback history no longer shows which model was rated when using arena models #6105

Closed
opened 2025-11-11 16:45:02 -06:00 by GiteaMirror · 1 comment
Owner

Originally created by @matthewdavidcourtney on GitHub (Aug 15, 2025).

Check Existing Issues

  • I have searched the existing issues and discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

v0.6.22

Ollama Version (if applicable)

No response

Operating System

Synology DSM 7.2.1-69057 Update 8

Browser (if applicable)

No response

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided every relevant configuration, setting, and environment variable used in my setup.
  • I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
  • I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
  • Start with the initial platform/version/OS and dependencies used,
  • Specify exact install/launch/configure commands,
  • List URLs visited, user input (incl. example values/emails/passwords if needed),
  • Describe all options and toggles enabled or changed,
  • Include any files or environmental changes,
  • Identify the expected and actual result at each stage,
  • Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

Up until the lates update, when using the Arena model and providing feedback, when you view that feedback in Admin Settings > Evaluations > Feedbacks, this would show what model was being used, and what model the feedback was for.

Actual Behavior

All feedback left on arena models have the model listed as 'arena-model', not the true model being used. There's no way to see what model the feedback was left for.

Steps to Reproduce

  1. Installed via docker with ghcr.io/open-webui/open-webui:main
  2. Create a chat with two arena models.
  3. Send a message
  4. Leave feedback on one of the messages
  5. Open Admin Settings > Evaluations > Feedbacks
  6. All it shows is that the feedback is left for 'arena-model', not the true underlying model

Logs & Screenshots

Image

Additional Information

I did a quick look through the webui.db. Looks like in the chat table on the arena model messages, there used to be a selectedModelId field that would contain the true model. Since the latest update my logs no longer contain this. I assume this has something to do with it.

Originally created by @matthewdavidcourtney on GitHub (Aug 15, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version v0.6.22 ### Ollama Version (if applicable) _No response_ ### Operating System Synology DSM 7.2.1-69057 Update 8 ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [ ] I have included the browser console logs. - [ ] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior Up until the lates update, when using the Arena model and providing feedback, when you view that feedback in Admin Settings > Evaluations > Feedbacks, this would show what model was being used, and what model the feedback was for. ### Actual Behavior All feedback left on arena models have the model listed as 'arena-model', not the true model being used. There's no way to see what model the feedback was left for. ### Steps to Reproduce 1. Installed via docker with ghcr.io/open-webui/open-webui:main 2. Create a chat with two arena models. 3. Send a message 4. Leave feedback on one of the messages 5. Open Admin Settings > Evaluations > Feedbacks 6. All it shows is that the feedback is left for 'arena-model', not the true underlying model ### Logs & Screenshots <img width="1197" height="636" alt="Image" src="https://github.com/user-attachments/assets/5e68d45a-dba8-4799-bc74-954b06918be7" /> ### Additional Information I did a quick look through the webui.db. Looks like in the chat table on the arena model messages, there used to be a `selectedModelId` field that would contain the true model. Since the latest update my logs no longer contain this. I assume this has something to do with it.
GiteaMirror added the bug label 2025-11-11 16:45:02 -06:00
Author
Owner

@tjbck commented on GitHub (Aug 17, 2025):

Addressed with d7363fd65f in dev!

@tjbck commented on GitHub (Aug 17, 2025): Addressed with d7363fd65ff293f4d5ac7855c32c26974105e732 in dev!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#6105