github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-05-23 18:25:10 -05:00
Code Issues 2.4k Packages Projects Releases 129 Wiki Activity

[GH-ISSUE #16950] issue: Arena model does not appear to use sub-model settings #18108

New Issue
Closed
opened 2026-04-20 00:07:20 -05:00 by GiteaMirror · 5 comments
GiteaMirror commented 2026-04-20 00:07:20 -05:00
Owner
Copy Link

Originally created by @shortydutchie on GitHub (Aug 27, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/16950

Check Existing Issues

  • I have searched the existing issues and discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

v0.6.25(latest)

Ollama Version (if applicable)

0.11.7

Operating System

Ubuntu linux 24.04

Browser (if applicable)

138.0.7204.185 (Official Build) (64-bit) (cohort: Control)

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided every relevant configuration, setting, and environment variable used in my setup.
  • I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
  • I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
  • Start with the initial platform/version/OS and dependencies used,
  • Specify exact install/launch/configure commands,
  • List URLs visited, user input (incl. example values/emails/passwords if needed),
  • Describe all options and toggles enabled or changed,
  • Include any files or environmental changes,
  • Identify the expected and actual result at each stage,
  • Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

Hi have created 4 models that use same RAG knowledge base and want to compare them.
I have un-ticked web access and code interpretation in the setup.
The models work as expected and search the local RAG db

I expect the Arena model to use the sub-model settings - do not access web, no code interpretation.

Actual Behavior

The Arena model gives different answers than each of the sub-models, and accesses the web for these. It also shows the "code interpreter", despite this being turned off in the separate models.

It looks like the Arena does not honour the specified model settings of no web, no code interpretation, use RAG knowledgebase. The Arena model does not appear to use the specified RAG db at all.

Steps to Reproduce

Set up 2 or more models with RAG (I have 4)
Untick web access, code interpretation for each model. Add the same knowledge base to each.
Create Arena model of these models.

  • In the Arena model chat eg. the 'code interpreter' is visible despite unticking these for the constituent models.
  • Answers seem to access the external web, and not the local RAG db.

Logs & Screenshots

The behaviour is eg. visible in displaying the code interpreter for the arena model, despite this being turned off in all of the separate sub-models.

Image

Additional Information

Any input appreciated.
I have not used OpenWebUI before - it may well have worked previously but I do not know!

Originally created by @shortydutchie on GitHub (Aug 27, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/16950 ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version v0.6.25(latest) ### Ollama Version (if applicable) 0.11.7 ### Operating System Ubuntu linux 24.04 ### Browser (if applicable) 138.0.7204.185 (Official Build) (64-bit) (cohort: Control) ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior Hi have created 4 models that use same RAG knowledge base and want to compare them. I have un-ticked web access and code interpretation in the setup. The models work as expected and search the local RAG db I expect the Arena model to use the sub-model settings - do not access web, no code interpretation. ### Actual Behavior The Arena model gives different answers than each of the sub-models, and accesses the web for these. It also shows the "code interpreter", despite this being turned off in the separate models. It looks like the Arena does not honour the specified model settings of no web, no code interpretation, use RAG knowledgebase. The Arena model does not appear to use the specified RAG db at all. ### Steps to Reproduce Set up 2 or more models with RAG (I have 4) Untick web access, code interpretation for each model. Add the same knowledge base to each. Create Arena model of these models. - In the Arena model chat eg. the 'code interpreter' is visible despite unticking these for the constituent models. - Answers seem to access the external web, and not the local RAG db. ### Logs & Screenshots The behaviour is eg. visible in displaying the code interpreter for the arena model, despite this being turned off in all of the separate sub-models. <img width="258" height="86" alt="Image" src="https://github.com/user-attachments/assets/bbc6c7b1-94ea-4eb2-ab92-09342d1e9b45" /> ### Additional Information Any input appreciated. I have not used OpenWebUI before - it may well have worked previously but I do not know!
GiteaMirror added the bug label 2026-04-20 00:07:20 -05:00
GiteaMirror commented 2026-04-20 00:07:23 -05:00
Author
Owner
Copy Link

@Th3R3alDuk3 commented on GitHub (Nov 4, 2025):

I’ve noticed the same issue.
Arena Models don’t seem to respect the model settings regarding knowledge bases (RAG) and provide different answers.

<!-- gh-comment-id:3487789574 --> @Th3R3alDuk3 commented on GitHub (Nov 4, 2025): I’ve noticed the same issue. Arena Models don’t seem to respect the model settings regarding knowledge bases (RAG) and provide different answers.
GiteaMirror commented 2026-04-20 00:07:24 -05:00
Author
Owner
Copy Link

@silentoplayz commented on GitHub (Nov 5, 2025):

Related - https://github.com/open-webui/open-webui/issues/14326

<!-- gh-comment-id:3493626424 --> @silentoplayz commented on GitHub (Nov 5, 2025): Related - https://github.com/open-webui/open-webui/issues/14326
GiteaMirror commented 2026-04-20 00:07:25 -05:00
Author
Owner
Copy Link

@silentoplayz commented on GitHub (Nov 9, 2025):

Semi-related PR that's currently drafted - https://github.com/open-webui/open-webui/pull/19053 (I've not tested this yet)

<!-- gh-comment-id:3508559834 --> @silentoplayz commented on GitHub (Nov 9, 2025): Semi-related PR that's currently drafted - https://github.com/open-webui/open-webui/pull/19053 (I've not tested this yet)
GiteaMirror commented 2026-04-20 00:07:28 -05:00
Author
Owner
Copy Link

@kjpoccia commented on GitHub (Nov 11, 2025):

@silentoplayz I got the feedback on #19053 that inheritance from base models happens already on the backend. I'm not seeing any evidence of this (and it's certainly not working in practice) but just FYI, I must be missing something

<!-- gh-comment-id:3517519656 --> @kjpoccia commented on GitHub (Nov 11, 2025): @silentoplayz I got the feedback on #19053 that inheritance from base models happens already on the backend. I'm not seeing any evidence of this (and it's certainly not working in practice) but just FYI, I must be missing something
GiteaMirror commented 2026-04-20 00:07:30 -05:00
Author
Owner
Copy Link

@tjbck commented on GitHub (Mar 25, 2026):

Addressed in dev.

<!-- gh-comment-id:4124471967 --> @tjbck commented on GitHub (Mar 25, 2026): Addressed in dev.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#18108
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?