[GH-ISSUE #14117] feat: Include server address in model response metadata for load balanced models #120460

Closed
opened 2026-05-20 22:04:49 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @darebfh on GitHub (May 21, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/14117

Check Existing Issues

  • I have searched the existing issues and discussions.

Problem Description

I have two ollama instances, each serving the same model. For evaluation purposes, I need to know which server a request was rooted to. Setting a prefix ID does not work, as this causes two models showing up in the model list instead of one model, which is load balanced “behind the scenes”.

Desired Solution you'd like

Please include the full server address in the model response metadata.

Alternatives Considered

No response

Additional Context

No response

Originally created by @darebfh on GitHub (May 21, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/14117 ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description I have two ollama instances, each serving the same model. For evaluation purposes, I need to know which server a request was rooted to. Setting a prefix ID does not work, as this causes two models showing up in the model list instead of one model, which is load balanced “behind the scenes”. ### Desired Solution you'd like Please include the full server address in the model response metadata. ### Alternatives Considered _No response_ ### Additional Context _No response_
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#120460