mirror of
https://github.com/open-webui/open-webui.git
synced 2026-11-14 05:02:01 -06:00
[GH-ISSUE #14117] feat: Include server address in model response metadata for load balanced models #87889
Reference in New Issue
Block a user
Originally created by @darebfh on GitHub (May 21, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/14117
Check Existing Issues
Problem Description
I have two ollama instances, each serving the same model. For evaluation purposes, I need to know which server a request was rooted to. Setting a prefix ID does not work, as this causes two models showing up in the model list instead of one model, which is load balanced “behind the scenes”.
Desired Solution you'd like
Please include the full server address in the model response metadata.
Alternatives Considered
No response
Additional Context
No response