github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-11-09 10:50:35 -06:00
Code Issues 2.4k Packages Projects Releases 129 Wiki Activity

[GH-ISSUE #17104] feat: Show inference statistics, such as tokens-per-second speed, for openai compatible inference engines #33695

New Issue
Closed
opened 2026-04-25 07:35:20 -05:00 by GiteaMirror · 1 comment
GiteaMirror commented 2026-04-25 07:35:20 -05:00
Owner
Copy Link
Copy Source

Originally created by @drp4rad0x on GitHub (Sep 1, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/17104

Check Existing Issues

  • I have searched the existing issues and discussions.

Problem Description

I created an issue as a bug, but the maintainer said it is intended functionality, so I think it is not a bug but a feature request. Open WebUI doesn't show inference statistics, such as tokens-per-second speed, for inference engines other than Ollama

Desired Solution you'd like

I want to see all prompt_token/s speed in webui

Alternatives Considered

No response

Additional Context

No response

Originally created by @drp4rad0x on GitHub (Sep 1, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/17104 ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description I created an issue as a bug, but the maintainer said it is intended functionality, so I think it is not a bug but a feature request. Open WebUI doesn't show inference statistics, such as tokens-per-second speed, for inference engines other than Ollama ### Desired Solution you'd like I want to see all prompt_token/s speed in webui ### Alternatives Considered _No response_ ### Additional Context _No response_
GiteaMirror commented 2026-04-25 07:35:20 -05:00
Author
Owner
Copy Link
Copy Source

@tjbck commented on GitHub (Sep 1, 2025):

The model inference engines themselves need to forward the stats, we already support usage field in the response.

<!-- gh-comment-id:3241218733 --> @tjbck commented on GitHub (Sep 1, 2025): The model inference engines themselves need to forward the stats, we already support usage field in the response.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
GiteaMirror ninjasurge (Kaehlen Rog)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#33695