mirror of
https://github.com/open-webui/open-webui.git
synced 2026-06-03 23:38:13 -05:00
feat: prompt token/s #259
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @robertvazan on GitHub (Feb 3, 2024).
Is your feature request related to a problem? Please describe.
Perf info under chat response shows response speed in tokens/sec, but prompt processing speed is only shown as token count and total time.
Describe the solution you'd like
Show tokens/sec for prompt processing too.
@tjbck commented on GitHub (Feb 3, 2024):
Feel free to make a PR!
@bolavefasfas commented on GitHub (Feb 9, 2024):
+1 Need token per second in the bottom of the webui like bottom left or right would be helpful.
Love the project.
@tjbck commented on GitHub (Feb 18, 2024):
@dannyl1u here's another good first issue
@dannyl1u commented on GitHub (Feb 18, 2024):
Thanks, I'll work on this