mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-07 03:18:23 -05:00
[GH-ISSUE #1950] feat: Show raw context length in the generation info popup #12694
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @notasquid1938 on GitHub (May 3, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/1950
SInce the ollama api returns the raw tokens of the context, counting these to display a raw context length in the generation info could be useful for those wanting to test large context models/see exactly how many tokens the model used.
Edit: Misunderstood Ollama api
@tjbck commented on GitHub (May 4, 2024):
We already have something that seems to fit your description, if it's not feel free to elaborate more and let us know.
@notasquid1938 commented on GitHub (May 4, 2024):
Are you referring to prompt_eval_count? I tried searching the repo but couldn't find any reference to what it means.
@tjbck commented on GitHub (May 4, 2024):
Ollama doc: https://github.com/ollama/ollama/blob/main/docs/api.md
@notasquid1938 commented on GitHub (May 4, 2024):
Thanks for the link