[GH-ISSUE #1950] feat: Show raw context length in the generation info popup #12694

Closed
opened 2026-04-19 19:36:09 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @notasquid1938 on GitHub (May 3, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/1950

SInce the ollama api returns the raw tokens of the context, counting these to display a raw context length in the generation info could be useful for those wanting to test large context models/see exactly how many tokens the model used.

Edit: Misunderstood Ollama api

Originally created by @notasquid1938 on GitHub (May 3, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/1950 SInce the ollama api returns the raw tokens of the context, counting these to display a raw context length in the generation info could be useful for those wanting to test large context models/see exactly how many tokens the model used. Edit: Misunderstood Ollama api
Author
Owner

@tjbck commented on GitHub (May 4, 2024):

image

We already have something that seems to fit your description, if it's not feel free to elaborate more and let us know.

<!-- gh-comment-id:2094372696 --> @tjbck commented on GitHub (May 4, 2024): <img width="385" alt="image" src="https://github.com/open-webui/open-webui/assets/25473318/1cf8c343-9345-4e29-a0b6-a7f99a9ca6d2"> We already have something that seems to fit your description, if it's not feel free to elaborate more and let us know.
Author
Owner

@notasquid1938 commented on GitHub (May 4, 2024):

Are you referring to prompt_eval_count? I tried searching the repo but couldn't find any reference to what it means.

<!-- gh-comment-id:2094373497 --> @notasquid1938 commented on GitHub (May 4, 2024): Are you referring to prompt_eval_count? I tried searching the repo but couldn't find any reference to what it means.
Author
Owner

@tjbck commented on GitHub (May 4, 2024):

Ollama doc: https://github.com/ollama/ollama/blob/main/docs/api.md

<!-- gh-comment-id:2094374063 --> @tjbck commented on GitHub (May 4, 2024): Ollama doc: https://github.com/ollama/ollama/blob/main/docs/api.md
Author
Owner

@notasquid1938 commented on GitHub (May 4, 2024):

Thanks for the link

<!-- gh-comment-id:2094396685 --> @notasquid1938 commented on GitHub (May 4, 2024): Thanks for the link
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#12694