[GH-ISSUE #6029] Prompt evaluation progress indicator #50285

Open
opened 2026-04-28 14:57:23 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @drazdra on GitHub (Jul 28, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6029

Prompt evaluation can take huge time, especially with long context. it can literary be hours.

Right now Ollama just hangs in that phase. Is it possible to have some messages updating on the progress? It's tough when after an hour of 100% load you still don't know if it's at 15% or at 99%..

Originally created by @drazdra on GitHub (Jul 28, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6029 Prompt evaluation can take huge time, especially with long context. it can literary be hours. Right now Ollama just hangs in that phase. Is it possible to have some messages updating on the progress? It's tough when after an hour of 100% load you still don't know if it's at 15% or at 99%..
GiteaMirror added the feature request label 2026-04-28 14:57:23 -05:00
Author
Owner

@MariasStory commented on GitHub (Aug 14, 2024):

Please, do implement this feature.
The feedback could be added to streaming api. Maybe, an optional parameter with a time distance between the processing updates, like an evalutation_update=1 corresponding an update every second.

<!-- gh-comment-id:2287879792 --> @MariasStory commented on GitHub (Aug 14, 2024): Please, do implement this feature. The feedback could be added to streaming api. Maybe, an optional parameter with a time distance between the processing updates, like an evalutation_update=1 corresponding an update every second.
Author
Owner

@trevorboydsmith commented on GitHub (Feb 28, 2025):

a simple idea would be server side log messages that are similar to the load model messages where it says 1%, 1.5%, ... 100% .

<!-- gh-comment-id:2690890830 --> @trevorboydsmith commented on GitHub (Feb 28, 2025): a simple idea would be server side log messages that are similar to the load model messages where it says 1%, 1.5%, ... 100% .
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#50285