[GH-ISSUE #10776] Check GPU / CPU without actually running model #53590

Closed
opened 2026-04-29 03:57:42 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @sfscgjohnson on GitHub (May 19, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10776

I would like to be able to do something like this:
ollama ps llama3.3:latest
and have it tell me what % GPU / % CPU it would use and potentially with TPS calculation and recommendation on usability.

This is because often I will download models and it will lock up my system because they are too big for it.

Ollama ps llama3.3:latest
NAME ID SIZE PROCESSOR UNTIL
llama3:latest 365c0bd3c000 6.7 GB 100% GPU 4 minutes from now
13 TPS, Recommend this model.

<1 TPS, Do not recommend this model.
2-9 TPS, Model will likely run into bottlenecks.

10 TPS, Recommend this model for most use cases.

Doesn't have to be these words or anything just the concept.

Originally created by @sfscgjohnson on GitHub (May 19, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10776 I would like to be able to do something like this: ollama ps llama3.3:latest and have it tell me what % GPU / % CPU it would use and potentially with TPS calculation and recommendation on usability. This is because often I will download models and it will lock up my system because they are too big for it. Ollama ps llama3.3:latest NAME ID SIZE PROCESSOR UNTIL llama3:latest 365c0bd3c000 6.7 GB 100% GPU 4 minutes from now 13 TPS, Recommend this model. <1 TPS, Do not recommend this model. 2-9 TPS, Model will likely run into bottlenecks. >10 TPS, Recommend this model for most use cases. Doesn't have to be these words or anything just the concept.
GiteaMirror added the feature request label 2026-04-29 03:57:42 -05:00
Author
Owner

@rick-github commented on GitHub (May 19, 2025):

#9774

<!-- gh-comment-id:2892398931 --> @rick-github commented on GitHub (May 19, 2025): #9774
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#53590