[GH-ISSUE #8550] New API command: gpu_stats or system_stats #83203

Closed
opened 2026-05-09 17:28:03 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @JusefPol on GitHub (Jan 23, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/8550

Hi everyone,

Haven't found this request on the list of issues, so I'll put it, and hopefully people likes it.

I believe it would be great if the Ollama API could communicate how much VRAM of a GPU is being consumed and how much is available, and how much system RAM is being consumed and how much is available. This could leverage interesting usages on third party apps such as Open WebUI to communicate the status of the system while using it online, without the need of going into the Ollama server to check the nvidia-smi or free -h.

It could also communicate the temperature of the GPUs (parameter also available on the nvidia-smi command)

What do you think? Doable?

Thanks everyone.

Originally created by @JusefPol on GitHub (Jan 23, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/8550 Hi everyone, Haven't found this request on the list of issues, so I'll put it, and hopefully people likes it. I believe it would be great if the Ollama API could communicate how much VRAM of a GPU is being consumed and how much is available, and how much system RAM is being consumed and how much is available. This could leverage interesting usages on third party apps such as Open WebUI to communicate the status of the system while using it online, without the need of going into the Ollama server to check the nvidia-smi or free -h. It could also communicate the temperature of the GPUs (parameter also available on the nvidia-smi command) What do you think? Doable? Thanks everyone.
GiteaMirror added the feature request label 2026-05-09 17:28:03 -05:00
Author
Owner

@rick-github commented on GitHub (Jan 23, 2025):

https://github.com/ollama/ollama/issues/3144

<!-- gh-comment-id:2610191512 --> @rick-github commented on GitHub (Jan 23, 2025): https://github.com/ollama/ollama/issues/3144
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#83203