Running models locally can be efficient, but it would be even more useful if we could monitor and display real-time GPU/CPU/RAM usage and temperature metrics directly within the UI.
Currently, I work around this limitation by splitting my screen between btop and either nvidia-smi or nvtop.
Fortunately, the latest version of btop now includes GPU resource monitoring, which aligns with our needs. Integrating similar functionality into the UI would be a valuable feature for developers like me.
Originally created by @satabios on GitHub (Nov 21, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/7134
Running models locally can be efficient, but it would be even more useful if we could monitor and display real-time GPU/CPU/RAM usage and temperature metrics directly within the UI.
Currently, I work around this limitation by splitting my screen between btop and either nvidia-smi or nvtop.
Fortunately, the latest version of btop now includes GPU resource monitoring, which aligns with our needs. Integrating similar functionality into the UI would be a valuable feature for developers like me.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @satabios on GitHub (Nov 21, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/7134
Running models locally can be efficient, but it would be even more useful if we could monitor and display real-time GPU/CPU/RAM usage and temperature metrics directly within the UI.
Currently, I work around this limitation by splitting my screen between btop and either nvidia-smi or nvtop.
Fortunately, the latest version of btop now includes GPU resource monitoring, which aligns with our needs. Integrating similar functionality into the UI would be a valuable feature for developers like me.