The model running locally in a PC, can be suspended when not in use (over night for example),
then it should be woken up when a chat comes in.
Ive got a script which works for this, but the UI is not aware.
Would be nice if there is in the UI "status" green meaning on black meaning sleep icon.
Manual control if clicking the power-icon to send the wake-on-lan packet or call the script to send-wake-on-lan, and similar to call a script which does the systemctl suspend.
Right now, I have the suspend running on the PC with the GPU and model running, while true ; do echo "waiting..." ; inotifywait -q -t 900 -e modify brain.file ; if [ $? -eq 2 ] ; then systemctl suspend ; else echo "...ok someone is chatting, not going to sleep" ; sleep 180s ; fi ; done
This makes it suspend after 15min of no modifies to brain.file
The model is run with vllm serve Fooobar --enable-reasoning --etc | tee -a brain.file
For wakeup the scripts are in open-webui running on another PC, but it would be nice to have all this integrated in the UI so it can show the status of the model-PC by the results of a ping for example.
Originally created by @iskradelta on GitHub (Feb 26, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/10802
# Feature Request
The model running locally in a PC, can be suspended when not in use (over night for example),
then it should be woken up when a chat comes in.
Ive got a script which works for this, but the UI is not aware.
Would be nice if there is in the UI "status" green meaning on black meaning sleep icon.
Manual control if clicking the power-icon to send the wake-on-lan packet or call the script to send-wake-on-lan, and similar to call a script which does the systemctl suspend.
Right now, I have the suspend running on the PC with the GPU and model running,
```while true ; do echo "waiting..." ; inotifywait -q -t 900 -e modify brain.file ; if [ $? -eq 2 ] ; then systemctl suspend ; else echo "...ok someone is chatting, not going to sleep" ; sleep 180s ; fi ; done```
This makes it suspend after 15min of no modifies to brain.file
The model is run with ```vllm serve Fooobar --enable-reasoning --etc | tee -a brain.file```
For wakeup the scripts are in open-webui running on another PC, but it would be nice to have all this integrated in the UI so it can show the status of the model-PC by the results of a ping for example.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @iskradelta on GitHub (Feb 26, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/10802
Feature Request
The model running locally in a PC, can be suspended when not in use (over night for example),
then it should be woken up when a chat comes in.
Ive got a script which works for this, but the UI is not aware.
Would be nice if there is in the UI "status" green meaning on black meaning sleep icon.
Manual control if clicking the power-icon to send the wake-on-lan packet or call the script to send-wake-on-lan, and similar to call a script which does the systemctl suspend.
Right now, I have the suspend running on the PC with the GPU and model running,
while true ; do echo "waiting..." ; inotifywait -q -t 900 -e modify brain.file ; if [ $? -eq 2 ] ; then systemctl suspend ; else echo "...ok someone is chatting, not going to sleep" ; sleep 180s ; fi ; doneThis makes it suspend after 15min of no modifies to brain.file
The model is run with
vllm serve Fooobar --enable-reasoning --etc | tee -a brain.fileFor wakeup the scripts are in open-webui running on another PC, but it would be nice to have all this integrated in the UI so it can show the status of the model-PC by the results of a ping for example.