Originally created by @thereand on GitHub (Aug 19, 2024).
When I use a large model such as 70B for inference, I need to wait for a long time in the web page. Could you please add a progress reminder of the model loading?
thanks!
Originally created by @thereand on GitHub (Aug 19, 2024).
When I use a large model such as 70B for inference, I need to wait for a long time in the web page. Could you please add a progress reminder of the model loading?
thanks!
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @thereand on GitHub (Aug 19, 2024).
When I use a large model such as 70B for inference, I need to wait for a long time in the web page. Could you please add a progress reminder of the model loading?
thanks!