Originally created by @Mugane on GitHub (Dec 17, 2024).
Feature Request
Although the model size (parameters) is shown in the chat UI drop-down, the physical size is not (unlike in the settings page where you can view the parameters and RAM requirements). The RAM is arguably more important in making a speed determination, and since it's quite tedious to stop a slow model after it has been selected/run, it is probably very much worth including this data in the drop-down view. Pic below of what it looks like currently, with redundant parameter information and missing RAM requirements.
It would be really helpful to use the same kind of display as the model select on the admin page that shows the RAM:
Originally created by @Mugane on GitHub (Dec 17, 2024).
# Feature Request
Although the model size (parameters) is shown in the chat UI drop-down, the physical size is not (unlike in the settings page where you can view the parameters and RAM requirements). The RAM is arguably more important in making a speed determination, and since it's quite tedious to stop a slow model after it has been selected/run, it is probably very much worth including this data in the drop-down view. Pic below of what it looks like currently, with redundant parameter information and missing RAM requirements.

It would be really helpful to use the same kind of display as the model select on the admin page that shows the RAM:

Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @Mugane on GitHub (Dec 17, 2024).
Feature Request
Although the model size (parameters) is shown in the chat UI drop-down, the physical size is not (unlike in the settings page where you can view the parameters and RAM requirements). The RAM is arguably more important in making a speed determination, and since it's quite tedious to stop a slow model after it has been selected/run, it is probably very much worth including this data in the drop-down view. Pic below of what it looks like currently, with redundant parameter information and missing RAM requirements.
It would be really helpful to use the same kind of display as the model select on the admin page that shows the RAM: