hi,
it would be great if there was the capability to be able to set how many threads/processers are used
for genneration of responces etc.
is this possible?
thank you for considdering my request
Originally created by @mhussaincov94 on GitHub (Feb 11, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/710
hi,
it would be great if there was the capability to be able to set how many threads/processers are used
for genneration of responces etc.
is this possible?
thank you for considdering my request
Hi, thanks for the feature request. I'll close this issue as Ollama does no offer such API afaik, but I could be wrong. Feel free to leave a comment here and I'll reopen the issue!
<!-- gh-comment-id:1944751510 -->
@tjbck commented on GitHub (Feb 14, 2024):
Hi, thanks for the feature request. I'll close this issue as Ollama does no offer such API afaik, but I could be wrong. Feel free to leave a comment here and I'll reopen the issue!
<!-- gh-comment-id:1987517341 -->
@chamburr commented on GitHub (Mar 11, 2024):
They do offer this feature with `num_thread`, which can be passed along with other parameters like temperature.
https://github.com/ollama/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @mhussaincov94 on GitHub (Feb 11, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/710
hi,
it would be great if there was the capability to be able to set how many threads/processers are used
for genneration of responces etc.
is this possible?
thank you for considdering my request
@tjbck commented on GitHub (Feb 14, 2024):
Hi, thanks for the feature request. I'll close this issue as Ollama does no offer such API afaik, but I could be wrong. Feel free to leave a comment here and I'll reopen the issue!
@chamburr commented on GitHub (Mar 11, 2024):
They do offer this feature with
num_thread, which can be passed along with other parameters like temperature.https://github.com/ollama/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values