[GH-ISSUE #3987] Increase the number of CPU usage for ollama_llama_se in linux #64504

Closed
opened 2026-05-03 17:55:12 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @wwjCMP on GitHub (Apr 28, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3987

Can the number of CPU cores used by the command 'ollama_llama_se' be increased through settings in Linux? As shown in the figure, the CPU is running at full load, but the 'ollama_llama_se' command can only use about thirty cores in competition with other continuously running commands. Which of these continuously running commands are submitted through Slurm?
Therefore, the ollama_llama_se runs very slowly.

When the CPU is idle, ollama_llama_se can probably utilize about 48 cores. At this time, ollama_llama_se is running very fast.

This machine only has CPU. There are a total of 96 cores.

Originally created by @wwjCMP on GitHub (Apr 28, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3987 Can the number of CPU cores used by the command 'ollama_llama_se' be increased through settings in Linux? As shown in the figure, the CPU is running at full load, but the 'ollama_llama_se' command can only use about thirty cores in competition with other continuously running commands. Which of these continuously running commands are submitted through Slurm? Therefore, the ollama_llama_se runs very slowly. When the CPU is idle, ollama_llama_se can probably utilize about 48 cores. At this time, ollama_llama_se is running very fast. This machine only has CPU. There are a total of 96 cores.
GiteaMirror added the feature request label 2026-05-03 17:55:12 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#64504