[GH-ISSUE #6984] It can't use more than 64 threads on Windows #50933

Closed
opened 2026-04-28 17:34:43 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @NektoDron on GitHub (Sep 26, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6984

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

It can't use more than 64 threads on Windows, only one numa node is used.

OS

Windows

GPU

Other

CPU

AMD

Ollama version

0.1.32

Originally created by @NektoDron on GitHub (Sep 26, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6984 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? It can't use more than 64 threads on Windows, only one numa node is used. ### OS Windows ### GPU Other ### CPU AMD ### Ollama version 0.1.32
GiteaMirror added the bugwindows labels 2026-04-28 17:34:45 -05:00
Author
Owner

@dhiltgen commented on GitHub (Sep 26, 2024):

Windows uses a concept of "CPU Groups" when you exceed 64 logical processors, and requires additional logic to handle process and thread creation. We're tracking adding this support in issue #2936

<!-- gh-comment-id:2377717537 --> @dhiltgen commented on GitHub (Sep 26, 2024): Windows uses a concept of "CPU Groups" when you exceed 64 logical processors, and requires additional logic to handle process and thread creation. We're tracking adding this support in issue #2936
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#50933