[GH-ISSUE #6105] Ollama not using GPU (AMD) #29577

Closed
opened 2026-04-22 08:34:19 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @theogbob on GitHub (Jul 31, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6105

What is the issue?

Im using ollama and I have an Ryzen 9 7900X3D and a Radeon RX 7900XTX, I have rocm installed:
rocm-smi output:

====================================================== Concise Info ======================================================
Device  Node  IDs              Temp    Power    Partitions          SCLK    MCLK     Fan  Perf  PwrCap       VRAM%  GPU%  
              (DID,     GUID)  (Edge)  (Avg)    (Mem, Compute, ID)                                                        
==========================================================================================================================
0       1     0x744c,   58112  31.0°C  21.0W    N/A, N/A, 0         137Mhz  96Mhz    0%   auto  303.0W       5%     7%    
1       2     0x164e,   26843  42.0°C  43.199W  N/A, N/A, 0         None    3000Mhz  0%   auto  Unsupported  4%     0%    
==========================================================================================================================
================================================== End of ROCm SMI Log ===================================================

The issue is ollama is using my CPU and RAM and never uses my GPU.

OS

Linux

GPU

AMD

CPU

AMD

Ollama version

reporting as 0.0.0?

Originally created by @theogbob on GitHub (Jul 31, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6105 ### What is the issue? Im using ollama and I have an Ryzen 9 7900X3D and a Radeon RX 7900XTX, I have rocm installed: rocm-smi output: ```============================================ ROCm System Management Interface ============================================ ====================================================== Concise Info ====================================================== Device Node IDs Temp Power Partitions SCLK MCLK Fan Perf PwrCap VRAM% GPU% (DID, GUID) (Edge) (Avg) (Mem, Compute, ID) ========================================================================================================================== 0 1 0x744c, 58112 31.0°C 21.0W N/A, N/A, 0 137Mhz 96Mhz 0% auto 303.0W 5% 7% 1 2 0x164e, 26843 42.0°C 43.199W N/A, N/A, 0 None 3000Mhz 0% auto Unsupported 4% 0% ========================================================================================================================== ================================================== End of ROCm SMI Log =================================================== ``` The issue is ollama is using my CPU and RAM and never uses my GPU. ### OS Linux ### GPU AMD ### CPU AMD ### Ollama version reporting as 0.0.0?
GiteaMirror added the bug label 2026-04-22 08:34:19 -05:00
Author
Owner

@rick-github commented on GitHub (Jul 31, 2024):

Did you download ollama or build it from source? A version of 0.0.0 usually means built from source, in which it may not have the correct build parameters. I just downloaded it and it responds as v0.3.1.

<!-- gh-comment-id:2261502397 --> @rick-github commented on GitHub (Jul 31, 2024): Did you download ollama or build it from source? A version of 0.0.0 usually means built from source, in which it may not have the correct build parameters. I just downloaded it and it responds as v0.3.1.
Author
Owner

@theogbob commented on GitHub (Jul 31, 2024):

I found my issue, (it was so stupid) this may effect any distro but i was using openSUSE tumbleweed, if you install ollama from the package manager it appears to be out of date or somethings wrong, installing using the script appeared to fix my issue.

<!-- gh-comment-id:2261503084 --> @theogbob commented on GitHub (Jul 31, 2024): I found my issue, (it was so stupid) this may effect any distro but i was using openSUSE tumbleweed, if you install ollama from the package manager it appears to be out of date or somethings wrong, installing using the script appeared to fix my issue.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#29577