github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 16:11:34 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #9633] Support for AMD 9000 GPUs #6287

New Issue
Closed
opened 2026-04-12 17:42:54 -05:00 by GiteaMirror · 10 comments
GiteaMirror commented 2026-04-12 17:42:54 -05:00
Owner
Copy Link

Originally created by @gergob on GitHub (Mar 10, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9633

Hi,

I am raising this issue to gather more data on when the recently released AMD 9000 Serries cards will be supported.

I searched for this topic in the issues, but did not find relevant details, so apologies if this is a duplicate and please direct me to the correct thread/issue.

Thanks in advance,
Greg

Originally created by @gergob on GitHub (Mar 10, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9633 Hi, I am raising this issue to gather more data on when the recently released AMD 9000 Serries cards will be supported. I searched for this topic in the issues, but did not find relevant details, so apologies if this is a duplicate and please direct me to the correct thread/issue. Thanks in advance, Greg
GiteaMirror added the feature request label 2026-04-12 17:42:54 -05:00
GiteaMirror commented 2026-04-12 17:42:56 -05:00
Author
Owner
Copy Link

@andreprodrigues commented on GitHub (Mar 11, 2025):

Ollama already supports AMD GPUs via ROCm, but the 9000 series may require updates to the ROCm version (e.g., 6.1.2+ for GFX12xx) and GPU detection logic to recognize these new targets. Community forks like likelovewant/ollama-for-amd have tackled similar expansions for RDNA 3, suggesting this is feasible. Supporting these cards would broaden Ollama’s appeal to AMD users and future-proof it for RDNA 4 adoption.

<!-- gh-comment-id:2714024798 --> @andreprodrigues commented on GitHub (Mar 11, 2025): Ollama already supports AMD GPUs via ROCm, but the 9000 series may require updates to the ROCm version (e.g., 6.1.2+ for GFX12xx) and GPU detection logic to recognize these new targets. Community forks like [likelovewant/ollama-for-amd](https://github.com/likelovewant/ollama-for-amd) have tackled similar expansions for RDNA 3, suggesting this is feasible. Supporting these cards would broaden Ollama’s appeal to AMD users and future-proof it for RDNA 4 adoption.
GiteaMirror commented 2026-04-12 17:42:56 -05:00
Author
Owner
Copy Link

@2eQTu commented on GitHub (Mar 12, 2025):

I can confirm at least on Windows that ollama does not currently detect AMD 9000 / gfx12 based cards.

The version of ROCm bundled with ollama does not support the newer cards. However there are newer versions of ROCm itself which do detect and at least function with the newer cards even if not yet fully supported.

The test in amd_common.go does correctly fail for the version of ROCm supplied.

See log output:
level=WARN source=amd_windows.go:138 msg="amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx1151 gfx906])" gpu_type=gfx1201 gpu=0

<!-- gh-comment-id:2718795932 --> @2eQTu commented on GitHub (Mar 12, 2025): I can confirm at least on Windows that ollama does _not_ currently detect AMD 9000 / gfx12 based cards. The version of ROCm bundled with ollama does not support the newer cards. However there are newer versions of ROCm itself which do detect and at least function with the newer cards even if not yet fully supported. The test in [amd_common.go](https://github.com/ollama/ollama/blob/a70820daa0a25024cfd857a528e717e3ac00a8e0/discover/amd_common.go#L26) does correctly fail for the version of ROCm supplied. See log output: `level=WARN source=amd_windows.go:138 msg="amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx1151 gfx906])" gpu_type=gfx1201 gpu=0`
GiteaMirror commented 2026-04-12 17:42:57 -05:00
Author
Owner
Copy Link

@AdamBullen commented on GitHub (Mar 19, 2025):

I'm running a RX 9070 with ROCm 6.10.5; I'm happy to help with testing. I just installed the latest (0.6.2) version of Ollama.


             ...-:::::-...                  
          .-MMMMMMMMMMMMMMM-.              ----------------- 
      .-MMMM`..-:::::::-..`MMMM-.          OS: Linux Mint 22.1 x86_64 
    .:MMMM.:MMMMMMMMMMMMMMM:.MMMM:.        Kernel: 6.11.0-19-generic 
   -MMM-M---MMMMMMMMMMMMMMMMMMM.MMM-       Uptime: 1 day, 8 hours, 13 mins 
 `:MMM:MM`  :MMMM:....::-...-MMMM:MMM:`    Packages: 2209 (dpkg), 26 (flatpak) 
 :MMM:MMM`  :MM:`  ``    ``  `:MMM:MMM:    Shell: bash 5.2.21 
.MMM.MMMM`  :MM.  -MM.  .MM-  `MMMM.MMM.   Resolution: 5504x2304 
:MMM:MMMM`  :MM.  -MM-  .MM:  `MMMM-MMM:   DE: Cinnamon 6.4.8 
:MMM:MMMM`  :MM.  -MM-  .MM:  `MMMM:MMM:   WM: Mutter (Muffin) 
:MMM:MMMM`  :MM.  -MM-  .MM:  `MMMM-MMM:   WM Theme: Mint-Y-Dark-Aqua (Mint-Y) 
.MMM.MMMM`  :MM:--:MM:--:MM:  `MMMM.MMM.   Theme: Mint-Y-Dark-Aqua [GTK2/3] 
 :MMM:MMM-  `-MMMMMMMMMMMM-`  -MMM-MMM:    Icons: Mint-Y-Sand [GTK2/3] 
  :MMM:MMM:`                `:MMM:MMM:     Terminal: gnome-terminal 
   .MMM.MMMM:--------------:MMMM.MMM.      CPU: AMD Ryzen 7 3700X (16) @ 3.700GHz 
     '-MMMM.-MMMMMMMMMMMMMMM-.MMMM-'       GPU: AMD ATI RX 9070/9070 XT 
       '.-MMMM``--:::::--``MMMM-.'         Memory: 3703MiB / 64212MiB 
            '-MMMMMMMMMMMMM-'
               ``-:::::-``                                         


============================ ROCm System Management Interface ============================
============================== Version of System Component ===============================
Driver version: 6.10.5
==========================================================================================
=========================================== ID ===========================================
GPU[0]		: Device Name: 		Navi 48 [RX 9070/9070 XT]
GPU[0]		: Device ID: 		0x7550
GPU[0]		: Device Rev: 		0xc3
GPU[0]		: Subsystem ID: 	0x4499
GPU[0]		: GUID: 		40448
==========================================================================================
======================================= Unique ID ========================================
GPU[0]		: Unique ID: N/A
==========================================================================================
========================================= VBIOS ==========================================
GPU[0]		: VBIOS version: 113-4E490TX-UP3
==========================================================================================
====================================== Temperature =======================================
GPU[0]		: Temperature (Sensor edge) (C): 41.0
GPU[0]		: Temperature (Sensor junction) (C): 43.0
GPU[0]		: Temperature (Sensor memory) (C): 62.0
==========================================================================================
=============================== Current clock frequencies ================================
GPU[0]		: dcefclk clock level: 1: (243Mhz)
GPU[0]		: fclk clock level: 1: (679Mhz)
GPU[0]		: mclk clock level: 0: (96Mhz)
GPU[0]		: sclk clock level: 1: (1369Mhz)
GPU[0]		: socclk clock level: 0: (417Mhz)
GPU[0]		: pcie clock level: 1 (16.0GT/s x16)
==========================================================================================
=================================== Current Fan Metric ===================================
GPU[0]		: Not supported
==========================================================================================
================================= Show Performance Level =================================
GPU[0]		: Performance Level: auto
==========================================================================================
==================================== OverDrive Level =====================================
GPU[0]		: get_overdrive_level_sclk, Not supported on the given system
==========================================================================================
==================================== OverDrive Level =====================================
GPU[0]		: get_mem_overdrive_level_mclk, Not supported on the given system
==========================================================================================
======================================= Power Cap ========================================
GPU[0]		: Max Graphics Package Power (W): 245.0
==========================================================================================
================================== Show Power Profiles ===================================
GPU[0]		: 1. Available power profile (#1 of 7): CUSTOM
GPU[0]		: 2. Available power profile (#2 of 7): VIDEO
GPU[0]		: 3. Available power profile (#3 of 7): POWER SAVING
GPU[0]		: 4. Available power profile (#4 of 7): COMPUTE
GPU[0]		: 5. Available power profile (#5 of 7): VR
GPU[0]		: 6. Available power profile (#6 of 7): 3D FULL SCREEN
GPU[0]		: 7. Available power profile (#7 of 7): BOOTUP DEFAULT*
==========================================================================================
=================================== Power Consumption ====================================
GPU[0]		: Average Graphics Package Power (W): 17.0
==========================================================================================
============================== Supported clock frequencies ===============================
GPU[0]		: Supported dcefclk frequencies on GPU0
GPU[0]		: 0: 147Mhz
GPU[0]		: 1: 243Mhz *
GPU[0]		: 2: 1800Mhz
GPU[0]		: 
GPU[0]		: Supported fclk frequencies on GPU0
GPU[0]		: 0: 313Mhz
GPU[0]		: 1: 679Mhz *
GPU[0]		: 2: 2400Mhz
GPU[0]		: 
GPU[0]		: Supported mclk frequencies on GPU0
GPU[0]		: 0: 96Mhz *
GPU[0]		: 1: 456Mhz
GPU[0]		: 2: 772Mhz
GPU[0]		: 3: 875Mhz
GPU[0]		: 4: 1124Mhz
GPU[0]		: 5: 1258Mhz
GPU[0]		: 
GPU[0]		: Supported sclk frequencies on GPU0
GPU[0]		: 0: 500Mhz
GPU[0]		: 1: 56Mhz *
GPU[0]		: 2: 2210Mhz
GPU[0]		: 
GPU[0]		: Supported socclk frequencies on GPU0
GPU[0]		: 0: 417Mhz *
GPU[0]		: 1: 1476Mhz
GPU[0]		: 
GPU[0]		: Supported PCIe frequencies on GPU0
GPU[0]		: 0: 2.5GT/s x16
GPU[0]		: 1: 16.0GT/s x16 *
GPU[0]		: 
------------------------------------------------------------------------------------------
==========================================================================================
=================================== % time GPU is busy ===================================
GPU[0]		: GPU use (%): 3
==========================================================================================
=================================== Current Memory Use ===================================
GPU[0]		: GPU Memory Allocated (VRAM%): 9
GPU[0]		: GPU Memory Read/Write Activity (%): 2
GPU[0]		: Memory Activity: N/A
GPU[0]		: Avg. Memory Bandwidth: 0
==========================================================================================
===================================== Memory Vendor ======================================
GPU[0]		: GPU memory vendor: hynix
==========================================================================================
================================== PCIe Replay Counter ===================================
GPU[0]		: PCIe Replay Count: 0
==========================================================================================
===================================== Serial Number ======================================
GPU[0]		: get_serial_number, Not supported on the given system
GPU[0]		: Serial Number: N/A
==========================================================================================
===================================== KFD Processes ======================================
No KFD PIDs currently running
==========================================================================================
================================== GPUs Indexed by PID ===================================
No KFD PIDs currently running
==========================================================================================
======================= GPU Memory clock frequencies and voltages ========================
GPU[0]		: get_od_volt, Not supported on the given system
==========================================================================================
==================================== Current voltage =====================================
GPU[0]		: Voltage (mV): 695
==========================================================================================
======================================= PCI Bus ID =======================================
GPU[0]		: PCI Bus: 0000:0B:00.0
==========================================================================================
================================== Firmware Information ==================================
GPU[0]		: ASD firmware version: 	0x210000ea
GPU[0]		: ME firmware version: 		2660
GPU[0]		: MEC firmware version: 	2920
GPU[0]		: MES firmware version: 	0x00000070
GPU[0]		: MES KIQ firmware version: 	0x00000070
GPU[0]		: PFP firmware version: 	2700
GPU[0]		: RLC firmware version: 	12483900
GPU[0]		: SDMA firmware version: 	6812397
GPU[0]		: SDMA2 firmware version: 	6812397
GPU[0]		: SMC firmware version: 	00.104.63.00
GPU[0]		: SOS firmware version: 	0x003a0a14
GPU[0]		: TA RAS firmware version: 	27.58.00.01
GPU[0]		: VCN firmware version: 	0x09106012
==========================================================================================
====================================== Product Info ======================================
GPU[0]		: Card Series: 		Navi 48 [RX 9070/9070 XT]
GPU[0]		: Card Model: 		0x7550
GPU[0]		: Card Vendor: 		Advanced Micro Devices, Inc. [AMD/ATI]
GPU[0]		: Card SKU: 		4E490TX
GPU[0]		: Subsystem ID: 	0x4499
GPU[0]		: Device Rev: 		0xc3
GPU[0]		: Node ID: 		1
GPU[0]		: GUID: 		40448
GPU[0]		: GFX Version: 		gfx1201
==========================================================================================
======================================= Pages Info =======================================
GPU[0]		: ras, Not supported on the given system
================================= Show Valid sclk Range ==================================
GPU[0]		: get_od_volt, Not supported on the given system
==========================================================================================
================================= Show Valid mclk Range ==================================
GPU[0]		: get_od_volt, Not supported on the given system
==========================================================================================
================================ Show Valid voltage Range ================================
GPU[0]		: get_od_volt, Not supported on the given system
==========================================================================================
================================== Voltage Curve Points ==================================
GPU[0]		: get_od_volt_info, Not supported on the given system
WARNING: GPU[0]	: Voltage curve Points unsupported.
==========================================================================================
==================================== Consumed Energy =====================================
GPU[0]		: Energy counter: 0
GPU[0]		: Accumulated Energy (uJ): 0.0
==========================================================================================
=============================== Current Compute Partition ================================
GPU[0]		: Not supported on the given system
==========================================================================================
================================ Current Memory Partition ================================
GPU[0]		: Not supported on the given system
==========================================================================================
====================================== GPU Metrics =======================================
GPU[0]		: Metric Version and Size (Bytes): 1.3 120
GPU[0]		: temperature_edge (C): 41
GPU[0]		: temperature_hotspot (C): 43
GPU[0]		: temperature_mem (C): 62
GPU[0]		: temperature_vrgfx (C): 38
GPU[0]		: temperature_vrsoc (C): 43
GPU[0]		: temperature_vrmem (C): 46
GPU[0]		: average_gfx_activity (%): 3
GPU[0]		: average_umc_activity (%): 4
GPU[0]		: average_mm_activity (%): 0
GPU[0]		: average_socket_power (W): 20
GPU[0]		: energy_accumulator (15.259uJ (2^-16)): 0
GPU[0]		: system_clock_counter (ns): 115756787021127
GPU[0]		: average_gfxclk_frequency (MHz): 41
GPU[0]		: average_socclk_frequency (MHz): N/A
GPU[0]		: average_uclk_frequency (MHz): 157
GPU[0]		: average_vclk0_frequency (MHz): 24
GPU[0]		: average_dclk0_frequency (MHz): 24
GPU[0]		: average_vclk1_frequency (MHz): 0
GPU[0]		: average_dclk1_frequency (MHz): 0
GPU[0]		: current_gfxclk (MHz): 41
GPU[0]		: current_socclk (MHz): 417
GPU[0]		: current_uclk (MHz): 96
GPU[0]		: current_vclk0 (MHz): 25
GPU[0]		: current_dclk0 (MHz): 25
GPU[0]		: current_vclk1 (MHz): 25
GPU[0]		: current_dclk1 (MHz): 25
GPU[0]		: throttle_status: 0
GPU[0]		: current_fan_speed (rpm): 0
GPU[0]		: pcie_link_width (Lanes): 16
GPU[0]		: pcie_link_speed (0.1 GT/s): 160
GPU[0]		: gfx_activity_acc (%): N/A
GPU[0]		: mem_activity_acc (%): N/A
GPU[0]		: temperature_hbm (C): ['N/A', 'N/A', 'N/A', 'N/A']
GPU[0]		: firmware_timestamp (10ns resolution): 18446744073709551606
GPU[0]		: voltage_soc (mV): 840
GPU[0]		: voltage_gfx (mV): 674
GPU[0]		: voltage_mem (mV): 1245
GPU[0]		: indep_throttle_status: 0
GPU[0]		: current_socket_power (W): N/A
GPU[0]		: vcn_activity (%): [0, 'N/A', 'N/A', 'N/A']
GPU[0]		: gfxclk_lock_status: N/A
GPU[0]		: xgmi_link_width: N/A
GPU[0]		: xgmi_link_speed (Gbps): N/A
GPU[0]		: pcie_bandwidth_acc (GB/s): N/A
GPU[0]		: pcie_bandwidth_inst (GB/s): N/A
GPU[0]		: pcie_l0_to_recov_count_acc (Count): N/A
GPU[0]		: pcie_replay_count_acc (Count): N/A
GPU[0]		: pcie_replay_rover_count_acc (Count): N/A
GPU[0]		: xgmi_read_data_acc (kB): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0]		: xgmi_write_data_acc (kB): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0]		: current_gfxclks (MHz): [41, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0]		: current_socclks (MHz): [417, 'N/A', 'N/A', 'N/A']
GPU[0]		: current_vclk0s (MHz): [25, 'N/A', 'N/A', 'N/A']
GPU[0]		: current_dclk0s (MHz): [25, 'N/A', 'N/A', 'N/A']
GPU[0]		: jpeg_activity (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0]		: pcie_nak_sent_count_acc (Count): N/A
GPU[0]		: pcie_nak_rcvd_count_acc (Count): N/A
GPU[0]		: accumulation_counter (Count): N/A
GPU[0]		: prochot_residency_acc (Count): N/A
GPU[0]		: ppt_residency_acc (Count): N/A
GPU[0]		: socket_thm_residency_acc (Count): N/A
GPU[0]		: vr_thm_residency_acc (Count): N/A
GPU[0]		: hbm_thm_residency_acc (Count): N/A
GPU[0]		: pcie_lc_perf_other_end_recovery (Count): N/A
GPU[0]		: num_partition: N/A
GPU[0] XCP[0]	: xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[1]	: xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[2]	: xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[3]	: xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[4]	: xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[5]	: xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[6]	: xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[7]	: xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[0]	: xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[1]	: xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[2]	: xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[3]	: xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[4]	: xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[5]	: xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[6]	: xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[7]	: xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[0]	: xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[1]	: xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[2]	: xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[3]	: xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[4]	: xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[5]	: xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[6]	: xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[7]	: xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[0]	: xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[1]	: xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[2]	: xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[3]	: xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[4]	: xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[5]	: xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[6]	: xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
GPU[0] XCP[7]	: xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A']
==========================================================================================
================================== End of ROCm SMI Log ===================================
<!-- gh-comment-id:2735799340 --> @AdamBullen commented on GitHub (Mar 19, 2025): I'm running a RX 9070 with ROCm 6.10.5; I'm happy to help with testing. I just installed the latest (0.6.2) version of Ollama. ``` ...-:::::-... .-MMMMMMMMMMMMMMM-. ----------------- .-MMMM`..-:::::::-..`MMMM-. OS: Linux Mint 22.1 x86_64 .:MMMM.:MMMMMMMMMMMMMMM:.MMMM:. Kernel: 6.11.0-19-generic -MMM-M---MMMMMMMMMMMMMMMMMMM.MMM- Uptime: 1 day, 8 hours, 13 mins `:MMM:MM` :MMMM:....::-...-MMMM:MMM:` Packages: 2209 (dpkg), 26 (flatpak) :MMM:MMM` :MM:` `` `` `:MMM:MMM: Shell: bash 5.2.21 .MMM.MMMM` :MM. -MM. .MM- `MMMM.MMM. Resolution: 5504x2304 :MMM:MMMM` :MM. -MM- .MM: `MMMM-MMM: DE: Cinnamon 6.4.8 :MMM:MMMM` :MM. -MM- .MM: `MMMM:MMM: WM: Mutter (Muffin) :MMM:MMMM` :MM. -MM- .MM: `MMMM-MMM: WM Theme: Mint-Y-Dark-Aqua (Mint-Y) .MMM.MMMM` :MM:--:MM:--:MM: `MMMM.MMM. Theme: Mint-Y-Dark-Aqua [GTK2/3] :MMM:MMM- `-MMMMMMMMMMMM-` -MMM-MMM: Icons: Mint-Y-Sand [GTK2/3] :MMM:MMM:` `:MMM:MMM: Terminal: gnome-terminal .MMM.MMMM:--------------:MMMM.MMM. CPU: AMD Ryzen 7 3700X (16) @ 3.700GHz '-MMMM.-MMMMMMMMMMMMMMM-.MMMM-' GPU: AMD ATI RX 9070/9070 XT '.-MMMM``--:::::--``MMMM-.' Memory: 3703MiB / 64212MiB '-MMMMMMMMMMMMM-' ``-:::::-`` ``` ``` ============================ ROCm System Management Interface ============================ ============================== Version of System Component =============================== Driver version: 6.10.5 ========================================================================================== =========================================== ID =========================================== GPU[0] : Device Name: Navi 48 [RX 9070/9070 XT] GPU[0] : Device ID: 0x7550 GPU[0] : Device Rev: 0xc3 GPU[0] : Subsystem ID: 0x4499 GPU[0] : GUID: 40448 ========================================================================================== ======================================= Unique ID ======================================== GPU[0] : Unique ID: N/A ========================================================================================== ========================================= VBIOS ========================================== GPU[0] : VBIOS version: 113-4E490TX-UP3 ========================================================================================== ====================================== Temperature ======================================= GPU[0] : Temperature (Sensor edge) (C): 41.0 GPU[0] : Temperature (Sensor junction) (C): 43.0 GPU[0] : Temperature (Sensor memory) (C): 62.0 ========================================================================================== =============================== Current clock frequencies ================================ GPU[0] : dcefclk clock level: 1: (243Mhz) GPU[0] : fclk clock level: 1: (679Mhz) GPU[0] : mclk clock level: 0: (96Mhz) GPU[0] : sclk clock level: 1: (1369Mhz) GPU[0] : socclk clock level: 0: (417Mhz) GPU[0] : pcie clock level: 1 (16.0GT/s x16) ========================================================================================== =================================== Current Fan Metric =================================== GPU[0] : Not supported ========================================================================================== ================================= Show Performance Level ================================= GPU[0] : Performance Level: auto ========================================================================================== ==================================== OverDrive Level ===================================== GPU[0] : get_overdrive_level_sclk, Not supported on the given system ========================================================================================== ==================================== OverDrive Level ===================================== GPU[0] : get_mem_overdrive_level_mclk, Not supported on the given system ========================================================================================== ======================================= Power Cap ======================================== GPU[0] : Max Graphics Package Power (W): 245.0 ========================================================================================== ================================== Show Power Profiles =================================== GPU[0] : 1. Available power profile (#1 of 7): CUSTOM GPU[0] : 2. Available power profile (#2 of 7): VIDEO GPU[0] : 3. Available power profile (#3 of 7): POWER SAVING GPU[0] : 4. Available power profile (#4 of 7): COMPUTE GPU[0] : 5. Available power profile (#5 of 7): VR GPU[0] : 6. Available power profile (#6 of 7): 3D FULL SCREEN GPU[0] : 7. Available power profile (#7 of 7): BOOTUP DEFAULT* ========================================================================================== =================================== Power Consumption ==================================== GPU[0] : Average Graphics Package Power (W): 17.0 ========================================================================================== ============================== Supported clock frequencies =============================== GPU[0] : Supported dcefclk frequencies on GPU0 GPU[0] : 0: 147Mhz GPU[0] : 1: 243Mhz * GPU[0] : 2: 1800Mhz GPU[0] : GPU[0] : Supported fclk frequencies on GPU0 GPU[0] : 0: 313Mhz GPU[0] : 1: 679Mhz * GPU[0] : 2: 2400Mhz GPU[0] : GPU[0] : Supported mclk frequencies on GPU0 GPU[0] : 0: 96Mhz * GPU[0] : 1: 456Mhz GPU[0] : 2: 772Mhz GPU[0] : 3: 875Mhz GPU[0] : 4: 1124Mhz GPU[0] : 5: 1258Mhz GPU[0] : GPU[0] : Supported sclk frequencies on GPU0 GPU[0] : 0: 500Mhz GPU[0] : 1: 56Mhz * GPU[0] : 2: 2210Mhz GPU[0] : GPU[0] : Supported socclk frequencies on GPU0 GPU[0] : 0: 417Mhz * GPU[0] : 1: 1476Mhz GPU[0] : GPU[0] : Supported PCIe frequencies on GPU0 GPU[0] : 0: 2.5GT/s x16 GPU[0] : 1: 16.0GT/s x16 * GPU[0] : ------------------------------------------------------------------------------------------ ========================================================================================== =================================== % time GPU is busy =================================== GPU[0] : GPU use (%): 3 ========================================================================================== =================================== Current Memory Use =================================== GPU[0] : GPU Memory Allocated (VRAM%): 9 GPU[0] : GPU Memory Read/Write Activity (%): 2 GPU[0] : Memory Activity: N/A GPU[0] : Avg. Memory Bandwidth: 0 ========================================================================================== ===================================== Memory Vendor ====================================== GPU[0] : GPU memory vendor: hynix ========================================================================================== ================================== PCIe Replay Counter =================================== GPU[0] : PCIe Replay Count: 0 ========================================================================================== ===================================== Serial Number ====================================== GPU[0] : get_serial_number, Not supported on the given system GPU[0] : Serial Number: N/A ========================================================================================== ===================================== KFD Processes ====================================== No KFD PIDs currently running ========================================================================================== ================================== GPUs Indexed by PID =================================== No KFD PIDs currently running ========================================================================================== ======================= GPU Memory clock frequencies and voltages ======================== GPU[0] : get_od_volt, Not supported on the given system ========================================================================================== ==================================== Current voltage ===================================== GPU[0] : Voltage (mV): 695 ========================================================================================== ======================================= PCI Bus ID ======================================= GPU[0] : PCI Bus: 0000:0B:00.0 ========================================================================================== ================================== Firmware Information ================================== GPU[0] : ASD firmware version: 0x210000ea GPU[0] : ME firmware version: 2660 GPU[0] : MEC firmware version: 2920 GPU[0] : MES firmware version: 0x00000070 GPU[0] : MES KIQ firmware version: 0x00000070 GPU[0] : PFP firmware version: 2700 GPU[0] : RLC firmware version: 12483900 GPU[0] : SDMA firmware version: 6812397 GPU[0] : SDMA2 firmware version: 6812397 GPU[0] : SMC firmware version: 00.104.63.00 GPU[0] : SOS firmware version: 0x003a0a14 GPU[0] : TA RAS firmware version: 27.58.00.01 GPU[0] : VCN firmware version: 0x09106012 ========================================================================================== ====================================== Product Info ====================================== GPU[0] : Card Series: Navi 48 [RX 9070/9070 XT] GPU[0] : Card Model: 0x7550 GPU[0] : Card Vendor: Advanced Micro Devices, Inc. [AMD/ATI] GPU[0] : Card SKU: 4E490TX GPU[0] : Subsystem ID: 0x4499 GPU[0] : Device Rev: 0xc3 GPU[0] : Node ID: 1 GPU[0] : GUID: 40448 GPU[0] : GFX Version: gfx1201 ========================================================================================== ======================================= Pages Info ======================================= GPU[0] : ras, Not supported on the given system ================================= Show Valid sclk Range ================================== GPU[0] : get_od_volt, Not supported on the given system ========================================================================================== ================================= Show Valid mclk Range ================================== GPU[0] : get_od_volt, Not supported on the given system ========================================================================================== ================================ Show Valid voltage Range ================================ GPU[0] : get_od_volt, Not supported on the given system ========================================================================================== ================================== Voltage Curve Points ================================== GPU[0] : get_od_volt_info, Not supported on the given system WARNING: GPU[0] : Voltage curve Points unsupported. ========================================================================================== ==================================== Consumed Energy ===================================== GPU[0] : Energy counter: 0 GPU[0] : Accumulated Energy (uJ): 0.0 ========================================================================================== =============================== Current Compute Partition ================================ GPU[0] : Not supported on the given system ========================================================================================== ================================ Current Memory Partition ================================ GPU[0] : Not supported on the given system ========================================================================================== ====================================== GPU Metrics ======================================= GPU[0] : Metric Version and Size (Bytes): 1.3 120 GPU[0] : temperature_edge (C): 41 GPU[0] : temperature_hotspot (C): 43 GPU[0] : temperature_mem (C): 62 GPU[0] : temperature_vrgfx (C): 38 GPU[0] : temperature_vrsoc (C): 43 GPU[0] : temperature_vrmem (C): 46 GPU[0] : average_gfx_activity (%): 3 GPU[0] : average_umc_activity (%): 4 GPU[0] : average_mm_activity (%): 0 GPU[0] : average_socket_power (W): 20 GPU[0] : energy_accumulator (15.259uJ (2^-16)): 0 GPU[0] : system_clock_counter (ns): 115756787021127 GPU[0] : average_gfxclk_frequency (MHz): 41 GPU[0] : average_socclk_frequency (MHz): N/A GPU[0] : average_uclk_frequency (MHz): 157 GPU[0] : average_vclk0_frequency (MHz): 24 GPU[0] : average_dclk0_frequency (MHz): 24 GPU[0] : average_vclk1_frequency (MHz): 0 GPU[0] : average_dclk1_frequency (MHz): 0 GPU[0] : current_gfxclk (MHz): 41 GPU[0] : current_socclk (MHz): 417 GPU[0] : current_uclk (MHz): 96 GPU[0] : current_vclk0 (MHz): 25 GPU[0] : current_dclk0 (MHz): 25 GPU[0] : current_vclk1 (MHz): 25 GPU[0] : current_dclk1 (MHz): 25 GPU[0] : throttle_status: 0 GPU[0] : current_fan_speed (rpm): 0 GPU[0] : pcie_link_width (Lanes): 16 GPU[0] : pcie_link_speed (0.1 GT/s): 160 GPU[0] : gfx_activity_acc (%): N/A GPU[0] : mem_activity_acc (%): N/A GPU[0] : temperature_hbm (C): ['N/A', 'N/A', 'N/A', 'N/A'] GPU[0] : firmware_timestamp (10ns resolution): 18446744073709551606 GPU[0] : voltage_soc (mV): 840 GPU[0] : voltage_gfx (mV): 674 GPU[0] : voltage_mem (mV): 1245 GPU[0] : indep_throttle_status: 0 GPU[0] : current_socket_power (W): N/A GPU[0] : vcn_activity (%): [0, 'N/A', 'N/A', 'N/A'] GPU[0] : gfxclk_lock_status: N/A GPU[0] : xgmi_link_width: N/A GPU[0] : xgmi_link_speed (Gbps): N/A GPU[0] : pcie_bandwidth_acc (GB/s): N/A GPU[0] : pcie_bandwidth_inst (GB/s): N/A GPU[0] : pcie_l0_to_recov_count_acc (Count): N/A GPU[0] : pcie_replay_count_acc (Count): N/A GPU[0] : pcie_replay_rover_count_acc (Count): N/A GPU[0] : xgmi_read_data_acc (kB): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] : xgmi_write_data_acc (kB): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] : current_gfxclks (MHz): [41, 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] : current_socclks (MHz): [417, 'N/A', 'N/A', 'N/A'] GPU[0] : current_vclk0s (MHz): [25, 'N/A', 'N/A', 'N/A'] GPU[0] : current_dclk0s (MHz): [25, 'N/A', 'N/A', 'N/A'] GPU[0] : jpeg_activity (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] : pcie_nak_sent_count_acc (Count): N/A GPU[0] : pcie_nak_rcvd_count_acc (Count): N/A GPU[0] : accumulation_counter (Count): N/A GPU[0] : prochot_residency_acc (Count): N/A GPU[0] : ppt_residency_acc (Count): N/A GPU[0] : socket_thm_residency_acc (Count): N/A GPU[0] : vr_thm_residency_acc (Count): N/A GPU[0] : hbm_thm_residency_acc (Count): N/A GPU[0] : pcie_lc_perf_other_end_recovery (Count): N/A GPU[0] : num_partition: N/A GPU[0] XCP[0] : xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[1] : xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[2] : xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[3] : xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[4] : xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[5] : xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[6] : xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[7] : xcp_stats.gfx_busy_inst (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[0] : xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[1] : xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[2] : xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[3] : xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[4] : xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[5] : xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[6] : xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[7] : xcp_stats.jpeg_busy (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[0] : xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[1] : xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[2] : xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[3] : xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[4] : xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[5] : xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[6] : xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[7] : xcp_stats.vcn_busy (%): ['N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[0] : xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[1] : xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[2] : xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[3] : xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[4] : xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[5] : xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[6] : xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] GPU[0] XCP[7] : xcp_stats.gfx_busy_acc (%): ['N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A', 'N/A'] ========================================================================================== ================================== End of ROCm SMI Log =================================== ```
GiteaMirror commented 2026-04-12 17:42:57 -05:00
Author
Owner
Copy Link

@fatino commented on GitHub (Mar 26, 2025):

I'm on arch. With ollama-rocm, linux-mainline 6.14 and latest mesa-git GPU started to get recognized by ollama. It loads models, but fails for any prompt(even for really small models):

ollama[10534]: [GIN] 2025/03/26 - 12:24:42 | 200 |   1.92741022s |       127.0.0.1 | POST     "/api/generate"
ollama[10534]: ggml_cuda_compute_forward: RMS_NORM failed
ollama[10534]: ROCm error: invalid device function
ollama[10534]:   current device: 0, in function ggml_cuda_compute_forward at /build/ollama/src/ollama/ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:2315
ollama[10534]:   err
ollama[10534]: /build/ollama/src/ollama/ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:73: ROCm error
ollama[10534]: ptrace: Operacja niedozwolona.
ollama[10534]: No stack.
ollama[10534]: The program is not being run.
ollama[10534]: SIGABRT: abort
ollama[10534]: PC=0x7f65489ad624 m=0 sigcode=18446744073709551610
ollama[10534]: signal arrived during cgo execution
ollama[10534]: goroutine 9 gp=0xc000484fc0 m=0 mp=0x55980b201240 [syscall]:
ollama[10534]: runtime.cgocall(0x55980a308060, 0xc000091bc8)
ollama[10534]:         /usr/lib/go/src/runtime/cgocall.go:167 +0x4b fp=0xc000091ba0 sp=0xc000091b68 pc=0x55980969470b
ollama[10534]: github.com/ollama/ollama/llama._Cfunc_llama_decode(0x7f64dc4b3ae0, {0x4, 0x7f64df181e20, 0x0, 0x0, 0x7f64dfdcac30, 0x7f64dfc63cd0, 0x7f64dfde5890, 0x7f64dfe0ba40})
ollama[10534]:         _cgo_gotypes.go:578 +0x4a fp=0xc000091bc8 sp=0xc000091ba0 pc=0x559809a2d08a
ollama[10534]: github.com/ollama/ollama/llama.(*Context).Decode.func1(...)
ollama[10534]:         /build/ollama/src/ollama/llama/llama.go:132
ollama[10534]: github.com/ollama/ollama/llama.(*Context).Decode(0xc00048ddd0?, 0x0?)
ollama[10534]:         /build/ollama/src/ollama/llama/llama.go:132 +0xf6 fp=0xc000091cc8 sp=0xc000091bc8 pc=0x559809a2fe36
ollama[10534]: github.com/ollama/ollama/runner/llamarunner.(*Server).processBatch(0xc0007b0360, 0xc0000ae660, 0xc00048df20)
ollama[10534]:         /build/ollama/src/ollama/runner/llamarunner/runner.go:436 +0x23e fp=0xc000091ee0 sp=0xc000091cc8 pc=0x559809ae5d9e
ollama[10534]: github.com/ollama/ollama/runner/llamarunner.(*Server).run(0xc0007b0360, {0x55980a98f3e0, 0xc0006b15e0})
ollama[10534]:         /build/ollama/src/ollama/runner/llamarunner/runner.go:344 +0x1d5 fp=0xc000091fb8 sp=0xc000091ee0 pc=0x559809ae59f5
ollama[10534]: github.com/ollama/ollama/runner/llamarunner.Execute.gowrap2()
ollama[10534]:         /build/ollama/src/ollama/runner/llamarunner/runner.go:887 +0x28 fp=0xc000091fe0 sp=0xc000091fb8 pc=0x559809aea348
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000091fe8 sp=0xc000091fe0 pc=0x55980969f981
ollama[10534]: created by github.com/ollama/ollama/runner/llamarunner.Execute in goroutine 1
ollama[10534]:         /build/ollama/src/ollama/runner/llamarunner/runner.go:887 +0xcb7
ollama[10534]: goroutine 1 gp=0xc000002380 m=nil [IO wait]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc0004975f8 sp=0xc0004975d8 pc=0x559809697a0e
ollama[10534]: runtime.netpollblock(0xc000497678?, 0x9631a06?, 0x98?)
ollama[10534]:         /usr/lib/go/src/runtime/netpoll.go:575 +0xf7 fp=0xc000497630 sp=0xc0004975f8 pc=0x55980965d037
ollama[10534]: internal/poll.runtime_pollWait(0x7f654865ede0, 0x72)
ollama[10534]:         /usr/lib/go/src/runtime/netpoll.go:351 +0x85 fp=0xc000497650 sp=0xc000497630 pc=0x559809696c25
ollama[10534]: internal/poll.(*pollDesc).wait(0xc0007ac580?, 0x55980963fbe6?, 0x0)
ollama[10534]:         /usr/lib/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000497678 sp=0xc000497650 pc=0x55980971f0a7
ollama[10534]: internal/poll.(*pollDesc).waitRead(...)
ollama[10534]:         /usr/lib/go/src/internal/poll/fd_poll_runtime.go:89
ollama[10534]: internal/poll.(*FD).Accept(0xc0007ac580)
ollama[10534]:         /usr/lib/go/src/internal/poll/fd_unix.go:620 +0x295 fp=0xc000497720 sp=0xc000497678 pc=0x559809724475
ollama[10534]: net.(*netFD).accept(0xc0007ac580)
ollama[10534]:         /usr/lib/go/src/net/fd_unix.go:172 +0x29 fp=0xc0004977d8 sp=0xc000497720 pc=0x559809797289
ollama[10534]: net.(*TCPListener).accept(0xc0000ad000)
ollama[10534]:         /usr/lib/go/src/net/tcpsock_posix.go:159 +0x1b fp=0xc000497828 sp=0xc0004977d8 pc=0x5598097acc3b
ollama[10534]: net.(*TCPListener).Accept(0xc0000ad000)
ollama[10534]:         /usr/lib/go/src/net/tcpsock.go:380 +0x30 fp=0xc000497858 sp=0xc000497828 pc=0x5598097abaf0
ollama[10534]: net/http.(*onceCloseListener).Accept(0xc0004a8000?)
ollama[10534]:         <autogenerated>:1 +0x24 fp=0xc000497870 sp=0xc000497858 pc=0x5598099c31a4
ollama[10534]: net/http.(*Server).Serve(0xc000035200, {0x55980a98d118, 0xc0000ad000})
ollama[10534]:         /usr/lib/go/src/net/http/server.go:3424 +0x30c fp=0xc0004979a0 sp=0xc000497870 pc=0x55980999aa6c
ollama[10534]: github.com/ollama/ollama/runner/llamarunner.Execute({0xc000132020, 0xe, 0xe})
ollama[10534]:         /build/ollama/src/ollama/runner/llamarunner/runner.go:907 +0x108a fp=0xc000497d08 sp=0xc0004979a0 pc=0x559809aea08a
ollama[10534]: github.com/ollama/ollama/runner.Execute({0xc000132010?, 0x0?, 0x0?})
ollama[10534]:         /build/ollama/src/ollama/runner/runner.go:22 +0xd4 fp=0xc000497d30 sp=0xc000497d08 pc=0x559809b4c7d4
ollama[10534]: github.com/ollama/ollama/cmd.NewCLI.func2(0xc000034f00?, {0x55980a501193?, 0x4?, 0x55980a501197?})
ollama[10534]:         /build/ollama/src/ollama/cmd/cmd.go:1327 +0x45 fp=0xc000497d58 sp=0xc000497d30 pc=0x55980a29a445
ollama[10534]: github.com/spf13/cobra.(*Command).execute(0xc0007b2f08, {0xc0001ced20, 0xe, 0xe})
ollama[10534]:         /build/ollama/src/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000497e78 sp=0xc000497d58 pc=0x5598098108dc
ollama[10534]: github.com/spf13/cobra.(*Command).ExecuteC(0xc000783508)
ollama[10534]:         /build/ollama/src/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000497f30 sp=0xc000497e78 pc=0x559809811125
ollama[10534]: github.com/spf13/cobra.(*Command).Execute(...)
ollama[10534]:         /build/ollama/src/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
ollama[10534]: github.com/spf13/cobra.(*Command).ExecuteContext(...)
ollama[10534]:         /build/ollama/src/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
ollama[10534]: main.main()
ollama[10534]:         /build/ollama/src/ollama/main.go:12 +0x4d fp=0xc000497f50 sp=0xc000497f30 pc=0x55980a29a7ad
ollama[10534]: runtime.main()
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:283 +0x29d fp=0xc000497fe0 sp=0xc000497f50 pc=0x55980966463d
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000497fe8 sp=0xc000497fe0 pc=0x55980969f981
ollama[10534]: goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000084fa8 sp=0xc000084f88 pc=0x559809697a0e
ollama[10534]: runtime.goparkunlock(...)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:441
ollama[10534]: runtime.forcegchelper()
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:348 +0xb8 fp=0xc000084fe0 sp=0xc000084fa8 pc=0x559809664978
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000084fe8 sp=0xc000084fe0 pc=0x55980969f981
ollama[10534]: created by runtime.init.7 in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:336 +0x1a
ollama[10534]: goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]:
ollama[10534]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000085780 sp=0xc000085760 pc=0x559809697a0e
ollama[10534]: runtime.goparkunlock(...)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:441
ollama[10534]: runtime.bgsweep(0xc0000aa000)
ollama[10534]:         /usr/lib/go/src/runtime/mgcsweep.go:316 +0xdf fp=0xc0000857c8 sp=0xc000085780 pc=0x55980964f03f
ollama[10534]: runtime.gcenable.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:204 +0x25 fp=0xc0000857e0 sp=0xc0000857c8 pc=0x559809643425
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000857e8 sp=0xc0000857e0 pc=0x55980969f981
ollama[10534]: created by runtime.gcenable in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:204 +0x66
ollama[10534]: goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]:
ollama[10534]: runtime.gopark(0x10000?, 0x55980a6b8390?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000085f78 sp=0xc000085f58 pc=0x559809697a0e
ollama[10534]: runtime.goparkunlock(...)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:441
ollama[10534]: runtime.(*scavengerState).park(0x55980b1fe420)
ollama[10534]:         /usr/lib/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000085fa8 sp=0xc000085f78 pc=0x55980964ca89
ollama[10534]: runtime.bgscavenge(0xc0000aa000)
ollama[10534]:         /usr/lib/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000085fc8 sp=0xc000085fa8 pc=0x55980964d019
ollama[10534]: runtime.gcenable.gowrap2()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:205 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x5598096433c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x55980969f981
ollama[10534]: created by runtime.gcenable in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:205 +0xa5
ollama[10534]: goroutine 18 gp=0xc000102700 m=nil [finalizer wait]:
ollama[10534]: runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc000084688?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000084630 sp=0xc000084610 pc=0x559809697a0e
ollama[10534]: runtime.runfinq()
ollama[10534]:         /usr/lib/go/src/runtime/mfinal.go:196 +0x107 fp=0xc0000847e0 sp=0xc000084630 pc=0x5598096423e7
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000847e8 sp=0xc0000847e0 pc=0x55980969f981
ollama[10534]: created by runtime.createfing in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mfinal.go:166 +0x3d
ollama[10534]: goroutine 19 gp=0xc000103180 m=nil [chan receive]:
ollama[10534]: runtime.gopark(0xc00022b540?, 0xc000010030?, 0x60?, 0x7?, 0x55980977dfc8?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000080718 sp=0xc0000806f8 pc=0x559809697a0e
ollama[10534]: runtime.chanrecv(0xc000110310, 0x0, 0x1)
ollama[10534]:         /usr/lib/go/src/runtime/chan.go:664 +0x445 fp=0xc000080790 sp=0xc000080718 pc=0x5598096345e5
ollama[10534]: runtime.chanrecv1(0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/chan.go:506 +0x12 fp=0xc0000807b8 sp=0xc000080790 pc=0x559809634172
ollama[10534]: runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1796
ollama[10534]: runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1799 +0x2f fp=0xc0000807e0 sp=0xc0000807b8 pc=0x5598096465cf
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000807e8 sp=0xc0000807e0 pc=0x55980969f981
ollama[10534]: created by unique.runtime_registerUniqueMapCleanup in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1794 +0x85
ollama[10534]: goroutine 20 gp=0xc000103500 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000080f38 sp=0xc000080f18 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000080fc8 sp=0xc000080f38 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000080fe0 sp=0xc000080fc8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 34 gp=0xc000484000 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc00048a738 sp=0xc00048a718 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048a7c8 sp=0xc00048a738 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc00048a7e0 sp=0xc00048a7c8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048a7e8 sp=0xc00048a7e0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 5 gp=0xc000003a40 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000086738 sp=0xc000086718 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000867c8 sp=0xc000086738 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0000867e0 sp=0xc0000867c8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000867e8 sp=0xc0000867e0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 21 gp=0xc0001036c0 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000081738 sp=0xc000081718 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000817c8 sp=0xc000081738 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0000817e0 sp=0xc0000817c8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000817e8 sp=0xc0000817e0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 22 gp=0xc000103880 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000081f38 sp=0xc000081f18 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000081fc8 sp=0xc000081f38 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000081fe0 sp=0xc000081fc8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000081fe8 sp=0xc000081fe0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 23 gp=0xc000103a40 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000082738 sp=0xc000082718 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000827c8 sp=0xc000082738 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0000827e0 sp=0xc0000827c8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000827e8 sp=0xc0000827e0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 24 gp=0xc000103c00 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000082f38 sp=0xc000082f18 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000082fc8 sp=0xc000082f38 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000082fe0 sp=0xc000082fc8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000082fe8 sp=0xc000082fe0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 25 gp=0xc000103dc0 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000083738 sp=0xc000083718 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000837c8 sp=0xc000083738 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0000837e0 sp=0xc0000837c8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000837e8 sp=0xc0000837e0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 26 gp=0xc000500000 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000083f38 sp=0xc000083f18 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000083fc8 sp=0xc000083f38 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000083fe0 sp=0xc000083fc8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000083fe8 sp=0xc000083fe0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 27 gp=0xc0005001c0 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000486738 sp=0xc000486718 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0004867c8 sp=0xc000486738 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0004867e0 sp=0xc0004867c8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0004867e8 sp=0xc0004867e0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 6 gp=0xc000003c00 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0xc4b1d1cd97?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000086f38 sp=0xc000086f18 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000086fc8 sp=0xc000086f38 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000086fe0 sp=0xc000086fc8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000086fe8 sp=0xc000086fe0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 35 gp=0xc0004841c0 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0x55980b2acb80?, 0x1?, 0xf4?, 0x77?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc00048af38 sp=0xc00048af18 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048afc8 sp=0xc00048af38 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc00048afe0 sp=0xc00048afc8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048afe8 sp=0xc00048afe0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 28 gp=0xc000500380 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0xc4b1d15ed5?, 0x3?, 0xb2?, 0x47?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000486f38 sp=0xc000486f18 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000486fc8 sp=0xc000486f38 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000486fe0 sp=0xc000486fc8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000486fe8 sp=0xc000486fe0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 7 gp=0xc000003dc0 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0xc4b1d15c68?, 0x1?, 0xb0?, 0x6a?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000087738 sp=0xc000087718 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000877c8 sp=0xc000087738 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0000877e0 sp=0xc0000877c8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000877e8 sp=0xc0000877e0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 29 gp=0xc000500540 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0xc4b1d150f0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000487738 sp=0xc000487718 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0004877c8 sp=0xc000487738 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0004877e0 sp=0xc0004877c8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0004877e8 sp=0xc0004877e0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 36 gp=0xc000484380 m=nil [GC worker (idle)]:
ollama[10534]: runtime.gopark(0xc4b1d1510e?, 0x1?, 0x54?, 0xc4?, 0x0?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc00048b738 sp=0xc00048b718 pc=0x559809697a0e
ollama[10534]: runtime.gcBgMarkWorker(0xc000111730)
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048b7c8 sp=0xc00048b738 pc=0x5598096458e9
ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1()
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc00048b7e0 sp=0xc00048b7c8 pc=0x5598096457c5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048b7e8 sp=0xc00048b7e0 pc=0x55980969f981
ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama[10534]:         /usr/lib/go/src/runtime/mgc.go:1339 +0x105
ollama[10534]: goroutine 37 gp=0xc000500700 m=nil [select]:
ollama[10534]: runtime.gopark(0xc000047a00?, 0x2?, 0xe0?, 0x3a?, 0xc000047884?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000047698 sp=0xc000047678 pc=0x559809697a0e
ollama[10534]: runtime.selectgo(0xc000047a00, 0xc000047880, 0x4?, 0x0, 0x1?, 0x1)
ollama[10534]:         /usr/lib/go/src/runtime/select.go:351 +0x837 fp=0xc0000477d0 sp=0xc000047698 pc=0x559809676b37
ollama[10534]: github.com/ollama/ollama/runner/llamarunner.(*Server).completion(0xc0007b0360, {0x55980a98d2f8, 0xc0006caa80}, 0xc0004b03c0)
ollama[10534]:         /build/ollama/src/ollama/runner/llamarunner/runner.go:634 +0xb17 fp=0xc000047ac0 sp=0xc0000477d0 pc=0x559809ae7897
ollama[10534]: github.com/ollama/ollama/runner/llamarunner.(*Server).completion-fm({0x55980a98d2f8?, 0xc0006caa80?}, 0xc0004b7b40?)
ollama[10534]:         <autogenerated>:1 +0x36 fp=0xc000047af0 sp=0xc000047ac0 pc=0x559809aea776
ollama[10534]: net/http.HandlerFunc.ServeHTTP(0xc0000f7980?, {0x55980a98d2f8?, 0xc0006caa80?}, 0xc0004b7b60?)
ollama[10534]:         /usr/lib/go/src/net/http/server.go:2294 +0x29 fp=0xc000047b18 sp=0xc000047af0 pc=0x5598099970a9
ollama[10534]: net/http.(*ServeMux).ServeHTTP(0x55980963c905?, {0x55980a98d2f8, 0xc0006caa80}, 0xc0004b03c0)
ollama[10534]:         /usr/lib/go/src/net/http/server.go:2822 +0x1c4 fp=0xc000047b68 sp=0xc000047b18 pc=0x559809998fa4
ollama[10534]: net/http.serverHandler.ServeHTTP({0x55980a989990?}, {0x55980a98d2f8?, 0xc0006caa80?}, 0x1?)
ollama[10534]:         /usr/lib/go/src/net/http/server.go:3301 +0x8e fp=0xc000047b98 sp=0xc000047b68 pc=0x5598099b6a2e
ollama[10534]: net/http.(*conn).serve(0xc0004a8000, {0x55980a98f3a8, 0xc0007aec00})
ollama[10534]:         /usr/lib/go/src/net/http/server.go:2102 +0x625 fp=0xc000047fb8 sp=0xc000047b98 pc=0x5598099955a5
ollama[10534]: net/http.(*Server).Serve.gowrap3()
ollama[10534]:         /usr/lib/go/src/net/http/server.go:3454 +0x28 fp=0xc000047fe0 sp=0xc000047fb8 pc=0x55980999ae68
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x55980969f981
ollama[10534]: created by net/http.(*Server).Serve in goroutine 1
ollama[10534]:         /usr/lib/go/src/net/http/server.go:3454 +0x485
ollama[10534]: goroutine 40 gp=0xc000485180 m=nil [IO wait]:
ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0xb?)
ollama[10534]:         /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000487dd8 sp=0xc000487db8 pc=0x559809697a0e
ollama[10534]: runtime.netpollblock(0x5598096bb6d8?, 0x9631a06?, 0x98?)
ollama[10534]:         /usr/lib/go/src/runtime/netpoll.go:575 +0xf7 fp=0xc000487e10 sp=0xc000487dd8 pc=0x55980965d037
ollama[10534]: internal/poll.runtime_pollWait(0x7f654865ecc8, 0x72)
ollama[10534]:         /usr/lib/go/src/runtime/netpoll.go:351 +0x85 fp=0xc000487e30 sp=0xc000487e10 pc=0x559809696c25
ollama[10534]: internal/poll.(*pollDesc).wait(0xc0004a6000?, 0xc00049a101?, 0x0)
ollama[10534]:         /usr/lib/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000487e58 sp=0xc000487e30 pc=0x55980971f0a7
ollama[10534]: internal/poll.(*pollDesc).waitRead(...)
ollama[10534]:         /usr/lib/go/src/internal/poll/fd_poll_runtime.go:89
ollama[10534]: internal/poll.(*FD).Read(0xc0004a6000, {0xc00049a101, 0x1, 0x1})
ollama[10534]:         /usr/lib/go/src/internal/poll/fd_unix.go:165 +0x27a fp=0xc000487ef0 sp=0xc000487e58 pc=0x55980972039a
ollama[10534]: net.(*netFD).Read(0xc0004a6000, {0xc00049a101?, 0xc0006ae998?, 0xc000487f70?})
ollama[10534]:         /usr/lib/go/src/net/fd_posix.go:55 +0x25 fp=0xc000487f38 sp=0xc000487ef0 pc=0x5598097952e5
ollama[10534]: net.(*conn).Read(0xc00007a000, {0xc00049a101?, 0x0?, 0x0?})
ollama[10534]:         /usr/lib/go/src/net/net.go:194 +0x45 fp=0xc000487f80 sp=0xc000487f38 pc=0x5598097a36a5
ollama[10534]: net/http.(*connReader).backgroundRead(0xc00049a0f0)
ollama[10534]:         /usr/lib/go/src/net/http/server.go:690 +0x37 fp=0xc000487fc8 sp=0xc000487f80 pc=0x55980998f477
ollama[10534]: net/http.(*connReader).startBackgroundRead.gowrap2()
ollama[10534]:         /usr/lib/go/src/net/http/server.go:686 +0x25 fp=0xc000487fe0 sp=0xc000487fc8 pc=0x55980998f3a5
ollama[10534]: runtime.goexit({})
ollama[10534]:         /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000487fe8 sp=0xc000487fe0 pc=0x55980969f981
ollama[10534]: created by net/http.(*connReader).startBackgroundRead in goroutine 37
ollama[10534]:         /usr/lib/go/src/net/http/server.go:686 +0xb6
ollama[10534]: rax    0x0
ollama[10534]: rbx    0x29b4
ollama[10534]: rcx    0x7f65489ad624
ollama[10534]: rdx    0x6
ollama[10534]: rdi    0x29b4
ollama[10534]: rsi    0x29b4
ollama[10534]: rbp    0x7ffee45510f0
ollama[10534]: rsp    0x7ffee45510b0
ollama[10534]: r8     0x0
ollama[10534]: r9     0x0
ollama[10534]: r10    0x0
ollama[10534]: r11    0x246
ollama[10534]: r12    0x7f64ba8418b6
ollama[10534]: r13    0x7f64ba82e933
ollama[10534]: r14    0x6
ollama[10534]: r15    0x7f64ba82e933
ollama[10534]: rip    0x7f65489ad624
ollama[10534]: rflags 0x246
ollama[10534]: cs     0x33
ollama[10534]: fs     0x0
ollama[10534]: gs     0x0
ollama[10534]: [GIN] 2025/03/26 - 12:24:43 | 200 |  115.720429ms |       127.0.0.1 | POST     "/api/chat"
ollama[10534]: time=2025-03-26T12:24:43.421+01:00 level=ERROR source=server.go:449 msg="llama runner terminated" error="exit status 2"```
<!-- gh-comment-id:2754103644 --> @fatino commented on GitHub (Mar 26, 2025): I'm on arch. With ollama-rocm, linux-mainline 6.14 and latest mesa-git GPU started to get recognized by ollama. It loads models, but fails for any prompt(even for really small models): ```ollama[10534]: time=2025-03-26T12:24:42.495+01:00 level=INFO source=server.go:619 msg="llama runner started in 1.76 seconds" ollama[10534]: [GIN] 2025/03/26 - 12:24:42 | 200 | 1.92741022s | 127.0.0.1 | POST "/api/generate" ollama[10534]: ggml_cuda_compute_forward: RMS_NORM failed ollama[10534]: ROCm error: invalid device function ollama[10534]: current device: 0, in function ggml_cuda_compute_forward at /build/ollama/src/ollama/ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:2315 ollama[10534]: err ollama[10534]: /build/ollama/src/ollama/ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:73: ROCm error ollama[10534]: ptrace: Operacja niedozwolona. ollama[10534]: No stack. ollama[10534]: The program is not being run. ollama[10534]: SIGABRT: abort ollama[10534]: PC=0x7f65489ad624 m=0 sigcode=18446744073709551610 ollama[10534]: signal arrived during cgo execution ollama[10534]: goroutine 9 gp=0xc000484fc0 m=0 mp=0x55980b201240 [syscall]: ollama[10534]: runtime.cgocall(0x55980a308060, 0xc000091bc8) ollama[10534]: /usr/lib/go/src/runtime/cgocall.go:167 +0x4b fp=0xc000091ba0 sp=0xc000091b68 pc=0x55980969470b ollama[10534]: github.com/ollama/ollama/llama._Cfunc_llama_decode(0x7f64dc4b3ae0, {0x4, 0x7f64df181e20, 0x0, 0x0, 0x7f64dfdcac30, 0x7f64dfc63cd0, 0x7f64dfde5890, 0x7f64dfe0ba40}) ollama[10534]: _cgo_gotypes.go:578 +0x4a fp=0xc000091bc8 sp=0xc000091ba0 pc=0x559809a2d08a ollama[10534]: github.com/ollama/ollama/llama.(*Context).Decode.func1(...) ollama[10534]: /build/ollama/src/ollama/llama/llama.go:132 ollama[10534]: github.com/ollama/ollama/llama.(*Context).Decode(0xc00048ddd0?, 0x0?) ollama[10534]: /build/ollama/src/ollama/llama/llama.go:132 +0xf6 fp=0xc000091cc8 sp=0xc000091bc8 pc=0x559809a2fe36 ollama[10534]: github.com/ollama/ollama/runner/llamarunner.(*Server).processBatch(0xc0007b0360, 0xc0000ae660, 0xc00048df20) ollama[10534]: /build/ollama/src/ollama/runner/llamarunner/runner.go:436 +0x23e fp=0xc000091ee0 sp=0xc000091cc8 pc=0x559809ae5d9e ollama[10534]: github.com/ollama/ollama/runner/llamarunner.(*Server).run(0xc0007b0360, {0x55980a98f3e0, 0xc0006b15e0}) ollama[10534]: /build/ollama/src/ollama/runner/llamarunner/runner.go:344 +0x1d5 fp=0xc000091fb8 sp=0xc000091ee0 pc=0x559809ae59f5 ollama[10534]: github.com/ollama/ollama/runner/llamarunner.Execute.gowrap2() ollama[10534]: /build/ollama/src/ollama/runner/llamarunner/runner.go:887 +0x28 fp=0xc000091fe0 sp=0xc000091fb8 pc=0x559809aea348 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000091fe8 sp=0xc000091fe0 pc=0x55980969f981 ollama[10534]: created by github.com/ollama/ollama/runner/llamarunner.Execute in goroutine 1 ollama[10534]: /build/ollama/src/ollama/runner/llamarunner/runner.go:887 +0xcb7 ollama[10534]: goroutine 1 gp=0xc000002380 m=nil [IO wait]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc0004975f8 sp=0xc0004975d8 pc=0x559809697a0e ollama[10534]: runtime.netpollblock(0xc000497678?, 0x9631a06?, 0x98?) ollama[10534]: /usr/lib/go/src/runtime/netpoll.go:575 +0xf7 fp=0xc000497630 sp=0xc0004975f8 pc=0x55980965d037 ollama[10534]: internal/poll.runtime_pollWait(0x7f654865ede0, 0x72) ollama[10534]: /usr/lib/go/src/runtime/netpoll.go:351 +0x85 fp=0xc000497650 sp=0xc000497630 pc=0x559809696c25 ollama[10534]: internal/poll.(*pollDesc).wait(0xc0007ac580?, 0x55980963fbe6?, 0x0) ollama[10534]: /usr/lib/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000497678 sp=0xc000497650 pc=0x55980971f0a7 ollama[10534]: internal/poll.(*pollDesc).waitRead(...) ollama[10534]: /usr/lib/go/src/internal/poll/fd_poll_runtime.go:89 ollama[10534]: internal/poll.(*FD).Accept(0xc0007ac580) ollama[10534]: /usr/lib/go/src/internal/poll/fd_unix.go:620 +0x295 fp=0xc000497720 sp=0xc000497678 pc=0x559809724475 ollama[10534]: net.(*netFD).accept(0xc0007ac580) ollama[10534]: /usr/lib/go/src/net/fd_unix.go:172 +0x29 fp=0xc0004977d8 sp=0xc000497720 pc=0x559809797289 ollama[10534]: net.(*TCPListener).accept(0xc0000ad000) ollama[10534]: /usr/lib/go/src/net/tcpsock_posix.go:159 +0x1b fp=0xc000497828 sp=0xc0004977d8 pc=0x5598097acc3b ollama[10534]: net.(*TCPListener).Accept(0xc0000ad000) ollama[10534]: /usr/lib/go/src/net/tcpsock.go:380 +0x30 fp=0xc000497858 sp=0xc000497828 pc=0x5598097abaf0 ollama[10534]: net/http.(*onceCloseListener).Accept(0xc0004a8000?) ollama[10534]: <autogenerated>:1 +0x24 fp=0xc000497870 sp=0xc000497858 pc=0x5598099c31a4 ollama[10534]: net/http.(*Server).Serve(0xc000035200, {0x55980a98d118, 0xc0000ad000}) ollama[10534]: /usr/lib/go/src/net/http/server.go:3424 +0x30c fp=0xc0004979a0 sp=0xc000497870 pc=0x55980999aa6c ollama[10534]: github.com/ollama/ollama/runner/llamarunner.Execute({0xc000132020, 0xe, 0xe}) ollama[10534]: /build/ollama/src/ollama/runner/llamarunner/runner.go:907 +0x108a fp=0xc000497d08 sp=0xc0004979a0 pc=0x559809aea08a ollama[10534]: github.com/ollama/ollama/runner.Execute({0xc000132010?, 0x0?, 0x0?}) ollama[10534]: /build/ollama/src/ollama/runner/runner.go:22 +0xd4 fp=0xc000497d30 sp=0xc000497d08 pc=0x559809b4c7d4 ollama[10534]: github.com/ollama/ollama/cmd.NewCLI.func2(0xc000034f00?, {0x55980a501193?, 0x4?, 0x55980a501197?}) ollama[10534]: /build/ollama/src/ollama/cmd/cmd.go:1327 +0x45 fp=0xc000497d58 sp=0xc000497d30 pc=0x55980a29a445 ollama[10534]: github.com/spf13/cobra.(*Command).execute(0xc0007b2f08, {0xc0001ced20, 0xe, 0xe}) ollama[10534]: /build/ollama/src/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000497e78 sp=0xc000497d58 pc=0x5598098108dc ollama[10534]: github.com/spf13/cobra.(*Command).ExecuteC(0xc000783508) ollama[10534]: /build/ollama/src/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000497f30 sp=0xc000497e78 pc=0x559809811125 ollama[10534]: github.com/spf13/cobra.(*Command).Execute(...) ollama[10534]: /build/ollama/src/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 ollama[10534]: github.com/spf13/cobra.(*Command).ExecuteContext(...) ollama[10534]: /build/ollama/src/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 ollama[10534]: main.main() ollama[10534]: /build/ollama/src/ollama/main.go:12 +0x4d fp=0xc000497f50 sp=0xc000497f30 pc=0x55980a29a7ad ollama[10534]: runtime.main() ollama[10534]: /usr/lib/go/src/runtime/proc.go:283 +0x29d fp=0xc000497fe0 sp=0xc000497f50 pc=0x55980966463d ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000497fe8 sp=0xc000497fe0 pc=0x55980969f981 ollama[10534]: goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000084fa8 sp=0xc000084f88 pc=0x559809697a0e ollama[10534]: runtime.goparkunlock(...) ollama[10534]: /usr/lib/go/src/runtime/proc.go:441 ollama[10534]: runtime.forcegchelper() ollama[10534]: /usr/lib/go/src/runtime/proc.go:348 +0xb8 fp=0xc000084fe0 sp=0xc000084fa8 pc=0x559809664978 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000084fe8 sp=0xc000084fe0 pc=0x55980969f981 ollama[10534]: created by runtime.init.7 in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/proc.go:336 +0x1a ollama[10534]: goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]: ollama[10534]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000085780 sp=0xc000085760 pc=0x559809697a0e ollama[10534]: runtime.goparkunlock(...) ollama[10534]: /usr/lib/go/src/runtime/proc.go:441 ollama[10534]: runtime.bgsweep(0xc0000aa000) ollama[10534]: /usr/lib/go/src/runtime/mgcsweep.go:316 +0xdf fp=0xc0000857c8 sp=0xc000085780 pc=0x55980964f03f ollama[10534]: runtime.gcenable.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:204 +0x25 fp=0xc0000857e0 sp=0xc0000857c8 pc=0x559809643425 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000857e8 sp=0xc0000857e0 pc=0x55980969f981 ollama[10534]: created by runtime.gcenable in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:204 +0x66 ollama[10534]: goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]: ollama[10534]: runtime.gopark(0x10000?, 0x55980a6b8390?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000085f78 sp=0xc000085f58 pc=0x559809697a0e ollama[10534]: runtime.goparkunlock(...) ollama[10534]: /usr/lib/go/src/runtime/proc.go:441 ollama[10534]: runtime.(*scavengerState).park(0x55980b1fe420) ollama[10534]: /usr/lib/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000085fa8 sp=0xc000085f78 pc=0x55980964ca89 ollama[10534]: runtime.bgscavenge(0xc0000aa000) ollama[10534]: /usr/lib/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000085fc8 sp=0xc000085fa8 pc=0x55980964d019 ollama[10534]: runtime.gcenable.gowrap2() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:205 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x5598096433c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x55980969f981 ollama[10534]: created by runtime.gcenable in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:205 +0xa5 ollama[10534]: goroutine 18 gp=0xc000102700 m=nil [finalizer wait]: ollama[10534]: runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc000084688?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000084630 sp=0xc000084610 pc=0x559809697a0e ollama[10534]: runtime.runfinq() ollama[10534]: /usr/lib/go/src/runtime/mfinal.go:196 +0x107 fp=0xc0000847e0 sp=0xc000084630 pc=0x5598096423e7 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000847e8 sp=0xc0000847e0 pc=0x55980969f981 ollama[10534]: created by runtime.createfing in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mfinal.go:166 +0x3d ollama[10534]: goroutine 19 gp=0xc000103180 m=nil [chan receive]: ollama[10534]: runtime.gopark(0xc00022b540?, 0xc000010030?, 0x60?, 0x7?, 0x55980977dfc8?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000080718 sp=0xc0000806f8 pc=0x559809697a0e ollama[10534]: runtime.chanrecv(0xc000110310, 0x0, 0x1) ollama[10534]: /usr/lib/go/src/runtime/chan.go:664 +0x445 fp=0xc000080790 sp=0xc000080718 pc=0x5598096345e5 ollama[10534]: runtime.chanrecv1(0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/chan.go:506 +0x12 fp=0xc0000807b8 sp=0xc000080790 pc=0x559809634172 ollama[10534]: runtime.unique_runtime_registerUniqueMapCleanup.func2(...) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1796 ollama[10534]: runtime.unique_runtime_registerUniqueMapCleanup.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1799 +0x2f fp=0xc0000807e0 sp=0xc0000807b8 pc=0x5598096465cf ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000807e8 sp=0xc0000807e0 pc=0x55980969f981 ollama[10534]: created by unique.runtime_registerUniqueMapCleanup in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1794 +0x85 ollama[10534]: goroutine 20 gp=0xc000103500 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000080f38 sp=0xc000080f18 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000080fc8 sp=0xc000080f38 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000080fe0 sp=0xc000080fc8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 34 gp=0xc000484000 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc00048a738 sp=0xc00048a718 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048a7c8 sp=0xc00048a738 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc00048a7e0 sp=0xc00048a7c8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048a7e8 sp=0xc00048a7e0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 5 gp=0xc000003a40 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000086738 sp=0xc000086718 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000867c8 sp=0xc000086738 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0000867e0 sp=0xc0000867c8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000867e8 sp=0xc0000867e0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 21 gp=0xc0001036c0 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000081738 sp=0xc000081718 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000817c8 sp=0xc000081738 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0000817e0 sp=0xc0000817c8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000817e8 sp=0xc0000817e0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 22 gp=0xc000103880 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000081f38 sp=0xc000081f18 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000081fc8 sp=0xc000081f38 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000081fe0 sp=0xc000081fc8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000081fe8 sp=0xc000081fe0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 23 gp=0xc000103a40 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000082738 sp=0xc000082718 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000827c8 sp=0xc000082738 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0000827e0 sp=0xc0000827c8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000827e8 sp=0xc0000827e0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 24 gp=0xc000103c00 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000082f38 sp=0xc000082f18 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000082fc8 sp=0xc000082f38 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000082fe0 sp=0xc000082fc8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000082fe8 sp=0xc000082fe0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 25 gp=0xc000103dc0 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000083738 sp=0xc000083718 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000837c8 sp=0xc000083738 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0000837e0 sp=0xc0000837c8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000837e8 sp=0xc0000837e0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 26 gp=0xc000500000 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000083f38 sp=0xc000083f18 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000083fc8 sp=0xc000083f38 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000083fe0 sp=0xc000083fc8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000083fe8 sp=0xc000083fe0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 27 gp=0xc0005001c0 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000486738 sp=0xc000486718 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0004867c8 sp=0xc000486738 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0004867e0 sp=0xc0004867c8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0004867e8 sp=0xc0004867e0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 6 gp=0xc000003c00 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0xc4b1d1cd97?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000086f38 sp=0xc000086f18 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000086fc8 sp=0xc000086f38 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000086fe0 sp=0xc000086fc8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000086fe8 sp=0xc000086fe0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 35 gp=0xc0004841c0 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0x55980b2acb80?, 0x1?, 0xf4?, 0x77?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc00048af38 sp=0xc00048af18 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048afc8 sp=0xc00048af38 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc00048afe0 sp=0xc00048afc8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048afe8 sp=0xc00048afe0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 28 gp=0xc000500380 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0xc4b1d15ed5?, 0x3?, 0xb2?, 0x47?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000486f38 sp=0xc000486f18 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc000486fc8 sp=0xc000486f38 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc000486fe0 sp=0xc000486fc8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000486fe8 sp=0xc000486fe0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 7 gp=0xc000003dc0 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0xc4b1d15c68?, 0x1?, 0xb0?, 0x6a?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000087738 sp=0xc000087718 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000877c8 sp=0xc000087738 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0000877e0 sp=0xc0000877c8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000877e8 sp=0xc0000877e0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 29 gp=0xc000500540 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0xc4b1d150f0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000487738 sp=0xc000487718 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc0004877c8 sp=0xc000487738 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc0004877e0 sp=0xc0004877c8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0004877e8 sp=0xc0004877e0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 36 gp=0xc000484380 m=nil [GC worker (idle)]: ollama[10534]: runtime.gopark(0xc4b1d1510e?, 0x1?, 0x54?, 0xc4?, 0x0?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc00048b738 sp=0xc00048b718 pc=0x559809697a0e ollama[10534]: runtime.gcBgMarkWorker(0xc000111730) ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048b7c8 sp=0xc00048b738 pc=0x5598096458e9 ollama[10534]: runtime.gcBgMarkStartWorkers.gowrap1() ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x25 fp=0xc00048b7e0 sp=0xc00048b7c8 pc=0x5598096457c5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048b7e8 sp=0xc00048b7e0 pc=0x55980969f981 ollama[10534]: created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama[10534]: /usr/lib/go/src/runtime/mgc.go:1339 +0x105 ollama[10534]: goroutine 37 gp=0xc000500700 m=nil [select]: ollama[10534]: runtime.gopark(0xc000047a00?, 0x2?, 0xe0?, 0x3a?, 0xc000047884?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000047698 sp=0xc000047678 pc=0x559809697a0e ollama[10534]: runtime.selectgo(0xc000047a00, 0xc000047880, 0x4?, 0x0, 0x1?, 0x1) ollama[10534]: /usr/lib/go/src/runtime/select.go:351 +0x837 fp=0xc0000477d0 sp=0xc000047698 pc=0x559809676b37 ollama[10534]: github.com/ollama/ollama/runner/llamarunner.(*Server).completion(0xc0007b0360, {0x55980a98d2f8, 0xc0006caa80}, 0xc0004b03c0) ollama[10534]: /build/ollama/src/ollama/runner/llamarunner/runner.go:634 +0xb17 fp=0xc000047ac0 sp=0xc0000477d0 pc=0x559809ae7897 ollama[10534]: github.com/ollama/ollama/runner/llamarunner.(*Server).completion-fm({0x55980a98d2f8?, 0xc0006caa80?}, 0xc0004b7b40?) ollama[10534]: <autogenerated>:1 +0x36 fp=0xc000047af0 sp=0xc000047ac0 pc=0x559809aea776 ollama[10534]: net/http.HandlerFunc.ServeHTTP(0xc0000f7980?, {0x55980a98d2f8?, 0xc0006caa80?}, 0xc0004b7b60?) ollama[10534]: /usr/lib/go/src/net/http/server.go:2294 +0x29 fp=0xc000047b18 sp=0xc000047af0 pc=0x5598099970a9 ollama[10534]: net/http.(*ServeMux).ServeHTTP(0x55980963c905?, {0x55980a98d2f8, 0xc0006caa80}, 0xc0004b03c0) ollama[10534]: /usr/lib/go/src/net/http/server.go:2822 +0x1c4 fp=0xc000047b68 sp=0xc000047b18 pc=0x559809998fa4 ollama[10534]: net/http.serverHandler.ServeHTTP({0x55980a989990?}, {0x55980a98d2f8?, 0xc0006caa80?}, 0x1?) ollama[10534]: /usr/lib/go/src/net/http/server.go:3301 +0x8e fp=0xc000047b98 sp=0xc000047b68 pc=0x5598099b6a2e ollama[10534]: net/http.(*conn).serve(0xc0004a8000, {0x55980a98f3a8, 0xc0007aec00}) ollama[10534]: /usr/lib/go/src/net/http/server.go:2102 +0x625 fp=0xc000047fb8 sp=0xc000047b98 pc=0x5598099955a5 ollama[10534]: net/http.(*Server).Serve.gowrap3() ollama[10534]: /usr/lib/go/src/net/http/server.go:3454 +0x28 fp=0xc000047fe0 sp=0xc000047fb8 pc=0x55980999ae68 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x55980969f981 ollama[10534]: created by net/http.(*Server).Serve in goroutine 1 ollama[10534]: /usr/lib/go/src/net/http/server.go:3454 +0x485 ollama[10534]: goroutine 40 gp=0xc000485180 m=nil [IO wait]: ollama[10534]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0xb?) ollama[10534]: /usr/lib/go/src/runtime/proc.go:435 +0xce fp=0xc000487dd8 sp=0xc000487db8 pc=0x559809697a0e ollama[10534]: runtime.netpollblock(0x5598096bb6d8?, 0x9631a06?, 0x98?) ollama[10534]: /usr/lib/go/src/runtime/netpoll.go:575 +0xf7 fp=0xc000487e10 sp=0xc000487dd8 pc=0x55980965d037 ollama[10534]: internal/poll.runtime_pollWait(0x7f654865ecc8, 0x72) ollama[10534]: /usr/lib/go/src/runtime/netpoll.go:351 +0x85 fp=0xc000487e30 sp=0xc000487e10 pc=0x559809696c25 ollama[10534]: internal/poll.(*pollDesc).wait(0xc0004a6000?, 0xc00049a101?, 0x0) ollama[10534]: /usr/lib/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000487e58 sp=0xc000487e30 pc=0x55980971f0a7 ollama[10534]: internal/poll.(*pollDesc).waitRead(...) ollama[10534]: /usr/lib/go/src/internal/poll/fd_poll_runtime.go:89 ollama[10534]: internal/poll.(*FD).Read(0xc0004a6000, {0xc00049a101, 0x1, 0x1}) ollama[10534]: /usr/lib/go/src/internal/poll/fd_unix.go:165 +0x27a fp=0xc000487ef0 sp=0xc000487e58 pc=0x55980972039a ollama[10534]: net.(*netFD).Read(0xc0004a6000, {0xc00049a101?, 0xc0006ae998?, 0xc000487f70?}) ollama[10534]: /usr/lib/go/src/net/fd_posix.go:55 +0x25 fp=0xc000487f38 sp=0xc000487ef0 pc=0x5598097952e5 ollama[10534]: net.(*conn).Read(0xc00007a000, {0xc00049a101?, 0x0?, 0x0?}) ollama[10534]: /usr/lib/go/src/net/net.go:194 +0x45 fp=0xc000487f80 sp=0xc000487f38 pc=0x5598097a36a5 ollama[10534]: net/http.(*connReader).backgroundRead(0xc00049a0f0) ollama[10534]: /usr/lib/go/src/net/http/server.go:690 +0x37 fp=0xc000487fc8 sp=0xc000487f80 pc=0x55980998f477 ollama[10534]: net/http.(*connReader).startBackgroundRead.gowrap2() ollama[10534]: /usr/lib/go/src/net/http/server.go:686 +0x25 fp=0xc000487fe0 sp=0xc000487fc8 pc=0x55980998f3a5 ollama[10534]: runtime.goexit({}) ollama[10534]: /usr/lib/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000487fe8 sp=0xc000487fe0 pc=0x55980969f981 ollama[10534]: created by net/http.(*connReader).startBackgroundRead in goroutine 37 ollama[10534]: /usr/lib/go/src/net/http/server.go:686 +0xb6 ollama[10534]: rax 0x0 ollama[10534]: rbx 0x29b4 ollama[10534]: rcx 0x7f65489ad624 ollama[10534]: rdx 0x6 ollama[10534]: rdi 0x29b4 ollama[10534]: rsi 0x29b4 ollama[10534]: rbp 0x7ffee45510f0 ollama[10534]: rsp 0x7ffee45510b0 ollama[10534]: r8 0x0 ollama[10534]: r9 0x0 ollama[10534]: r10 0x0 ollama[10534]: r11 0x246 ollama[10534]: r12 0x7f64ba8418b6 ollama[10534]: r13 0x7f64ba82e933 ollama[10534]: r14 0x6 ollama[10534]: r15 0x7f64ba82e933 ollama[10534]: rip 0x7f65489ad624 ollama[10534]: rflags 0x246 ollama[10534]: cs 0x33 ollama[10534]: fs 0x0 ollama[10534]: gs 0x0 ollama[10534]: [GIN] 2025/03/26 - 12:24:43 | 200 | 115.720429ms | 127.0.0.1 | POST "/api/chat" ollama[10534]: time=2025-03-26T12:24:43.421+01:00 level=ERROR source=server.go:449 msg="llama runner terminated" error="exit status 2"```
GiteaMirror commented 2026-04-12 17:42:58 -05:00
Author
Owner
Copy Link

@hnedelciuc commented on GitHub (Mar 30, 2025):

I have a Ryzen 9 7950X, 64GB RAM system running Windows 11 and Ollama 0.6.3 for Windows. I have two AMD Radeon cards, a RX 6950XT and a 9070XT (both have 16GB of VRAM) and I am running a single model (70b parameter llama3.3) and it fills up the system RAM completely and the 6950XT VRAM completely and it runs on the CPU and the 6950XT, but it does not use at all the 9070XT (no VRAM and no compute on this one). I am checking the usage with Task Manager. How can I make it use both GPUs (their compute and VRAM first preferably) and only then spill over to the system RAM and CPU for the rest of the load? Thanks.

<!-- gh-comment-id:2764793325 --> @hnedelciuc commented on GitHub (Mar 30, 2025): I have a Ryzen 9 7950X, 64GB RAM system running Windows 11 and Ollama 0.6.3 for Windows. I have two AMD Radeon cards, a RX 6950XT and a 9070XT (both have 16GB of VRAM) and I am running a single model (70b parameter llama3.3) and it fills up the system RAM completely and the 6950XT VRAM completely and it runs on the CPU and the 6950XT, but it does not use at all the 9070XT (no VRAM and no compute on this one). I am checking the usage with Task Manager. How can I make it use both GPUs (their compute and VRAM first preferably) and only then spill over to the system RAM and CPU for the rest of the load? Thanks.
GiteaMirror commented 2026-04-12 17:42:59 -05:00
Author
Owner
Copy Link

@XXLumin commented on GitHub (Mar 31, 2025):

I have a Ryzen 9 7950X, 64GB RAM system running Windows 11 and Ollama 0.6.3 for Windows. I have two AMD Radeon cards, a RX 6950XT and a 9070XT (both have 16GB of VRAM) and I am running a single model (70b parameter llama3.3) and it fills up the system RAM completely and the 6950XT VRAM completely and it runs on the CPU and the 6950XT, but it does not use at all the 9070XT (no VRAM and no compute on this one). I am checking the usage with Task Manager. How can I make it use both GPUs (their compute and VRAM first preferably) and only then spill over to the system RAM and CPU for the rest of the load? Thanks.我有一个搭载 Ryzen 9 7950X、64GB RAM 的系统，运行 Windows 11 和 Ollama 0.6.3 for Windows。我有两张 AMD Radeon 显卡，分别是 RX 6950XT 和 9070XT（两者都有 16GB 的 VRAM），我正在运行一个单一模型（70b 参数的 llama3.3），它完全填满了系统 RAM 和 6950XT 的 VRAM，并在 CPU 和 6950XT 上运行，但完全没有使用 9070XT（这个没有 VRAM 和计算）。我正在使用任务管理器检查使用情况。我该如何让它使用两个 GPU（优先使用它们的计算和 VRAM）？然后再将剩余负载溢出到系统 RAM 和 CPU？谢谢。

I saw your reply on Support Multiple GPU? #9810 . I use both 9070xt and 9070 cards running on Ollama. If you want to use the latest Radeon cards for AI usage, must download a docker for running a virtual environment since it doesn't support on Windows but Linux till now. Then try to pull ROCm 6.3.1+ on docker to use them for LLM. Although I'm struggling to cross-fire those two Redeon cards, at least one of them is running deepseek-r1:14b well. Hoping Ollama updates support on Windows asap, I saw someone on Reddit said they merged a version to support 9070 on Win. So rather we wait, or work together to solve a problem that will be no longer exist in near future.

<!-- gh-comment-id:2767219885 --> @XXLumin commented on GitHub (Mar 31, 2025): > I have a Ryzen 9 7950X, 64GB RAM system running Windows 11 and Ollama 0.6.3 for Windows. I have two AMD Radeon cards, a RX 6950XT and a 9070XT (both have 16GB of VRAM) and I am running a single model (70b parameter llama3.3) and it fills up the system RAM completely and the 6950XT VRAM completely and it runs on the CPU and the 6950XT, but it does not use at all the 9070XT (no VRAM and no compute on this one). I am checking the usage with Task Manager. How can I make it use both GPUs (their compute and VRAM first preferably) and only then spill over to the system RAM and CPU for the rest of the load? Thanks.我有一个搭载 Ryzen 9 7950X、64GB RAM 的系统，运行 Windows 11 和 Ollama 0.6.3 for Windows。我有两张 AMD Radeon 显卡，分别是 RX 6950XT 和 9070XT（两者都有 16GB 的 VRAM），我正在运行一个单一模型（70b 参数的 llama3.3），它完全填满了系统 RAM 和 6950XT 的 VRAM，并在 CPU 和 6950XT 上运行，但完全没有使用 9070XT（这个没有 VRAM 和计算）。我正在使用任务管理器检查使用情况。我该如何让它使用两个 GPU（优先使用它们的计算和 VRAM）？然后再将剩余负载溢出到系统 RAM 和 CPU？谢谢。 I saw your reply on [Support Multiple GPU?](https://github.com/ollama/ollama/issues/9810#top) #9810 . I use both 9070xt and 9070 cards running on Ollama. If you want to use the latest Radeon cards for AI usage, must download a docker for running a virtual environment since it doesn't support on Windows but Linux till now. Then try to pull ROCm 6.3.1+ on docker to use them for LLM. Although I'm struggling to cross-fire those two Redeon cards, at least one of them is running deepseek-r1:14b well. Hoping Ollama updates support on Windows asap, I saw someone on Reddit said they merged a version to support 9070 on Win. So rather we wait, or work together to solve a problem that will be no longer exist in near future.
GiteaMirror commented 2026-04-12 17:42:59 -05:00
Author
Owner
Copy Link

@nphalem commented on GitHub (Apr 8, 2025):

Error from ollama:

error="amdgpu version file missing: /sys/module/amdgpu/version stat /sys/module/amdgpu/version: no such file or directory"

But on newer driver versions it's /sys/module/amdgpu/srcversion.

lspci -k | grep -A 3 -E "(VGA|3D)"
0a:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 48 [RX 9070/9070 XT] (rev c0)
        Subsystem: ASRock Incorporation Device 5401
        Kernel driver in use: amdgpu
        Kernel modules: amdgpu

I'm on arch 6.14.0-arch1-1 with latest mesa drivers.

<!-- gh-comment-id:2785566527 --> @nphalem commented on GitHub (Apr 8, 2025): Error from ollama: ```sh error="amdgpu version file missing: /sys/module/amdgpu/version stat /sys/module/amdgpu/version: no such file or directory" ``` But on newer driver versions it's `/sys/module/amdgpu/srcversion`. ```shell-session lspci -k | grep -A 3 -E "(VGA|3D)" 0a:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 48 [RX 9070/9070 XT] (rev c0) Subsystem: ASRock Incorporation Device 5401 Kernel driver in use: amdgpu Kernel modules: amdgpu ``` I'm on arch 6.14.0-arch1-1 with latest mesa drivers.
GiteaMirror commented 2026-04-12 17:42:59 -05:00
Author
Owner
Copy Link

@AdamBullen commented on GitHub (Apr 8, 2025):

I have mine working on Linux Mint; I upgraded to the 6.14 kernel, upgraded to Ollama 0.6.4 (latest at the time), I'm running 0.6.5 now.

Critically; I had to remove the version of ROCm that I had manually installed in the last couple of weeks when trying to get my 9070 working with kernel 6.11.

Note I'm running Mint 22.1

<!-- gh-comment-id:2787373017 --> @AdamBullen commented on GitHub (Apr 8, 2025): I have mine working on Linux Mint; I upgraded to the 6.14 kernel, upgraded to Ollama 0.6.4 (latest at the time), I'm running 0.6.5 now. Critically; I had to remove the version of ROCm that I had manually installed in the last couple of weeks when trying to get my 9070 working with kernel 6.11. Note I'm running Mint 22.1
GiteaMirror commented 2026-04-12 17:43:00 -05:00
Author
Owner
Copy Link

@BloodyIron commented on GitHub (Jun 26, 2025):

Maybe time to close this thread?

<!-- gh-comment-id:3009741080 --> @BloodyIron commented on GitHub (Jun 26, 2025): Maybe time to close this thread?
GiteaMirror commented 2026-04-12 17:43:00 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (Jul 5, 2025):

Linux support has been merged for a while. Windows support is still waiting on the ROCm 6.4 release on Windows. PR #10676 can be unblocked once that's available. We're tracking windows support in #10430

<!-- gh-comment-id:3040194449 --> @dhiltgen commented on GitHub (Jul 5, 2025): Linux support has been merged for a while. Windows support is still waiting on the ROCm 6.4 release on Windows. PR #10676 can be unblocked once that's available. We're tracking windows support in #10430
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#6287
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?