[GH-ISSUE #10033] HSA_OVERRIDE_GFX_VERSION for individual GPU's required #68636

Open
opened 2026-05-04 14:40:42 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @colin-stubbs on GitHub (Mar 29, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10033

ollama only supports HSA_OVERRIDE_GFX_VERSION for all GPU's

rocm supports HSA_OVERRIDE_GFX_VERSION_%n for individual GPU support

Supported added to ROCm here: https://github.com/ROCm/ROCT-Thunk-Interface/pull/104

ROCm now supports independent overrides per GPU by setting HSA_OVERRIDE_GFX_VERSION_%n environment variables.

e.g. HSA_OVERRIDE_GFX_VERSION_1=10.3.0 would force gfx1030 on GPU 1, while GPU 0 would utilise auto-detection for supported gfx version.

From my testing Ollama can easily support this with minimal changes.

This has previously been brought up in https://github.com/ollama/ollama/issues/8473

Originally created by @colin-stubbs on GitHub (Mar 29, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10033 ollama only supports HSA_OVERRIDE_GFX_VERSION for all GPU's rocm supports HSA_OVERRIDE_GFX_VERSION_%n for individual GPU support Supported added to ROCm here: https://github.com/ROCm/ROCT-Thunk-Interface/pull/104 ROCm now supports independent overrides per GPU by setting HSA_OVERRIDE_GFX_VERSION_%n environment variables. e.g. HSA_OVERRIDE_GFX_VERSION_1=10.3.0 would force gfx1030 on GPU 1, while GPU 0 would utilise auto-detection for supported gfx version. From my testing Ollama can easily support this with minimal changes. This has previously been brought up in https://github.com/ollama/ollama/issues/8473
GiteaMirror added the feature request label 2026-05-04 14:40:42 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#68636