[PR #4264] [MERGED] Centralize GPU configuration vars #21969

Closed
opened 2026-04-19 15:59:29 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/4264
Author: @dhiltgen
Created: 5/8/2024
Status: Merged
Merged: 6/15/2024
Merged by: @dhiltgen

Base: mainHead: show_gpu_visible_settings


📝 Commits (1)

  • 6be309e Centralize GPU configuration vars

📊 Changes

3 files changed (+33 additions, -6 deletions)

View changed files

📝 envconfig/config.go (+26 -1)
📝 gpu/amd_linux.go (+5 -4)
📝 gpu/amd_windows.go (+2 -1)

📄 Description

This should aid in troubleshooting by capturing and reporting the GPU settings at startup in the logs along with all the other server settings.

Fixes #4139

Example output setting the ROCm gfx override:

2024/05/08 19:33:27 routes.go:993: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION:10.3.0 OLLAMA_DEBUG:true OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:*] OLLAMA_RUNNERS_DIR: OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]"

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/4264 **Author:** [@dhiltgen](https://github.com/dhiltgen) **Created:** 5/8/2024 **Status:** ✅ Merged **Merged:** 6/15/2024 **Merged by:** [@dhiltgen](https://github.com/dhiltgen) **Base:** `main` ← **Head:** `show_gpu_visible_settings` --- ### 📝 Commits (1) - [`6be309e`](https://github.com/ollama/ollama/commit/6be309e1bd8a7fde936853c8981779df5b918e01) Centralize GPU configuration vars ### 📊 Changes **3 files changed** (+33 additions, -6 deletions) <details> <summary>View changed files</summary> 📝 `envconfig/config.go` (+26 -1) 📝 `gpu/amd_linux.go` (+5 -4) 📝 `gpu/amd_windows.go` (+2 -1) </details> ### 📄 Description This should aid in troubleshooting by capturing and reporting the GPU settings at startup in the logs along with all the other server settings. Fixes #4139 Example output setting the ROCm gfx override: ``` 2024/05/08 19:33:27 routes.go:993: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION:10.3.0 OLLAMA_DEBUG:true OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:*] OLLAMA_RUNNERS_DIR: OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]" ``` --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-19 15:59:29 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#21969