[GH-ISSUE #9143] Ollama fails because it is not part of the vglusers group #52459

New Issue

GiteaMirror · 2026-04-28T23:24:16-05:00

GiteaMirror commented

2026-04-28 23:24:16 -05:00

Originally created by @songzijiang on GitHub (Feb 15, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9143

What is the issue?

I can use the GPUs correct before I reinstall the Nvidia driver. Now, the nvidia-smi and nvcc -V is right

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:33:58_PDT_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0

Sun Feb 16 02:33:34 2025       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 570.86.16              Driver Version: 570.86.16      CUDA Version: 12.8     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA RTX 6000 Ada Gene...    Off |   00000000:21:00.0 Off |                  Off |
| 30%   39C    P0             63W /  300W |       1MiB /  49140MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
|   1  NVIDIA RTX 6000 Ada Gene...    Off |   00000000:41:00.0 Off |                  Off |
| 30%   41C    P0             62W /  300W |       1MiB /  49140MiB |      2%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
|   2  NVIDIA RTX 6000 Ada Gene...    Off |   00000000:81:00.0 Off |                  Off |
| 30%   36C    P0             67W /  300W |       1MiB /  49140MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
|   3  NVIDIA RTX 6000 Ada Gene...    Off |   00000000:A1:00.0 Off |                  Off |
| 30%   35C    P0             57W /  300W |       1MiB /  49140MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+

and the log of ollama is

Feb 16 02:27:36 sms-ubuntu systemd[1]: Started Ollama Service.
Feb 16 02:27:36 sms-ubuntu ollama[179286]: 2025/02/16 02:27:36 routes.go:1186: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVE>
Feb 16 02:27:36 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:36.964+08:00 level=INFO source=images.go:432 msg="total blobs: 11"
Feb 16 02:27:36 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:36.965+08:00 level=INFO source=images.go:439 msg="total unused blobs removed: 0"
Feb 16 02:27:36 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:36.965+08:00 level=INFO source=routes.go:1237 msg="Listening on 127.0.0.1:11434 (version 0.5.11)"
Feb 16 02:27:36 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:36.966+08:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
Feb 16 02:27:37 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:37.001+08:00 level=INFO source=gpu.go:602 msg="no nvidia devices detected by library /usr/lib/x86_64-linux-gnu/l>
Feb 16 02:27:37 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:37.011+08:00 level=INFO source=gpu.go:377 msg="no compatible GPUs were discovered"
Feb 16 02:27:37 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:37.011+08:00 level=INFO source=types.go:130 msg="inference compute" id=0 library=cpu variant="" compute="" drive>
Feb 16 02:27:58 sms-ubuntu ollama[179286]: [GIN] 2025/02/16 - 02:27:58 | 200 |     408.159µs |       127.0.0.1 | HEAD     "/"
Feb 16 02:27:58 sms-ubuntu ollama[179286]: [GIN] 2025/02/16 - 02:27:58 | 200 |   13.803036ms |       127.0.0.1 | POST     "/api/show"
Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.013+08:00 level=INFO source=server.go:100 msg="system memory" total="1511.5 GiB" free="1475.6 GiB" free_swap=>
Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.013+08:00 level=INFO source=memory.go:356 msg="offload to cpu" layers.requested=-1 layers.model=29 layers.off>
Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.014+08:00 level=INFO source=server.go:380 msg="starting llama server" cmd="/usr/bin/ollama runner --model /us>
Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.014+08:00 level=INFO source=sched.go:449 msg="loaded runners" count=1
Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.014+08:00 level=INFO source=server.go:557 msg="waiting for llama runner to start responding"
Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.015+08:00 level=INFO source=server.go:591 msg="waiting for server to become available" status="llm server err>
Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.051+08:00 level=INFO source=runner.go:936 msg="starting go runner"
Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.051+08:00 level=INFO source=runner.go:937 msg=system info="CPU : LLAMAFILE = 1 | CPU : LLAMAFILE = 1 | cgo(gc>
Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.051+08:00 level=INFO source=runner.go:995 msg="Server listening on 127.0.0.1:42679"
Feb 16 02:27:59 sms-ubuntu ollama[179286]: load_backend: loaded CPU backend from /usr/lib/ollama/libggml-cpu-icelake.so
Feb 16 02:27:59 sms-ubuntu ollama[179286]: llama_model_loader: loaded meta data with 26 key-value pairs and 339 tensors from /usr/share/ollama/.ollama/models/blobs/sha256-96c415>
Feb 16 02:27:59 sms-ubuntu ollama[179286]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.

What's wrong with my machine?

Relevant log output

OS

Linux

GPU

Nvidia

CPU

AMD

Ollama version

0.5.11

Originally created by @songzijiang on GitHub (Feb 15, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9143 ### What is the issue? I can use the GPUs correct before I reinstall the Nvidia driver. Now, the nvidia-smi and nvcc -V is right ``` nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2022 NVIDIA Corporation Built on Wed_Sep_21_10:33:58_PDT_2022 Cuda compilation tools, release 11.8, V11.8.89 Build cuda_11.8.r11.8/compiler.31833905_0 ``` ``` Sun Feb 16 02:33:34 2025 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 570.86.16 Driver Version: 570.86.16 CUDA Version: 12.8 | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA RTX 6000 Ada Gene... Off | 00000000:21:00.0 Off | Off | | 30% 39C P0 63W / 300W | 1MiB / 49140MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ | 1 NVIDIA RTX 6000 Ada Gene... Off | 00000000:41:00.0 Off | Off | | 30% 41C P0 62W / 300W | 1MiB / 49140MiB | 2% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ | 2 NVIDIA RTX 6000 Ada Gene... Off | 00000000:81:00.0 Off | Off | | 30% 36C P0 67W / 300W | 1MiB / 49140MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ | 3 NVIDIA RTX 6000 Ada Gene... Off | 00000000:A1:00.0 Off | Off | | 30% 35C P0 57W / 300W | 1MiB / 49140MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | No running processes found | +-----------------------------------------------------------------------------------------+ ``` and the log of ollama is ``` Feb 16 02:27:36 sms-ubuntu systemd[1]: Started Ollama Service. Feb 16 02:27:36 sms-ubuntu ollama[179286]: 2025/02/16 02:27:36 routes.go:1186: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVE> Feb 16 02:27:36 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:36.964+08:00 level=INFO source=images.go:432 msg="total blobs: 11" Feb 16 02:27:36 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:36.965+08:00 level=INFO source=images.go:439 msg="total unused blobs removed: 0" Feb 16 02:27:36 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:36.965+08:00 level=INFO source=routes.go:1237 msg="Listening on 127.0.0.1:11434 (version 0.5.11)" Feb 16 02:27:36 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:36.966+08:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs" Feb 16 02:27:37 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:37.001+08:00 level=INFO source=gpu.go:602 msg="no nvidia devices detected by library /usr/lib/x86_64-linux-gnu/l> Feb 16 02:27:37 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:37.011+08:00 level=INFO source=gpu.go:377 msg="no compatible GPUs were discovered" Feb 16 02:27:37 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:37.011+08:00 level=INFO source=types.go:130 msg="inference compute" id=0 library=cpu variant="" compute="" drive> Feb 16 02:27:58 sms-ubuntu ollama[179286]: [GIN] 2025/02/16 - 02:27:58 | 200 | 408.159µs | 127.0.0.1 | HEAD "/" Feb 16 02:27:58 sms-ubuntu ollama[179286]: [GIN] 2025/02/16 - 02:27:58 | 200 | 13.803036ms | 127.0.0.1 | POST "/api/show" Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.013+08:00 level=INFO source=server.go:100 msg="system memory" total="1511.5 GiB" free="1475.6 GiB" free_swap=> Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.013+08:00 level=INFO source=memory.go:356 msg="offload to cpu" layers.requested=-1 layers.model=29 layers.off> Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.014+08:00 level=INFO source=server.go:380 msg="starting llama server" cmd="/usr/bin/ollama runner --model /us> Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.014+08:00 level=INFO source=sched.go:449 msg="loaded runners" count=1 Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.014+08:00 level=INFO source=server.go:557 msg="waiting for llama runner to start responding" Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.015+08:00 level=INFO source=server.go:591 msg="waiting for server to become available" status="llm server err> Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.051+08:00 level=INFO source=runner.go:936 msg="starting go runner" Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.051+08:00 level=INFO source=runner.go:937 msg=system info="CPU : LLAMAFILE = 1 | CPU : LLAMAFILE = 1 | cgo(gc> Feb 16 02:27:59 sms-ubuntu ollama[179286]: time=2025-02-16T02:27:59.051+08:00 level=INFO source=runner.go:995 msg="Server listening on 127.0.0.1:42679" Feb 16 02:27:59 sms-ubuntu ollama[179286]: load_backend: loaded CPU backend from /usr/lib/ollama/libggml-cpu-icelake.so Feb 16 02:27:59 sms-ubuntu ollama[179286]: llama_model_loader: loaded meta data with 26 key-value pairs and 339 tensors from /usr/share/ollama/.ollama/models/blobs/sha256-96c415> Feb 16 02:27:59 sms-ubuntu ollama[179286]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. ``` What's wrong with my machine? ### Relevant log output ```shell ``` ### OS Linux ### GPU Nvidia ### CPU AMD ### Ollama version 0.5.11

GiteaMirror added the bug label 2026-04-28 23:24:16 -05:00

GiteaMirror commented

2026-04-28 23:24:17 -05:00

@songzijiang commented on GitHub (Feb 15, 2025):

I used ollama as a service and the service config is

[Unit]
Description=Ollama Service
After=network-online.target

[Service]
ExecStart=/usr/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="OLLAMA_HOST=0.0.0.0"
Environment="OLLAMA_ORIGINS=*"

[Install]
WantedBy=default.target

@songzijiang commented on GitHub (Feb 15, 2025): I used ollama as a service and the service config is ``` [Unit] Description=Ollama Service After=network-online.target [Service] ExecStart=/usr/bin/ollama serve User=ollama Group=ollama Restart=always RestartSec=3 Environment="OLLAMA_HOST=0.0.0.0" Environment="OLLAMA_ORIGINS=*" [Install] WantedBy=default.target ```

GiteaMirror commented

2026-04-28 23:24:17 -05:00

@jmorganca commented on GitHub (Feb 15, 2025):

Hi there, does restarting your machine help? Sometimes when reinstalling the drivers there are issues discovering GPUs. Sorry about this

@jmorganca commented on GitHub (Feb 15, 2025): Hi there, does restarting your machine help? Sometimes when reinstalling the drivers there are issues discovering GPUs. Sorry about this

GiteaMirror commented

2026-04-28 23:24:18 -05:00

@songzijiang commented on GitHub (Feb 15, 2025):

Hi there, does restarting your machine help? Sometimes when reinstalling the drivers there are issues discovering GPUs. Sorry about this

Yes, I have rebooted the machine, and still can't use gpus. It is so confused. Maybe some environment is wrong leads to this results？

@songzijiang commented on GitHub (Feb 15, 2025): > Hi there, does restarting your machine help? Sometimes when reinstalling the drivers there are issues discovering GPUs. Sorry about this Yes, I have rebooted the machine, and still can't use gpus. It is so confused. Maybe some environment is wrong leads to this results？

GiteaMirror commented

2026-04-28 23:24:18 -05:00

@jmorganca commented on GitHub (Feb 15, 2025):

Sorry about that – do you have the full logs – journalctl by default will cut off horizontally? journalctl -u ollama --no-pager should do it. Thanks so much

@jmorganca commented on GitHub (Feb 15, 2025): Sorry about that – do you have the full logs – `journalctl` by default will cut off horizontally? `journalctl -u ollama --no-pager` should do it. Thanks so much

GiteaMirror commented

2026-04-28 23:24:18 -05:00

@songzijiang commented on GitHub (Feb 16, 2025):

Sorry about that – do you have the full logs – journalctl by default will cut off horizontally? journalctl -u ollama --no-pager should do it. Thanks so much

Sure, here is the full log

Feb 16 13:10:05 sms-ubuntu systemd[1]: Started Ollama Service.
Feb 16 13:10:05 sms-ubuntu ollama[435235]: 2025/02/16 13:10:05 routes.go:1186: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/usr/share/ollama/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[* http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.883+08:00 level=INFO source=images.go:432 msg="total blobs: 11"
Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.883+08:00 level=INFO source=images.go:439 msg="total unused blobs removed: 0"
Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.883+08:00 level=INFO source=routes.go:1237 msg="Listening on [::]:11434 (version 0.5.11)"
Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.883+08:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.901+08:00 level=INFO source=gpu.go:602 msg="no nvidia devices detected by library /usr/lib/x86_64-linux-gnu/libcuda.so.570.86.16"
Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.912+08:00 level=INFO source=gpu.go:377 msg="no compatible GPUs were discovered"
Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.912+08:00 level=INFO source=types.go:130 msg="inference compute" id=0 library=cpu variant="" compute="" driver=0.0 name="" total="1511.5 GiB" available="1459.0 GiB"

@songzijiang commented on GitHub (Feb 16, 2025): > Sorry about that – do you have the full logs – `journalctl` by default will cut off horizontally? `journalctl -u ollama --no-pager` should do it. Thanks so much Sure, here is the full log ``` Feb 16 13:10:05 sms-ubuntu systemd[1]: Started Ollama Service. Feb 16 13:10:05 sms-ubuntu ollama[435235]: 2025/02/16 13:10:05 routes.go:1186: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/usr/share/ollama/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[* http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.883+08:00 level=INFO source=images.go:432 msg="total blobs: 11" Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.883+08:00 level=INFO source=images.go:439 msg="total unused blobs removed: 0" Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.883+08:00 level=INFO source=routes.go:1237 msg="Listening on [::]:11434 (version 0.5.11)" Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.883+08:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs" Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.901+08:00 level=INFO source=gpu.go:602 msg="no nvidia devices detected by library /usr/lib/x86_64-linux-gnu/libcuda.so.570.86.16" Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.912+08:00 level=INFO source=gpu.go:377 msg="no compatible GPUs were discovered" Feb 16 13:10:05 sms-ubuntu ollama[435235]: time=2025-02-16T13:10:05.912+08:00 level=INFO source=types.go:130 msg="inference compute" id=0 library=cpu variant="" compute="" driver=0.0 name="" total="1511.5 GiB" available="1459.0 GiB" ```

GiteaMirror commented

2026-04-28 23:24:19 -05:00

@songzijiang commented on GitHub (Feb 16, 2025):

Sorry about that – do you have the full logs – journalctl by default will cut off horizontally? journalctl -u ollama --no-pager should do it. Thanks so much

The problem solved by reinstalling ollama, although I don`t how it happened, I will close the issue, thank you so much.

@songzijiang commented on GitHub (Feb 16, 2025): > Sorry about that – do you have the full logs – `journalctl` by default will cut off horizontally? `journalctl -u ollama --no-pager` should do it. Thanks so much The problem solved by reinstalling ollama, although I don`t how it happened, I will close the issue, thank you so much.

GiteaMirror commented

2026-04-28 23:24:19 -05:00

@songzijiang commented on GitHub (Feb 16, 2025):

Sorry, I made a mistake, reinstalling ollama didn't sloved the problem. However, I found run ollama serve can use GPU normally and use the service ollama start can't use GPU. I guess the user ollama do not have the permission. So I test the command sudo -H -u ollama bash -c 'nvidia-smi' and return the Failed to initialize NVML: Insufficient Permissions

So I add ollama into vglusers groups by sudo usermod -a -G vglusers ollama, and everything is ok.
This may a bug of ollama, and you can check if some steps are missing of installing ollama.

@songzijiang commented on GitHub (Feb 16, 2025): Sorry, I made a mistake, reinstalling ollama didn't sloved the problem. However, I found run `ollama serve` can use GPU normally and use the `service ollama start` can't use GPU. I guess the user `ollama` do not have the permission. So I test the command `sudo -H -u ollama bash -c 'nvidia-smi'` and return the `Failed to initialize NVML: Insufficient Permissions` So I add ollama into vglusers groups by `sudo usermod -a -G vglusers ollama`, and everything is ok. This may a bug of ollama, and you can check if some steps are missing of installing ollama.

GiteaMirror commented

2026-04-28 23:24:19 -05:00

@jmorganca commented on GitHub (Feb 16, 2025):

Awesome! I'll re-open this just so we can mark it as fixed once the installer is updated. Really appreciate the help hunting this down @songzijiang

@jmorganca commented on GitHub (Feb 16, 2025): Awesome! I'll re-open this just so we can mark it as fixed once the installer is updated. Really appreciate the help hunting this down @songzijiang

Sign in to join this conversation.

Branches Tags

main

hoyyeva/fix-claude-channels-env

parth-update-hermes-launch

hoyyeva/vscode-extension-docs-update

parth-gemma4-chat-template-renderer

parth-api-status-context-length

hoyyeva/wire-up-context-length

hoyyeva/claude-code-context-doc

jmorganca/investigate-issue-17046

hoyyeva/hermes-docs

jmorganca/agent-loop-style

hoyyeva/openclaw

parth-agent-loop

hoyyeva/ollama-vscode-extension

brucemacd/cache-metrics

brucemacd/hermes-desktop

hoyyeva/docs-vscode

parth-input-style-experiment

brucemacd/docs-glm52

hoyyeva/poc-docs

Parth/mlx-launch-recommendations

parth-first-time-app-cli-experience

test/darwin-xcode-pin

improve-cloud-model-recommendations

hoyyeva/goose-docs

jmorganca/context-limit-fixes

hoyyeva/qwen-doc

hoyyeva/vscode-docs

jmorganca/remove-mlx-imagegen-code

parth-copilot-token-length-defaults

hoyyeva/poolside-windows

laguna-support

jmorganca/harden-markdown-rendering

laguna-renderer-parser

laguna-llamacpp

codex/make-integration-hidden-and-lunchable

brucemacd/omp-docs

pdevine/gguf-mtp-oldstyle

hoyyeva/migrate-pi

hoyyeva/anthropic-local-image-path

parth-launch-codex-app

hoyyeva/anthropic-reference-images-path

parth-anthropic-reference-images-path

brucemacd/download-before-remove

hoyyeva/editor-config-repair

parth-mlx-decode-checkpoints

parth/hide-claude-desktop-till-release

parth-add-claude-code-autoinstall

release_v0.22.0

pdevine/manifest-list

codex/fix-codex-model-metadata-warning

pdevine/addressable-manifest

brucemacd/launch-fetch-reccomended

jmorganca/llama-compat

launch-copilot-cli

release_v0.20.7

parth-auto-save-backup

parth-test

jmorganca/gemma4-audio-replacements

fix-manifest-digest-on-pull

hoyyeva/vscode-improve

brucemacd/install-server-wait

parth/update-claude-docs

brucemac/start-ap-install

pdevine/mlx-update

pdevine/qwen35_vision

drifkin/api-show-fallback

mintlify/image-generation-1773352582

hoyyeva/server-context-length-local-config

jmorganca/faster-reptition-penalties

jmorganca/convert-nemotron

parth-pi-thinking

pdevine/sampling-penalties

jmorganca/fix-create-quantization-memory

dongchen/resumable_transfer_fix

pdevine/sampling-cache-error

jessegross/mlx-usage

hoyyeva/openclaw-config

hoyyeva/app-html

pdevine/qwen3next

brucemacd/sign-sh-install

brucemacd/tui-update

brucemacd/usage-api

jmorganca/launch-empty

fix-app-dist-embed

mxyng/mlx-compile

mxyng/mlx-quant

mxyng/mlx-glm4.7

mxyng/mlx

brucemacd/simplify-model-picker

jmorganca/qwen3-concurrent

fix-glm-4.7-flash-mla-config

drifkin/qwen3-coder-opening-tag

brucemacd/usage-cli

fix-cuda12-fattn-shmem

ollama-imagegen-docs

parth/fix-multiline-inputs

brucemacd/config-docs

mxyng/model-files

mxyng/simple-execute

fix-imagegen-ollama-models

mxyng/async-upload

jmorganca/lazy-no-dtype-changes

imagegen-auto-detect-create

parth/decrease-concurrent-download-hf

fix-mlx-quantize-init

jmorganca/x-cleanup

usage

imagegen-readme

jmorganca/glm-image

mlx-gpu-cd

jmorganca/imagegen-modelfile

parth/agent-skills

parth/agent-allowlist

parth/signed-in-offline

parth/agents

parth/fix-context-chopping

improve-cloud-flow

parth/add-models-websearch

parth/prompt-renderer-mcp

jmorganca/native-settings

jmorganca/download-stream-hash

jmorganca/client2-rebased

brucemacd/oai-chat-req-multipart

jessegross/multi_chunk_reserve

grace/additional-omit-empty

grace/mistral-3-large

mxyng/tokenizer2

mxyng/tokenizer

jessegross/flash

hoyyeva/windows-nacked-app

mxyng/cleanup-attention

grace/deepseek-parser

hoyyeva/remember-unsent-prompt

parth/add-lfs-pointer-error-conversion

parth/olmo2-test2

hoyyeva/ollama-launchagent-plist

nicole/olmo-model

parth/olmo-test

mxyng/remove-embedded

parth/render-template

jmorganca/intellect-3

parth/remove-prealloc-linter

jmorganca/cmd-eval

nicole/nomic-embed-text-fix

mxyng/lint-2

hoyyeva/add-gemini-3-pro-preview

hoyyeva/load-model-list

mxyng/expand-path

mxyng/environ-2

hoyyeva/deeplink-json-encoding

parth/improve-tool-calling-tests

hoyyeva/conversation

hoyyeva/assistant-edit-response

hoyyeva/thinking

origin/brucemacd/invalid-char-i-err

parth/improve-tool-calling

jmorganca/required-omitempty

grace/qwen3-vl-tests

mxyng/iter-client

parth/docs-readme

nicole/embed-test

pdevine/integration-benchstat

parth/remove-generate-cmd

parth/add-toolcall-id

mxyng/server-tests

jmorganca/glm-4.6

jmorganca/gin-h-compat

drifkin/stable-tool-args

pdevine/qwen3-more-thinking

parth/add-websearch-client

nicole/websearch_local

jmorganca/qwen3-coder-updates

grace/deepseek-v3-migration-tests

mxyng/fix-create

jmorganca/cloud-errors

pdevine/parser-tidy

revert-12233-parth/simplify-entrypoints-runner

parth/enable-so-gpt-oss

brucemacd/qwen3vl

jmorganca/readme-simplify

parth/gpt-oss-structured-outputs

revert-12039-jmorganca/tools-braces

mxyng/embeddings

mxyng/gguf

mxyng/benchmark

mxyng/types-null

parth/move-parsing

mxyng/gemma2

jmorganca/docs

mxyng/16-bit

mxyng/create-stdin

pdevine/authorizedkeys

mxyng/quant

parth/opt-in-error-context-window

brucemacd/cache-models

brucemacd/runner-completion

jmorganca/llama-update-6

brucemacd/benchmark-list

brucemacd/partial-read-caps

parth/deepseek-r1-tools

mxyng/omit-array

parth/tool-prefix-temp

brucemacd/runner-test

jmorganca/qwen25vl

brucemacd/model-forward-test-ext

parth/python-function-parsing

jmorganca/cuda-compression-none

drifkin/num-parallel

drifkin/chat-truncation-fix

jmorganca/sync

parth/python-tools-calling

drifkin/array-head-count

brucemacd/create-no-loop

parth/server-enable-content-stream-with-tools

qwen25omni

mxyng/v3

brucemacd/ropeconfig

jmorganca/silence-tokenizer

parth/sample-so-test

parth/sampling-structured-outputs

brucemacd/doc-go-engine

parth/constrained-sampling-json

jmorganca/mistral-wip

brucemacd/mistral-small-convert

parth/sample-unmarshal-json-for-params

brucemacd/jomorganca/mistral

pdevine/bfloat16

jmorganca/mistral

brucemacd/mistral

pdevine/logging

parth/sample-correctness-fix

parth/sample-fix-sorting

jmorgan/sample-fix-sorting-extras

jmorganca/temp-0-images

brucemacd/parallel-embed-models

brucemacd/shim-grammar

jmorganca/fix-gguf-error

bmizerany/nameswork

jmorganca/faster-releases

bmizerany/validatenames

brucemacd/err-no-vocab

brucemacd/rope-config

brucemacd/err-hint

brucemacd/qwen2_5

brucemacd/logprobs

brucemacd/new_runner_graph_bench

progress-flicker

brucemacd/forward-test

brucemacd/go_qwen2

pdevine/gemma2

jmorganca/add-missing-symlink-eval

mxyng/next-debug

parth/set-context-size-openai

brucemacd/next-bpe-bench

brucemacd/next-bpe-test

brucemacd/new_runner_e2e

brucemacd/new_runner_qwen2

pdevine/convert-cohere2

brucemacd/convert-cli

parth/log-probs

mxyng/next-mlx

mxyng/cmd-history

parth/templating

parth/tokenize-detokenize

brucemacd/check-key-register

bmizerany/grammar

jmorganca/vendor-081b29bd

mxyng/func-checks

jmorganca/fix-null-format

parth/fix-default-to-warn-json

jmorganca/qwen2vl

jmorganca/no-concat

parth/cmd-cleanup-SO

brucemacd/check-key-register-structured-err

parth/openai-stream-usage

parth/fix-referencing-so

stream-tools-stop

jmorganca/degin-1

brucemacd/install-path-clean

brucemacd/push-name-validation

brucemacd/browser-key-register

jmorganca/openai-fix-first-message

jmorganca/fix-proxy

jessegross/sample

parth/disallow-streaming-tools

dhiltgen/remove_submodule

jmorganca/ga

jmorganca/mllama

pdevine/newlines

pdevine/geems-2b

jmorganca/llama-bump

mxyng/modelname-7

mxyng/gin-slog

mxyng/modelname-6

jyan/convert-prog

jyan/quant5

paligemma-support

pdevine/import-docs

jmorganca/openai-context

jyan/paligemma

jyan/p2

jyan/palitest

bmizerany/embedspeedup

jmorganca/llama-vit

brucemacd/allow-ollama

royh/ep-methods

royh/whisper

mxyng/api-models

mxyng/fix-memory

jyan/q4_4/8

jyan/ollama-v

royh/stream-tools

roy-embed-parallel

bmizerany/hrm

revert-5963-revert-5924-mxyng/llama3.1-rope

royh/embed-viz

jyan/local2

jyan/auth

jyan/local

jyan/parse-temp

jmorganca/template-mistral

jyan/reord-g

royh-openai-suffixdocs

royh-imgembed

royh-embed-parallel

jyan/quant4

royh-precision

jyan/progress

pdevine/fix-template

jyan/quant3

pdevine/ggla

mxyng/update-registry-domain

jmorganca/ggml-static

mxyng/create-context

jyan/v0.146

mxyng/layers-from-files

build_dist

bmizerany/noseek

royh-ls

royh-name

timeout

mxyng/server-timestamp

bmizerany/nosillyggufslurps

royh-params

jmorganca/llama-cpp-7c26775

royh-openai-delete

royh-show-rigid

jmorganca/enable-fa

jmorganca/no-error-template

jyan/format

royh-testdelete

bmizerany/fastverify

language_support

pdevine/ps-glitches

brucemacd/tokenize

bruce/iq-quants

bmizerany/filepathwithcoloninhost

mxyng/split-bin

bmizerany/client-registry

jmorganca/if-none-match

native

jmorganca/native

jmorganca/batch-embeddings

jmorganca/initcmake

jmorganca/mm

pdevine/showggmlinfo

modenameenforcealphanum

bmizerany/modenameenforcealphanum

jmorganca/done-reason

jmorganca/llama-cpp-8960fe8

ollama.com

bmizerany/filepathnobuild

bmizerany/types/model/defaultfix

rmdisplaylong

nogogen

bmizerany/x

modelfile-readme

bmizerany/replacecolon

jmorganca/limit

jmorganca/execstack

jmorganca/replace-assets

mxyng/tune-concurrency

jmorganca/testing

whitespace-detection

jmorganca/options

upgrade-all

scratch

cuda-search

mattw/airenamer

mattw/allmodelsonhuggingface

mattw/quantcontext

mattw/whatneedstorun

brucemacd/llama-mem-calc

mattw/faq-context

mattw/communitylinks

mattw/noprune

mattw/python-functioncalling

rename

mxyng/install

pulse

remove-first

editor

mattw/selfqueryingretrieval

cgo

mattw/howtoquant

api

matt/streamingapi

format-config

mxyng/extra-args

shell

update-nous-hermes

cp-model

upload-progress

fix-unknown-model

fix-model-names

delete-fix

insecure-registry

ls

deletemodels

progressbar

readme-updates

license-layers

skip-list

list-models

modelpath

matt/examplemodelfiles

distribution

go-opts

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/ollama#52459

[GH-ISSUE #9143] Ollama fails because it is not part of the vglusers group #52459

What is the issue?

Relevant log output

OS

GPU

CPU

Ollama version

[GH-ISSUE #9143] Ollama fails because it is not part of the `vglusers` group #52459