github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-24 06:31:50 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #14052] Ollama 0.15.4 fails to use GPU when running Ministral-3 (falls back to CPU) #34942

New Issue
Closed
opened 2026-04-22 18:58:10 -05:00 by GiteaMirror · 22 comments
GiteaMirror commented 2026-04-22 18:58:10 -05:00
Owner
Copy Link

Originally created by @Kieirra on GitHub (Feb 3, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/14052

What is the issue?

OS: Linux Mint (with Nvidia RTX 4070)
Version: 0.15.4
llm: ministral-3:latest (8b version)

Description : Ollama 0.15.4 fails to use GPU when running Ministral-3

Image

Relevant log output

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.15.4

Originally created by @Kieirra on GitHub (Feb 3, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/14052 ### What is the issue? **OS:** Linux Mint (with Nvidia RTX 4070) **Version:** 0.15.4 **llm:** ministral-3:latest (8b version) **Description :** Ollama 0.15.4 fails to use GPU when running Ministral-3 <img width="650" height="76" alt="Image" src="https://github.com/user-attachments/assets/93774c4c-77c2-4073-8e8b-e9c010532dad" /> - Was not working in 0.13.1 see https://www.reddit.com/r/ollama/comments/1pk7chx/same_hardware_but_linux_5_slower_than_windows/ - Was working in 0.13.3 - Break again in 0.15.4 ### Relevant log output ```shell ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.15.4
GiteaMirror added the bug label 2026-04-22 18:58:10 -05:00
GiteaMirror commented 2026-04-22 18:58:12 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

Server logs will aid in debugging.

<!-- gh-comment-id:3842942772 --> @rick-github commented on GitHub (Feb 3, 2026): [Server logs](https://docs.ollama.com/troubleshooting) will aid in debugging.
GiteaMirror commented 2026-04-22 18:58:14 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.855+01:00 level=INFO source=server.go:245 msg="enabling flash attention"
févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.855+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --model /usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 --port 46523"
févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.855+01:00 level=INFO source=sched.go:452 msg="system memory" total="31.2 GiB" free="18.8 GiB" free_swap="602.3 MiB"
févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.855+01:00 level=INFO source=server.go:755 msg="loading model" "model layers"=35 requested=-1
févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.865+01:00 level=INFO source=runner.go:1405 msg="starting ollama engine"
févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.866+01:00 level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:46523"
févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.866+01:00 level=INFO source=runner.go:1278 msg=load request="{Operation:fit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:4096 KvCacheType: NumThreads:6 GPULayers:[] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.891+01:00 level=INFO source=ggml.go:136 msg="" architecture=mistral3 file_type=Q4_K_M name="" description="" num_tensors=531 num_key_values=45
févr. 03 19:34:45 al1x-ai ollama[386482]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so
févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.894+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc)
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.109+01:00 level=INFO source=runner.go:1278 msg=load request="{Operation:alloc LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:4096 KvCacheType: NumThreads:6 GPULayers:[] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=runner.go:1278 msg=load request="{Operation:commit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:4096 KvCacheType: NumThreads:6 GPULayers:[] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=ggml.go:482 msg="offloading 0 repeating layers to GPU"
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=ggml.go:486 msg="offloading output layer to CPU"
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=ggml.go:494 msg="offloaded 0/35 layers to GPU"
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=device.go:245 msg="model weights" device=CPU size="5.6 GiB"
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=device.go:256 msg="kv cache" device=CPU size="544.0 MiB"
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=device.go:267 msg="compute graph" device=CPU size="765.1 MiB"
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=device.go:272 msg="total memory" size="6.9 GiB"
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=sched.go:526 msg="loaded runners" count=1
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=server.go:1347 msg="waiting for llama runner to start responding"
févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=server.go:1381 msg="waiting for server to become available" status="llm server loading model"
févr. 03 19:34:47 al1x-ai ollama[386482]: time=2026-02-03T19:34:47.496+01:00 level=INFO source=server.go:1385 msg="llama runner started in 1.64 seconds"
févr. 03 19:34:50 al1x-ai ollama[386482]: [GIN] 2026/02/03 - 19:34:50 | 200 |      19.594µs |       127.0.0.1 | HEAD     "/"
févr. 03 19:34:50 al1x-ai ollama[386482]: [GIN] 2026/02/03 - 19:34:50 | 200 |      21.717µs |       127.0.0.1 | GET      "/api/ps"
févr. 03 19:35:08 al1x-ai ollama[386482]: [GIN] 2026/02/03 - 19:35:08 | 200 | 23.276071394s |       127.0.0.1 | POST     "/api/generate"
févr. 03 19:35:18 al1x-ai ollama[386482]: [GIN] 2026/02/03 - 19:35:18 | 200 |  30.85668324s |       127.0.0.1 | POST     "/api/generate"
<!-- gh-comment-id:3843008510 --> @Kieirra commented on GitHub (Feb 3, 2026): ```bash févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.855+01:00 level=INFO source=server.go:245 msg="enabling flash attention" févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.855+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --model /usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 --port 46523" févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.855+01:00 level=INFO source=sched.go:452 msg="system memory" total="31.2 GiB" free="18.8 GiB" free_swap="602.3 MiB" févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.855+01:00 level=INFO source=server.go:755 msg="loading model" "model layers"=35 requested=-1 févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.865+01:00 level=INFO source=runner.go:1405 msg="starting ollama engine" févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.866+01:00 level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:46523" févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.866+01:00 level=INFO source=runner.go:1278 msg=load request="{Operation:fit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:4096 KvCacheType: NumThreads:6 GPULayers:[] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.891+01:00 level=INFO source=ggml.go:136 msg="" architecture=mistral3 file_type=Q4_K_M name="" description="" num_tensors=531 num_key_values=45 févr. 03 19:34:45 al1x-ai ollama[386482]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.894+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc) févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.109+01:00 level=INFO source=runner.go:1278 msg=load request="{Operation:alloc LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:4096 KvCacheType: NumThreads:6 GPULayers:[] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=runner.go:1278 msg=load request="{Operation:commit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:4096 KvCacheType: NumThreads:6 GPULayers:[] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=ggml.go:482 msg="offloading 0 repeating layers to GPU" févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=ggml.go:486 msg="offloading output layer to CPU" févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=ggml.go:494 msg="offloaded 0/35 layers to GPU" févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=device.go:245 msg="model weights" device=CPU size="5.6 GiB" févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=device.go:256 msg="kv cache" device=CPU size="544.0 MiB" févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=device.go:267 msg="compute graph" device=CPU size="765.1 MiB" févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=device.go:272 msg="total memory" size="6.9 GiB" févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=sched.go:526 msg="loaded runners" count=1 févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=server.go:1347 msg="waiting for llama runner to start responding" févr. 03 19:34:46 al1x-ai ollama[386482]: time=2026-02-03T19:34:46.492+01:00 level=INFO source=server.go:1381 msg="waiting for server to become available" status="llm server loading model" févr. 03 19:34:47 al1x-ai ollama[386482]: time=2026-02-03T19:34:47.496+01:00 level=INFO source=server.go:1385 msg="llama runner started in 1.64 seconds" févr. 03 19:34:50 al1x-ai ollama[386482]: [GIN] 2026/02/03 - 19:34:50 | 200 | 19.594µs | 127.0.0.1 | HEAD "/" févr. 03 19:34:50 al1x-ai ollama[386482]: [GIN] 2026/02/03 - 19:34:50 | 200 | 21.717µs | 127.0.0.1 | GET "/api/ps" févr. 03 19:35:08 al1x-ai ollama[386482]: [GIN] 2026/02/03 - 19:35:08 | 200 | 23.276071394s | 127.0.0.1 | POST "/api/generate" févr. 03 19:35:18 al1x-ai ollama[386482]: [GIN] 2026/02/03 - 19:35:18 | 200 | 30.85668324s | 127.0.0.1 | POST "/api/generate" ```
GiteaMirror commented 2026-04-22 18:58:14 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

févr. 03 19:34:45 al1x-ai ollama[386482]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so
févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.894+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc)

No GPU backends found. Set OLLAMA_DEBUG=1 in the server environment and restart the server, and post the log from the start up to and including the line that says inference compute. Also include the output of

ls -l /usr/local/lib/ollama

How did you install ollama?

<!-- gh-comment-id:3843052645 --> @rick-github commented on GitHub (Feb 3, 2026): ``` févr. 03 19:34:45 al1x-ai ollama[386482]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so févr. 03 19:34:45 al1x-ai ollama[386482]: time=2026-02-03T19:34:45.894+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc) ``` No GPU backends found. Set `OLLAMA_DEBUG=1` in the server environment and restart the server, and post the log from the start up to and including the line that says `inference compute`. Also include the output of ``` ls -l /usr/local/lib/ollama ``` How did you install ollama?
GiteaMirror commented 2026-04-22 18:58:15 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

I had Ollama installed in version 0.13.3, which was working very well, and I just wanted to update it using this command:
curl -fsSL https://ollama.com/install.sh | sh from https://ollama.com/download/linux

Then imposible to make GPU work even after

sudo systemctl stop ollama
sudo systemctl start ollama

Just a minute i OLLAMA_DEBUG=1

<!-- gh-comment-id:3843098975 --> @Kieirra commented on GitHub (Feb 3, 2026): I had Ollama installed in version 0.13.3, which was working very well, and I just wanted to update it using this command: `curl -fsSL https://ollama.com/install.sh | sh` from https://ollama.com/download/linux Then imposible to make GPU work even after ``` sudo systemctl stop ollama sudo systemctl start ollama ``` Just a minute i OLLAMA_DEBUG=1
GiteaMirror commented 2026-04-22 18:58:16 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

~]$ OLLAMA_DEBUG=1 ollama serve

time=2026-02-03T20:00:48.121+01:00 level=INFO source=routes.go:1631 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/kieirra/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
time=2026-02-03T20:00:48.122+01:00 level=INFO source=images.go:473 msg="total blobs: 0"
time=2026-02-03T20:00:48.122+01:00 level=INFO source=images.go:480 msg="total unused blobs removed: 0"
time=2026-02-03T20:00:48.122+01:00 level=INFO source=routes.go:1684 msg="Listening on 127.0.0.1:11434 (version 0.15.4)"
time=2026-02-03T20:00:48.123+01:00 level=DEBUG source=sched.go:121 msg="starting llm scheduler"
time=2026-02-03T20:00:48.123+01:00 level=INFO source=runner.go:67 msg="discovering available GPUs..."
time=2026-02-03T20:00:48.123+01:00 level=INFO source=runner.go:106 msg="experimental Vulkan support disabled.  To enable, set OLLAMA_VULKAN=1"
time=2026-02-03T20:00:48.124+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 41289"
time=2026-02-03T20:00:48.124+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=1 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12
time=2026-02-03T20:00:48.449+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=325.69629ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs=map[]
time=2026-02-03T20:00:48.449+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 38335"
time=2026-02-03T20:00:48.449+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=1 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13
time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=234.719283ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs=map[]
time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=2
time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=/usr/local/lib/ollama/cuda_v12 description="NVIDIA GeForce RTX 4070" compute=8.9 id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c pci_id=0000:01:00.0
time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=/usr/local/lib/ollama/cuda_v13 description="NVIDIA GeForce RTX 4070" compute=8.9 id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c pci_id=0000:01:00.0
time=2026-02-03T20:00:48.684+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 36093"
time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=1 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 CUDA_VISIBLE_DEVICES=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT=1
time=2026-02-03T20:00:48.684+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 33153"
time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=1 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 GGML_CUDA_INIT=1 CUDA_VISIBLE_DEVICES=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c
time=2026-02-03T20:00:48.810+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=125.885104ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]"
time=2026-02-03T20:00:48.811+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=126.755637ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]"
time=2026-02-03T20:00:48.811+01:00 level=DEBUG source=runner.go:401 msg="filtering device with overlapping libraries" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c library=/usr/local/lib/ollama/cuda_v12 delete_index=0 kept_library=/usr/local/lib/ollama/cuda_v13
time=2026-02-03T20:00:48.811+01:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=687.780714ms
time=2026-02-03T20:00:48.811+01:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c filter_id="" library=CUDA compute=8.9 name=CUDA0 description="NVIDIA GeForce RTX 4070" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="12.0 GiB" available="10.3 GiB"
time=2026-02-03T20:00:48.811+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="12.0 GiB" threshold="20.0 GiB"
^@[GIN] 2026/02/03 - 20:00:52 | 404 |     230.204µs |       127.0.0.1 | POST     "/api/generate"
^@[GIN] 2026/02/03 - 20:00:54 | 404 |      95.764µs |       127.0.0.1 | POST     "/api/generate"
<!-- gh-comment-id:3843109842 --> @Kieirra commented on GitHub (Feb 3, 2026): ```bash ~]$ OLLAMA_DEBUG=1 ollama serve time=2026-02-03T20:00:48.121+01:00 level=INFO source=routes.go:1631 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/kieirra/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" time=2026-02-03T20:00:48.122+01:00 level=INFO source=images.go:473 msg="total blobs: 0" time=2026-02-03T20:00:48.122+01:00 level=INFO source=images.go:480 msg="total unused blobs removed: 0" time=2026-02-03T20:00:48.122+01:00 level=INFO source=routes.go:1684 msg="Listening on 127.0.0.1:11434 (version 0.15.4)" time=2026-02-03T20:00:48.123+01:00 level=DEBUG source=sched.go:121 msg="starting llm scheduler" time=2026-02-03T20:00:48.123+01:00 level=INFO source=runner.go:67 msg="discovering available GPUs..." time=2026-02-03T20:00:48.123+01:00 level=INFO source=runner.go:106 msg="experimental Vulkan support disabled. To enable, set OLLAMA_VULKAN=1" time=2026-02-03T20:00:48.124+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 41289" time=2026-02-03T20:00:48.124+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=1 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 time=2026-02-03T20:00:48.449+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=325.69629ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs=map[] time=2026-02-03T20:00:48.449+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 38335" time=2026-02-03T20:00:48.449+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=1 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=234.719283ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs=map[] time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=2 time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=/usr/local/lib/ollama/cuda_v12 description="NVIDIA GeForce RTX 4070" compute=8.9 id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c pci_id=0000:01:00.0 time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=/usr/local/lib/ollama/cuda_v13 description="NVIDIA GeForce RTX 4070" compute=8.9 id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c pci_id=0000:01:00.0 time=2026-02-03T20:00:48.684+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 36093" time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=1 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 CUDA_VISIBLE_DEVICES=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT=1 time=2026-02-03T20:00:48.684+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 33153" time=2026-02-03T20:00:48.684+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=1 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 GGML_CUDA_INIT=1 CUDA_VISIBLE_DEVICES=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c time=2026-02-03T20:00:48.810+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=125.885104ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]" time=2026-02-03T20:00:48.811+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=126.755637ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]" time=2026-02-03T20:00:48.811+01:00 level=DEBUG source=runner.go:401 msg="filtering device with overlapping libraries" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c library=/usr/local/lib/ollama/cuda_v12 delete_index=0 kept_library=/usr/local/lib/ollama/cuda_v13 time=2026-02-03T20:00:48.811+01:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=687.780714ms time=2026-02-03T20:00:48.811+01:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c filter_id="" library=CUDA compute=8.9 name=CUDA0 description="NVIDIA GeForce RTX 4070" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="12.0 GiB" available="10.3 GiB" time=2026-02-03T20:00:48.811+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="12.0 GiB" threshold="20.0 GiB" ^@[GIN] 2026/02/03 - 20:00:52 | 404 | 230.204µs | 127.0.0.1 | POST "/api/generate" ^@[GIN] 2026/02/03 - 20:00:54 | 404 | 95.764µs | 127.0.0.1 | POST "/api/generate" ```
GiteaMirror commented 2026-04-22 18:58:16 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

ls -l /usr/local/lib/ollama
<!-- gh-comment-id:3843123458 --> @rick-github commented on GitHub (Feb 3, 2026): ``` ls -l /usr/local/lib/ollama ```
GiteaMirror commented 2026-04-22 18:58:17 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

[~]$ ls -l /usr/local/lib/ollama

total 6484
drwxr-xr-x 2 root root    4096 févr.  1 23:24 cuda_v12
drwxr-xr-x 2 root root    4096 févr.  1 23:14 cuda_v13
lrwxrwxrwx 1 root root      17 févr.  1 23:01 libggml-base.so -> libggml-base.so.0
lrwxrwxrwx 1 root root      21 févr.  1 23:01 libggml-base.so.0 -> libggml-base.so.0.0.0
-rwxr-xr-x 1 root root  748152 févr.  1 23:01 libggml-base.so.0.0.0
-rwxr-xr-x 1 root root  873912 févr.  1 23:01 libggml-cpu-alderlake.so
-rwxr-xr-x 1 root root  873912 févr.  1 23:01 libggml-cpu-haswell.so
-rwxr-xr-x 1 root root 1009080 févr.  1 23:01 libggml-cpu-icelake.so
-rwxr-xr-x 1 root root  820728 févr.  1 23:01 libggml-cpu-sandybridge.so
-rwxr-xr-x 1 root root 1009080 févr.  1 23:01 libggml-cpu-skylakex.so
-rwxr-xr-x 1 root root  636536 févr.  1 23:01 libggml-cpu-sse42.so
-rwxr-xr-x 1 root root  632472 févr.  1 23:01 libggml-cpu-x64.so
drwxr-xr-x 2 root root    4096 févr.  1 23:24 mlx_cuda_v13
drwxr-xr-x 2 root root    4096 févr.  1 23:01 vulkan
<!-- gh-comment-id:3843127413 --> @Kieirra commented on GitHub (Feb 3, 2026): ``` [~]$ ls -l /usr/local/lib/ollama total 6484 drwxr-xr-x 2 root root 4096 févr. 1 23:24 cuda_v12 drwxr-xr-x 2 root root 4096 févr. 1 23:14 cuda_v13 lrwxrwxrwx 1 root root 17 févr. 1 23:01 libggml-base.so -> libggml-base.so.0 lrwxrwxrwx 1 root root 21 févr. 1 23:01 libggml-base.so.0 -> libggml-base.so.0.0.0 -rwxr-xr-x 1 root root 748152 févr. 1 23:01 libggml-base.so.0.0.0 -rwxr-xr-x 1 root root 873912 févr. 1 23:01 libggml-cpu-alderlake.so -rwxr-xr-x 1 root root 873912 févr. 1 23:01 libggml-cpu-haswell.so -rwxr-xr-x 1 root root 1009080 févr. 1 23:01 libggml-cpu-icelake.so -rwxr-xr-x 1 root root 820728 févr. 1 23:01 libggml-cpu-sandybridge.so -rwxr-xr-x 1 root root 1009080 févr. 1 23:01 libggml-cpu-skylakex.so -rwxr-xr-x 1 root root 636536 févr. 1 23:01 libggml-cpu-sse42.so -rwxr-xr-x 1 root root 632472 févr. 1 23:01 libggml-cpu-x64.so drwxr-xr-x 2 root root 4096 févr. 1 23:24 mlx_cuda_v13 drwxr-xr-x 2 root root 4096 févr. 1 23:01 vulkan ```
GiteaMirror commented 2026-04-22 18:58:19 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

Still not clear why the GPU detection is failing. Try with OLLAMA_DEBUG=2 and show the log from the start through to inference compute.

<!-- gh-comment-id:3843706912 --> @rick-github commented on GitHub (Feb 3, 2026): Still not clear why the GPU detection is failing. Try with `OLLAMA_DEBUG=2` and show the log from the start through to `inference compute`.
GiteaMirror commented 2026-04-22 18:58:19 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

févr. 03 22:16:07 al1x-ai systemd[1]: Started ollama.service - Ollama Service.
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.290+01:00 level=INFO source=routes.go:1631 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PRO>
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.293+01:00 level=INFO source=images.go:473 msg="total blobs: 38"
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=INFO source=images.go:480 msg="total unused blobs removed: 0"
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=INFO source=routes.go:1684 msg="Listening on 127.0.0.1:11434 (version 0.15.4)"
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=sched.go:121 msg="starting llm scheduler"
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=INFO source=runner.go:67 msg="discovering available GPUs..."
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/cuda_v12
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/cuda_v13
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/vulkan
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=0
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=132.607µs
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=INFO source=types.go:60 msg="inference compute" id=cpu library=cpu compute="" name=cpu description=cpu libdirs=ollama driver="" pci_id="" type="" total="31.2 GiB" available="18.6 GiB"
févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="0 B" threshold="20.0 GiB"
févr. 03 22:16:25 al1x-ai ollama[541185]: time=2026-02-03T22:16:25.514+01:00 level=DEBUG source=runner.go:264 msg="refreshing free memory"
<!-- gh-comment-id:3843743478 --> @Kieirra commented on GitHub (Feb 3, 2026): ``` févr. 03 22:16:07 al1x-ai systemd[1]: Started ollama.service - Ollama Service. févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.290+01:00 level=INFO source=routes.go:1631 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PRO> févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.293+01:00 level=INFO source=images.go:473 msg="total blobs: 38" févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=INFO source=images.go:480 msg="total unused blobs removed: 0" févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=INFO source=routes.go:1684 msg="Listening on 127.0.0.1:11434 (version 0.15.4)" févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=sched.go:121 msg="starting llm scheduler" févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=INFO source=runner.go:67 msg="discovering available GPUs..." févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/cuda_v12 févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/cuda_v13 févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/vulkan févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=0 févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=132.607µs févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=INFO source=types.go:60 msg="inference compute" id=cpu library=cpu compute="" name=cpu description=cpu libdirs=ollama driver="" pci_id="" type="" total="31.2 GiB" available="18.6 GiB" févr. 03 22:16:07 al1x-ai ollama[541185]: time=2026-02-03T22:16:07.294+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="0 B" threshold="20.0 GiB" févr. 03 22:16:25 al1x-ai ollama[541185]: time=2026-02-03T22:16:25.514+01:00 level=DEBUG source=runner.go:264 msg="refreshing free memory" ```
GiteaMirror commented 2026-04-22 18:58:20 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

With OLLAMA_DEBUG=2.

<!-- gh-comment-id:3843749848 --> @rick-github commented on GitHub (Feb 3, 2026): With `OLLAMA_DEBUG=2`.
GiteaMirror commented 2026-04-22 18:58:23 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

Don't set OLLAMA_LLM_LIBRARY and use journalctl -u ollama --no-pager to dump the log

<!-- gh-comment-id:3843758573 --> @rick-github commented on GitHub (Feb 3, 2026): Don't set `OLLAMA_LLM_LIBRARY` and use `journalctl -u ollama --no-pager` to dump the log
GiteaMirror commented 2026-04-22 18:58:24 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

I did it by editing ollama.service, but it doesn't seem to work. Here's the same thing with ollama serve::

[~]$ OLLAMA_DEBUG=2 ollama serve              

time=2026-02-03T22:23:31.999+01:00 level=INFO source=routes.go:1631 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG-4 OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/kieirra/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
time=2026-02-03T22:23:31.999+01:00 level=INFO source=images.go:473 msg="total blobs: 0"
time=2026-02-03T22:23:31.999+01:00 level=INFO source=images.go:480 msg="total unused blobs removed: 0"
time=2026-02-03T22:23:31.999+01:00 level=INFO source=routes.go:1684 msg="Listening on 127.0.0.1:11434 (version 0.15.4)"
time=2026-02-03T22:23:32.000+01:00 level=DEBUG source=sched.go:121 msg="starting llm scheduler"
time=2026-02-03T22:23:32.000+01:00 level=INFO source=runner.go:67 msg="discovering available GPUs..."
time=2026-02-03T22:23:32.000+01:00 level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extraEnvs=map[]
time=2026-02-03T22:23:32.001+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 45951"
time=2026-02-03T22:23:32.001+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12
time=2026-02-03T22:23:32.026+01:00 level=INFO source=runner.go:1405 msg="starting ollama engine"
time=2026-02-03T22:23:32.027+01:00 level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:45951"
time=2026-02-03T22:23:32.033+01:00 level=DEBUG source=gguf.go:589 msg=general.architecture type=string
time=2026-02-03T22:23:32.033+01:00 level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string
time=2026-02-03T22:23:32.033+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32
time=2026-02-03T22:23:32.034+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32
time=2026-02-03T22:23:32.034+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.file_type default=0
time=2026-02-03T22:23:32.034+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.name default=""
time=2026-02-03T22:23:32.034+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.description default=""
time=2026-02-03T22:23:32.034+01:00 level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3
time=2026-02-03T22:23:32.034+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama
load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so
time=2026-02-03T22:23:32.049+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v12
ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 4070, compute capability 8.9, VMM: yes, ID: GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c
load_backend: loaded CUDA backend from /usr/local/lib/ollama/cuda_v12/libggml-cuda.so
time=2026-02-03T22:23:32.157+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,520,600,610,700,750,800,860,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc)
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.pooling_type default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.expert_count default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.pre default=""
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.embedding_length default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count_kv default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.key_length default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.dimension_count default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.freq_base default=100000
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.scaling.factor default=1
time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=124.476619ms
ggml_backend_cuda_device_get_memory device GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c utilizing NVML memory reporting free: 11168382976 total: 12878610432
time=2026-02-03T22:23:32.172+01:00 level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=14.367962ms
time=2026-02-03T22:23:32.172+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11168382976 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]}]"
time=2026-02-03T22:23:32.172+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=171.81296ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs=map[]
time=2026-02-03T22:23:32.172+01:00 level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extraEnvs=map[]
time=2026-02-03T22:23:32.172+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 34399"
time=2026-02-03T22:23:32.172+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13
time=2026-02-03T22:23:32.179+01:00 level=INFO source=runner.go:1405 msg="starting ollama engine"
time=2026-02-03T22:23:32.179+01:00 level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:34399"
time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=gguf.go:589 msg=general.architecture type=string
time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string
time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32
time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32
time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.file_type default=0
time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.name default=""
time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.description default=""
time=2026-02-03T22:23:32.183+01:00 level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3
time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama
load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so
time=2026-02-03T22:23:32.187+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v13
ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 4070, compute capability 8.9, VMM: yes, ID: GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c
load_backend: loaded CUDA backend from /usr/local/lib/ollama/cuda_v13/libggml-cuda.so
time=2026-02-03T22:23:32.323+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=750,800,860,870,890,900,1000,1030,1100,1200,1210 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc)
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.pooling_type default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.expert_count default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.pre default=""
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.embedding_length default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count_kv default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.key_length default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.dimension_count default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.freq_base default=100000
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.scaling.factor default=1
time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=140.748828ms
ggml_backend_cuda_device_get_memory device GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c utilizing NVML memory reporting free: 11168382976 total: 12878610432
time=2026-02-03T22:23:32.343+01:00 level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=19.410639ms
time=2026-02-03T22:23:32.343+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11168382976 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]}]"
time=2026-02-03T22:23:32.343+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=171.422273ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs=map[]
time=2026-02-03T22:23:32.343+01:00 level=INFO source=runner.go:106 msg="experimental Vulkan support disabled.  To enable, set OLLAMA_VULKAN=1"
time=2026-02-03T22:23:32.343+01:00 level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=2
time=2026-02-03T22:23:32.343+01:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=/usr/local/lib/ollama/cuda_v12 description="NVIDIA GeForce RTX 4070" compute=8.9 id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c pci_id=0000:01:00.0
time=2026-02-03T22:23:32.343+01:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=/usr/local/lib/ollama/cuda_v13 description="NVIDIA GeForce RTX 4070" compute=8.9 id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c pci_id=0000:01:00.0
time=2026-02-03T22:23:32.343+01:00 level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extraEnvs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]"
time=2026-02-03T22:23:32.343+01:00 level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extraEnvs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]"
time=2026-02-03T22:23:32.344+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 33923"
time=2026-02-03T22:23:32.344+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 35539"
time=2026-02-03T22:23:32.344+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 CUDA_VISIBLE_DEVICES=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT=1
time=2026-02-03T22:23:32.344+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 CUDA_VISIBLE_DEVICES=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT=1
time=2026-02-03T22:23:32.353+01:00 level=INFO source=runner.go:1405 msg="starting ollama engine"
time=2026-02-03T22:23:32.353+01:00 level=INFO source=runner.go:1405 msg="starting ollama engine"
time=2026-02-03T22:23:32.353+01:00 level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:35539"
time=2026-02-03T22:23:32.353+01:00 level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:33923"
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=gguf.go:589 msg=general.architecture type=string
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.file_type default=0
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.name default=""
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.description default=""
time=2026-02-03T22:23:32.355+01:00 level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=gguf.go:589 msg=general.architecture type=string
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.file_type default=0
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.name default=""
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.description default=""
time=2026-02-03T22:23:32.355+01:00 level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3
time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama
load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so
time=2026-02-03T22:23:32.358+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v12
load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so
time=2026-02-03T22:23:32.359+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v13
ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 4070, compute capability 8.9, VMM: yes, ID: GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c
ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 4070, compute capability 8.9, VMM: yes, ID: GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c
load_backend: loaded CUDA backend from /usr/local/lib/ollama/cuda_v13/libggml-cuda.so
time=2026-02-03T22:23:32.479+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=750,800,860,870,890,900,1000,1030,1100,1200,1210 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc)
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.pooling_type default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.expert_count default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.pre default=""
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.embedding_length default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count_kv default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.key_length default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.dimension_count default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.freq_base default=100000
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.scaling.factor default=1
time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=124.24928ms
load_backend: loaded CUDA backend from /usr/local/lib/ollama/cuda_v12/libggml-cuda.so
time=2026-02-03T22:23:32.480+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,520,600,610,700,750,800,860,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc)
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.pooling_type default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.expert_count default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.pre default=""
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.embedding_length default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count_kv default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.key_length default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.dimension_count default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.freq_base default=100000
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.scaling.factor default=1
time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=125.618812ms
ggml_backend_cuda_device_get_memory device GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c utilizing NVML memory reporting free: 11168382976 total: 12878610432
ggml_backend_cuda_device_get_memory device GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c utilizing NVML memory reporting free: 11168382976 total: 12878610432
time=2026-02-03T22:23:32.496+01:00 level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=17.068949ms
time=2026-02-03T22:23:32.496+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11168382976 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]}]"
time=2026-02-03T22:23:32.496+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=153.11303ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]"
time=2026-02-03T22:23:32.498+01:00 level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=17.358452ms
time=2026-02-03T22:23:32.498+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11168382976 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]}]"
time=2026-02-03T22:23:32.498+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=154.634277ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]"
time=2026-02-03T22:23:32.498+01:00 level=TRACE source=runner.go:174 msg="supported GPU library combinations before filtering" supported="map[CUDA:map[/usr/local/lib/ollama/cuda_v12:map[GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c:0] /usr/local/lib/ollama/cuda_v13:map[GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c:1]]]"
time=2026-02-03T22:23:32.498+01:00 level=DEBUG source=runner.go:401 msg="filtering device with overlapping libraries" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c library=/usr/local/lib/ollama/cuda_v12 delete_index=0 kept_library=/usr/local/lib/ollama/cuda_v13
time=2026-02-03T22:23:32.498+01:00 level=TRACE source=runner.go:183 msg="removing unsupported or overlapping GPU combination" libDir=/usr/local/lib/ollama/cuda_v12 description="NVIDIA GeForce RTX 4070" compute=8.9 pci_id=0000:01:00.0
time=2026-02-03T22:23:32.498+01:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=498.426856ms
time=2026-02-03T22:23:32.498+01:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c filter_id="" library=CUDA compute=8.9 name=CUDA0 description="NVIDIA GeForce RTX 4070" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="12.0 GiB" available="10.4 GiB"
time=2026-02-03T22:23:32.498+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="12.0 GiB" threshold="20.0 GiB"
<!-- gh-comment-id:3843760779 --> @Kieirra commented on GitHub (Feb 3, 2026): I did it by editing ollama.service, but it doesn't seem to work. Here's the same thing with ollama serve:: ``` [~]$ OLLAMA_DEBUG=2 ollama serve time=2026-02-03T22:23:31.999+01:00 level=INFO source=routes.go:1631 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG-4 OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/kieirra/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" time=2026-02-03T22:23:31.999+01:00 level=INFO source=images.go:473 msg="total blobs: 0" time=2026-02-03T22:23:31.999+01:00 level=INFO source=images.go:480 msg="total unused blobs removed: 0" time=2026-02-03T22:23:31.999+01:00 level=INFO source=routes.go:1684 msg="Listening on 127.0.0.1:11434 (version 0.15.4)" time=2026-02-03T22:23:32.000+01:00 level=DEBUG source=sched.go:121 msg="starting llm scheduler" time=2026-02-03T22:23:32.000+01:00 level=INFO source=runner.go:67 msg="discovering available GPUs..." time=2026-02-03T22:23:32.000+01:00 level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extraEnvs=map[] time=2026-02-03T22:23:32.001+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 45951" time=2026-02-03T22:23:32.001+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 time=2026-02-03T22:23:32.026+01:00 level=INFO source=runner.go:1405 msg="starting ollama engine" time=2026-02-03T22:23:32.027+01:00 level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:45951" time=2026-02-03T22:23:32.033+01:00 level=DEBUG source=gguf.go:589 msg=general.architecture type=string time=2026-02-03T22:23:32.033+01:00 level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string time=2026-02-03T22:23:32.033+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32 time=2026-02-03T22:23:32.034+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32 time=2026-02-03T22:23:32.034+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.file_type default=0 time=2026-02-03T22:23:32.034+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.name default="" time=2026-02-03T22:23:32.034+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.description default="" time=2026-02-03T22:23:32.034+01:00 level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3 time=2026-02-03T22:23:32.034+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so time=2026-02-03T22:23:32.049+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v12 ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 4070, compute capability 8.9, VMM: yes, ID: GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c load_backend: loaded CUDA backend from /usr/local/lib/ollama/cuda_v12/libggml-cuda.so time=2026-02-03T22:23:32.157+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,520,600,610,700,750,800,860,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc) time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.pooling_type default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.expert_count default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}" time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}" time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}" time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}" time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.pre default="" time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.embedding_length default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count_kv default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.key_length default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.dimension_count default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.freq_base default=100000 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.scaling.factor default=1 time=2026-02-03T22:23:32.157+01:00 level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=124.476619ms ggml_backend_cuda_device_get_memory device GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c utilizing NVML memory reporting free: 11168382976 total: 12878610432 time=2026-02-03T22:23:32.172+01:00 level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=14.367962ms time=2026-02-03T22:23:32.172+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11168382976 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]}]" time=2026-02-03T22:23:32.172+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=171.81296ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs=map[] time=2026-02-03T22:23:32.172+01:00 level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extraEnvs=map[] time=2026-02-03T22:23:32.172+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 34399" time=2026-02-03T22:23:32.172+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 time=2026-02-03T22:23:32.179+01:00 level=INFO source=runner.go:1405 msg="starting ollama engine" time=2026-02-03T22:23:32.179+01:00 level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:34399" time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=gguf.go:589 msg=general.architecture type=string time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32 time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32 time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.file_type default=0 time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.name default="" time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.description default="" time=2026-02-03T22:23:32.183+01:00 level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3 time=2026-02-03T22:23:32.183+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so time=2026-02-03T22:23:32.187+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v13 ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 4070, compute capability 8.9, VMM: yes, ID: GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c load_backend: loaded CUDA backend from /usr/local/lib/ollama/cuda_v13/libggml-cuda.so time=2026-02-03T22:23:32.323+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=750,800,860,870,890,900,1000,1030,1100,1200,1210 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc) time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.pooling_type default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.expert_count default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}" time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}" time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}" time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}" time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.pre default="" time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.embedding_length default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count_kv default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.key_length default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.dimension_count default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.freq_base default=100000 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.scaling.factor default=1 time=2026-02-03T22:23:32.324+01:00 level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=140.748828ms ggml_backend_cuda_device_get_memory device GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c utilizing NVML memory reporting free: 11168382976 total: 12878610432 time=2026-02-03T22:23:32.343+01:00 level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=19.410639ms time=2026-02-03T22:23:32.343+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11168382976 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]}]" time=2026-02-03T22:23:32.343+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=171.422273ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs=map[] time=2026-02-03T22:23:32.343+01:00 level=INFO source=runner.go:106 msg="experimental Vulkan support disabled. To enable, set OLLAMA_VULKAN=1" time=2026-02-03T22:23:32.343+01:00 level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=2 time=2026-02-03T22:23:32.343+01:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=/usr/local/lib/ollama/cuda_v12 description="NVIDIA GeForce RTX 4070" compute=8.9 id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c pci_id=0000:01:00.0 time=2026-02-03T22:23:32.343+01:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=/usr/local/lib/ollama/cuda_v13 description="NVIDIA GeForce RTX 4070" compute=8.9 id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c pci_id=0000:01:00.0 time=2026-02-03T22:23:32.343+01:00 level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extraEnvs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]" time=2026-02-03T22:23:32.343+01:00 level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extraEnvs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]" time=2026-02-03T22:23:32.344+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 33923" time=2026-02-03T22:23:32.344+01:00 level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 35539" time=2026-02-03T22:23:32.344+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 CUDA_VISIBLE_DEVICES=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT=1 time=2026-02-03T22:23:32.344+01:00 level=DEBUG source=server.go:430 msg=subprocess PATH=/home/kieirra/.local/bin:/home/kieirra/.local/share/pnpm:/usr/local/n/bin:/home/kieirra/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 CUDA_VISIBLE_DEVICES=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT=1 time=2026-02-03T22:23:32.353+01:00 level=INFO source=runner.go:1405 msg="starting ollama engine" time=2026-02-03T22:23:32.353+01:00 level=INFO source=runner.go:1405 msg="starting ollama engine" time=2026-02-03T22:23:32.353+01:00 level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:35539" time=2026-02-03T22:23:32.353+01:00 level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:33923" time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=gguf.go:589 msg=general.architecture type=string time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32 time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32 time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.file_type default=0 time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.name default="" time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.description default="" time=2026-02-03T22:23:32.355+01:00 level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3 time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=gguf.go:589 msg=general.architecture type=string time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32 time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32 time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.file_type default=0 time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.name default="" time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.description default="" time=2026-02-03T22:23:32.355+01:00 level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3 time=2026-02-03T22:23:32.355+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so time=2026-02-03T22:23:32.358+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v12 load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-alderlake.so time=2026-02-03T22:23:32.359+01:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v13 ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 4070, compute capability 8.9, VMM: yes, ID: GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 4070, compute capability 8.9, VMM: yes, ID: GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c load_backend: loaded CUDA backend from /usr/local/lib/ollama/cuda_v13/libggml-cuda.so time=2026-02-03T22:23:32.479+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=750,800,860,870,890,900,1000,1030,1100,1200,1210 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc) time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.pooling_type default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.expert_count default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}" time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}" time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}" time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}" time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.pre default="" time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.embedding_length default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count_kv default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.key_length default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.dimension_count default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.freq_base default=100000 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.scaling.factor default=1 time=2026-02-03T22:23:32.479+01:00 level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=124.24928ms load_backend: loaded CUDA backend from /usr/local/lib/ollama/cuda_v12/libggml-cuda.so time=2026-02-03T22:23:32.480+01:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,520,600,610,700,750,800,860,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc) time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.pooling_type default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.expert_count default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}" time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}" time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}" time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}" time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=tokenizer.ggml.pre default="" time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.block_count default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.embedding_length default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.head_count_kv default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.key_length default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.dimension_count default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.freq_base default=100000 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=llama.rope.scaling.factor default=1 time=2026-02-03T22:23:32.480+01:00 level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=125.618812ms ggml_backend_cuda_device_get_memory device GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c utilizing NVML memory reporting free: 11168382976 total: 12878610432 ggml_backend_cuda_device_get_memory device GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c utilizing NVML memory reporting free: 11168382976 total: 12878610432 time=2026-02-03T22:23:32.496+01:00 level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=17.068949ms time=2026-02-03T22:23:32.496+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11168382976 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]}]" time=2026-02-03T22:23:32.496+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=153.11303ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]" time=2026-02-03T22:23:32.498+01:00 level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=17.358452ms time=2026-02-03T22:23:32.498+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11168382976 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]}]" time=2026-02-03T22:23:32.498+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=154.634277ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]" time=2026-02-03T22:23:32.498+01:00 level=TRACE source=runner.go:174 msg="supported GPU library combinations before filtering" supported="map[CUDA:map[/usr/local/lib/ollama/cuda_v12:map[GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c:0] /usr/local/lib/ollama/cuda_v13:map[GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c:1]]]" time=2026-02-03T22:23:32.498+01:00 level=DEBUG source=runner.go:401 msg="filtering device with overlapping libraries" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c library=/usr/local/lib/ollama/cuda_v12 delete_index=0 kept_library=/usr/local/lib/ollama/cuda_v13 time=2026-02-03T22:23:32.498+01:00 level=TRACE source=runner.go:183 msg="removing unsupported or overlapping GPU combination" libDir=/usr/local/lib/ollama/cuda_v12 description="NVIDIA GeForce RTX 4070" compute=8.9 pci_id=0000:01:00.0 time=2026-02-03T22:23:32.498+01:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=498.426856ms time=2026-02-03T22:23:32.498+01:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c filter_id="" library=CUDA compute=8.9 name=CUDA0 description="NVIDIA GeForce RTX 4070" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="12.0 GiB" available="10.4 GiB" time=2026-02-03T22:23:32.498+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="12.0 GiB" threshold="20.0 GiB" ```
GiteaMirror commented 2026-04-22 18:58:26 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

OK, it found the GPU

time=2026-02-03T22:23:32.498+01:00 level=INFO source=types.go:42 msg="inference compute"
 id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c filter_id="" library=CUDA compute=8.9 name=CUDA0
 description="NVIDIA GeForce RTX 4070" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0
 type=discrete total="12.0 GiB" available="10.4 GiB"

If you run ollama run ministral-3:8b '', what's the rest of the log?

<!-- gh-comment-id:3843789126 --> @rick-github commented on GitHub (Feb 3, 2026): OK, it found the GPU ``` time=2026-02-03T22:23:32.498+01:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c filter_id="" library=CUDA compute=8.9 name=CUDA0 description="NVIDIA GeForce RTX 4070" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="12.0 GiB" available="10.4 GiB" ``` If you run `ollama run ministral-3:8b ''`, what's the rest of the log?
GiteaMirror commented 2026-04-22 18:58:28 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

It appears I don't get the same result with ollama serve and sudo systemctl start ollama (but can't make OLLAMA_DEBUG=2 work in the second)

<!-- gh-comment-id:3843792494 --> @Kieirra commented on GitHub (Feb 3, 2026): It appears I don't get the same result with `ollama serve` and `sudo systemctl start ollama` (but can't make OLLAMA_DEBUG=2 work in the second)
GiteaMirror commented 2026-04-22 18:58:30 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

sudo systemctl edit ollama and add the following lines in the blank space between "Anything between here and the comment..." and "Edits below this will be discarded":

[Service]
Environment="OLLAMA_DEBUG=2"

Save and exit, then run

sudo systemctl daemon-reload
sudo systemctl restart ollama
<!-- gh-comment-id:3843807369 --> @rick-github commented on GitHub (Feb 3, 2026): `sudo systemctl edit ollama` and add the following lines in the blank space between "Anything between here and the comment..." and "Edits below this will be discarded": ``` [Service] Environment="OLLAMA_DEBUG=2" ``` Save and exit, then run ``` sudo systemctl daemon-reload sudo systemctl restart ollama ````
GiteaMirror commented 2026-04-22 18:58:31 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

with ollama serve :

time=2026-02-03T22:35:54.356+01:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c filter_id="" library=CUDA compute=8.9 name=CUDA0 description="NVIDIA GeForce RTX 4070" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="12.0 GiB" available="10.4 GiB"
time=2026-02-03T22:35:54.356+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="12.0 GiB" threshold="20.0 GiB"
[GIN] 2026/02/03 - 22:35:59 | 200 |      40.188µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/02/03 - 22:35:59 | 404 |     197.327µs |       127.0.0.1 | POST     "/api/show"
time=2026-02-03T22:36:00.719+01:00 level=INFO source=download.go:179 msg="downloading 3ea32f882c99 in 16 376 MB part(s)"

with sudo systemctl start ollama :

Image 
r/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096
févr. 03 22:39:05 al1x-ai ollama[557973]: [GIN] 2026/02/03 - 22:39:05 | 200 |  2.598913581s |       127.0.0.1 | POST     "/api/generate"
févr. 03 22:39:05 al1x-ai ollama[557973]: time=2026-02-03T22:39:05.358+01:00 level=DEBUG source=sched.go:546 msg="context for request finished"
févr. 03 22:39:05 al1x-ai ollama[557973]: time=2026-02-03T22:39:05.358+01:00 level=DEBUG source=sched.go:299 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/ministral-3:latest runner.size="6.9 GiB" runner.vram="0 B" runner.parallel=1 runner.pid=558050 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096 duration=5m0s
févr. 03 22:39:05 al1x-ai ollama[557973]: time=2026-02-03T22:39:05.358+01:00 level=DEBUG source=sched.go:317 msg="after processing request finished event" runner.name=registry.ollama.ai/library/ministral-3:latest runner.size="6.9 GiB" runner.vram="0 B" runner.parallel=1 runner.pid=558050 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096 refCount=0
févr. 03 22:40:22 al1x-ai ollama[557973]: [GIN] 2026/02/03 - 22:40:22 | 200 |       32.41µs |       127.0.0.1 | HEAD     "/"
févr. 03 22:40:22 al1x-ai ollama[557973]: time=2026-02-03T22:40:22.491+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32
févr. 03 22:40:22 al1x-ai ollama[557973]: [GIN] 2026/02/03 - 22:40:22 | 200 |  101.622944ms |       127.0.0.1 | POST     "/api/show"
févr. 03 22:40:22 al1x-ai ollama[557973]: time=2026-02-03T22:40:22.594+01:00 level=DEBUG source=sched.go:678 msg="evaluating already loaded" model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3
févr. 03 22:40:22 al1x-ai ollama[557973]: [GIN] 2026/02/03 - 22:40:22 | 200 |  100.454927ms |       127.0.0.1 | POST     "/api/generate"
févr. 03 22:40:22 al1x-ai ollama[557973]: time=2026-02-03T22:40:22.594+01:00 level=DEBUG source=sched.go:394 msg="context for request finished" runner.name=registry.ollama.ai/library/ministral-3:latest runner.size="6.9 GiB" runner.vram="0 B" runner.parallel=1 runner.pid=558050 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096
févr. 03 22:40:22 al1x-ai ollama[557973]: time=2026-02-03T22:40:22.594+01:00 level=DEBUG source=sched.go:299 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/ministral-3:latest runner.size="6.9 GiB" runner.vram="0 B" runner.parallel=1 runner.pid=558050 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096 duration=5m0s
févr. 03 22:40:22 al1x-ai ollama[557973]: time=2026-02-03T22:40:22.594+01:00 level=DEBUG source=sched.go:317 msg="after processing request finished event" runner.name=registry.ollama.ai/library/ministral-3:latest runner.size="6.9 GiB" runner.vram="0 B" runner.parallel=1 runner.pid=558050 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096 refCount=0
<!-- gh-comment-id:3843823686 --> @Kieirra commented on GitHub (Feb 3, 2026): with ollama serve : ``` time=2026-02-03T22:35:54.356+01:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c filter_id="" library=CUDA compute=8.9 name=CUDA0 description="NVIDIA GeForce RTX 4070" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="12.0 GiB" available="10.4 GiB" time=2026-02-03T22:35:54.356+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="12.0 GiB" threshold="20.0 GiB" [GIN] 2026/02/03 - 22:35:59 | 200 | 40.188µs | 127.0.0.1 | HEAD "/" [GIN] 2026/02/03 - 22:35:59 | 404 | 197.327µs | 127.0.0.1 | POST "/api/show" time=2026-02-03T22:36:00.719+01:00 level=INFO source=download.go:179 msg="downloading 3ea32f882c99 in 16 376 MB part(s)" ``` with `sudo systemctl start ollama` : <img width="859" height="547" alt="Image" src="https://github.com/user-attachments/assets/6caab9f1-39e9-44a9-9baa-1dd3817b5f8b" /> ``` r/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096 févr. 03 22:39:05 al1x-ai ollama[557973]: [GIN] 2026/02/03 - 22:39:05 | 200 | 2.598913581s | 127.0.0.1 | POST "/api/generate" févr. 03 22:39:05 al1x-ai ollama[557973]: time=2026-02-03T22:39:05.358+01:00 level=DEBUG source=sched.go:546 msg="context for request finished" févr. 03 22:39:05 al1x-ai ollama[557973]: time=2026-02-03T22:39:05.358+01:00 level=DEBUG source=sched.go:299 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/ministral-3:latest runner.size="6.9 GiB" runner.vram="0 B" runner.parallel=1 runner.pid=558050 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096 duration=5m0s févr. 03 22:39:05 al1x-ai ollama[557973]: time=2026-02-03T22:39:05.358+01:00 level=DEBUG source=sched.go:317 msg="after processing request finished event" runner.name=registry.ollama.ai/library/ministral-3:latest runner.size="6.9 GiB" runner.vram="0 B" runner.parallel=1 runner.pid=558050 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096 refCount=0 févr. 03 22:40:22 al1x-ai ollama[557973]: [GIN] 2026/02/03 - 22:40:22 | 200 | 32.41µs | 127.0.0.1 | HEAD "/" févr. 03 22:40:22 al1x-ai ollama[557973]: time=2026-02-03T22:40:22.491+01:00 level=DEBUG source=ggml.go:298 msg="key with type not found" key=general.alignment default=32 févr. 03 22:40:22 al1x-ai ollama[557973]: [GIN] 2026/02/03 - 22:40:22 | 200 | 101.622944ms | 127.0.0.1 | POST "/api/show" févr. 03 22:40:22 al1x-ai ollama[557973]: time=2026-02-03T22:40:22.594+01:00 level=DEBUG source=sched.go:678 msg="evaluating already loaded" model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 févr. 03 22:40:22 al1x-ai ollama[557973]: [GIN] 2026/02/03 - 22:40:22 | 200 | 100.454927ms | 127.0.0.1 | POST "/api/generate" févr. 03 22:40:22 al1x-ai ollama[557973]: time=2026-02-03T22:40:22.594+01:00 level=DEBUG source=sched.go:394 msg="context for request finished" runner.name=registry.ollama.ai/library/ministral-3:latest runner.size="6.9 GiB" runner.vram="0 B" runner.parallel=1 runner.pid=558050 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096 févr. 03 22:40:22 al1x-ai ollama[557973]: time=2026-02-03T22:40:22.594+01:00 level=DEBUG source=sched.go:299 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/ministral-3:latest runner.size="6.9 GiB" runner.vram="0 B" runner.parallel=1 runner.pid=558050 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096 duration=5m0s févr. 03 22:40:22 al1x-ai ollama[557973]: time=2026-02-03T22:40:22.594+01:00 level=DEBUG source=sched.go:317 msg="after processing request finished event" runner.name=registry.ollama.ai/library/ministral-3:latest runner.size="6.9 GiB" runner.vram="0 B" runner.parallel=1 runner.pid=558050 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 runner.num_ctx=4096 refCount=0 ```
GiteaMirror commented 2026-04-22 18:58:32 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

And the "inference" log with sudo sytemctl :

févr. 03 22:42:49 al1x-ai systemd[1]: Stopping ollama.service - Ollama Service...
févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.747+01:00 level=DEBUG source=sched.go:896 msg="shutting down runner" model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3
févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.747+01:00 level=DEBUG source=server.go:1827 msg="stopping llama server" pid=558050
févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.747+01:00 level=DEBUG source=server.go:1833 msg="waiting for llama server to exit" pid=558050
févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.747+01:00 level=DEBUG source=sched.go:137 msg="shutting down scheduler pending loop"
févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.747+01:00 level=DEBUG source=sched.go:278 msg="shutting down scheduler completed loop"
févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.938+01:00 level=DEBUG source=server.go:1837 msg="llama server stopped" pid=558050
févr. 03 22:42:49 al1x-ai systemd[1]: ollama.service: Deactivated successfully.
févr. 03 22:42:49 al1x-ai systemd[1]: Stopped ollama.service - Ollama Service.
févr. 03 22:42:49 al1x-ai systemd[1]: ollama.service: Consumed 9.101s CPU time.
févr. 03 22:43:05 al1x-ai systemd[1]: Started ollama.service - Ollama Service.
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.052+01:00 level=INFO source=routes.go:1631 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG-4 OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY:cuda_v11 OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/usr/share/ollama/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.055+01:00 level=INFO source=images.go:473 msg="total blobs: 38"
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.055+01:00 level=INFO source=images.go:480 msg="total unused blobs removed: 0"
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=INFO source=routes.go:1684 msg="Listening on 127.0.0.1:11434 (version 0.15.4)"
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=sched.go:121 msg="starting llm scheduler"
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=INFO source=runner.go:67 msg="discovering available GPUs..."
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/cuda_v12
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/cuda_v13
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/vulkan
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=0
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=TRACE source=runner.go:174 msg="supported GPU library combinations before filtering" supported=map[]
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=396.974µs
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=INFO source=types.go:60 msg="inference compute" id=cpu library=cpu compute="" name=cpu description=cpu libdirs=ollama driver="" pci_id="" type="" total="31.2 GiB" available="18.4 GiB"
févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="0 B" threshold="20.0 GiB"
<!-- gh-comment-id:3843833312 --> @Kieirra commented on GitHub (Feb 3, 2026): And the "inference" log with sudo sytemctl : ``` févr. 03 22:42:49 al1x-ai systemd[1]: Stopping ollama.service - Ollama Service... févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.747+01:00 level=DEBUG source=sched.go:896 msg="shutting down runner" model=/usr/share/ollama/.ollama/models/blobs/sha256-3c9af22ff0acd89c7335e92e4b947569b089e7448971c98d72b017d346453ae3 févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.747+01:00 level=DEBUG source=server.go:1827 msg="stopping llama server" pid=558050 févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.747+01:00 level=DEBUG source=server.go:1833 msg="waiting for llama server to exit" pid=558050 févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.747+01:00 level=DEBUG source=sched.go:137 msg="shutting down scheduler pending loop" févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.747+01:00 level=DEBUG source=sched.go:278 msg="shutting down scheduler completed loop" févr. 03 22:42:49 al1x-ai ollama[557973]: time=2026-02-03T22:42:49.938+01:00 level=DEBUG source=server.go:1837 msg="llama server stopped" pid=558050 févr. 03 22:42:49 al1x-ai systemd[1]: ollama.service: Deactivated successfully. févr. 03 22:42:49 al1x-ai systemd[1]: Stopped ollama.service - Ollama Service. févr. 03 22:42:49 al1x-ai systemd[1]: ollama.service: Consumed 9.101s CPU time. févr. 03 22:43:05 al1x-ai systemd[1]: Started ollama.service - Ollama Service. févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.052+01:00 level=INFO source=routes.go:1631 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG-4 OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY:cuda_v11 OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/usr/share/ollama/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.055+01:00 level=INFO source=images.go:473 msg="total blobs: 38" févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.055+01:00 level=INFO source=images.go:480 msg="total unused blobs removed: 0" févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=INFO source=routes.go:1684 msg="Listening on 127.0.0.1:11434 (version 0.15.4)" févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=sched.go:121 msg="starting llm scheduler" févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=INFO source=runner.go:67 msg="discovering available GPUs..." févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/cuda_v12 févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/cuda_v13 févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=runner.go:98 msg="skipping available library at user's request" requested=cuda_v11 libDir=/usr/local/lib/ollama/vulkan févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=0 févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=TRACE source=runner.go:174 msg="supported GPU library combinations before filtering" supported=map[] févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=396.974µs févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=INFO source=types.go:60 msg="inference compute" id=cpu library=cpu compute="" name=cpu description=cpu libdirs=ollama driver="" pci_id="" type="" total="31.2 GiB" available="18.4 GiB" févr. 03 22:43:05 al1x-ai ollama[560616]: time=2026-02-03T22:43:05.056+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="0 B" threshold="20.0 GiB" ```
GiteaMirror commented 2026-04-22 18:58:34 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

Don't set OLLAMA_LLM_LIBRARY

<!-- gh-comment-id:3843835389 --> @rick-github commented on GitHub (Feb 3, 2026): Don't set `OLLAMA_LLM_LIBRARY`
GiteaMirror commented 2026-04-22 18:58:35 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

Ok i removed it, then

sudo systemctl daemon-reload
sudo systemctl restart ollama

févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.305+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11210129408 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]}]"
févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.305+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=107.806162ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]"
févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=11.749703ms
févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11210129408 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]}]"
févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=108.744559ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]"
févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=TRACE source=runner.go:174 msg="supported GPU library combinations before filtering" supported="map[CUDA:map[/usr/local/lib/ollama/cuda_v12:map[GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c:1] /usr/local/lib/ollama/cuda_v13:map[GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c:0]]]"
févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=DEBUG source=runner.go:401 msg="filtering device with overlapping libraries" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c library=/usr/local/lib/ollama/cuda_v12 delete_index=1 kept_library=/usr/local/lib/ollama/cuda_v13
févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=TRACE source=runner.go:183 msg="removing unsupported or overlapping GPU combination" libDir=/usr/local/lib/ollama/cuda_v12 description="NVIDIA GeForce RTX 4070" compute=8.9 pci_id=0000:01:00.0
févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=445.299397ms
févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c filter_id="" library=CUDA compute=8.9 name=CUDA0 description="NVIDIA GeForce RTX 4070" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="12.0 GiB" available="10.4 GiB"
févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="12.0 GiB" threshold="20.0 GiB"
Image

Seems to work.

Thank you! So in the end, it was me who edited this file during Ollama 0.13.1 to make it work, perhaps?

If so, I'm sorry for wasting your time, and thank you very much for the fix.

<!-- gh-comment-id:3843856619 --> @Kieirra commented on GitHub (Feb 3, 2026): Ok i removed it, then ``` sudo systemctl daemon-reload sudo systemctl restart ollama ``` ``` févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.305+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11210129408 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]}]" févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.305+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=107.806162ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]" févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=11.749703ms févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" devices="[{DeviceID:{ID:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c Library:CUDA} Name:CUDA0 Description:NVIDIA GeForce RTX 4070 FilterID: Integrated:false PCIID:0000:01:00.0 TotalMemory:12878610432 FreeMemory:11210129408 ComputeMajor:8 ComputeMinor:9 DriverMajor:13 DriverMinor:0 LibraryPath:[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]}]" févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=108.744559ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c GGML_CUDA_INIT:1]" févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=TRACE source=runner.go:174 msg="supported GPU library combinations before filtering" supported="map[CUDA:map[/usr/local/lib/ollama/cuda_v12:map[GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c:1] /usr/local/lib/ollama/cuda_v13:map[GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c:0]]]" févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=DEBUG source=runner.go:401 msg="filtering device with overlapping libraries" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c library=/usr/local/lib/ollama/cuda_v12 delete_index=1 kept_library=/usr/local/lib/ollama/cuda_v13 févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=TRACE source=runner.go:183 msg="removing unsupported or overlapping GPU combination" libDir=/usr/local/lib/ollama/cuda_v12 description="NVIDIA GeForce RTX 4070" compute=8.9 pci_id=0000:01:00.0 févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=445.299397ms févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-e992e590-348c-6f5a-aaa6-94fd2b0a038c filter_id="" library=CUDA compute=8.9 name=CUDA0 description="NVIDIA GeForce RTX 4070" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="12.0 GiB" available="10.4 GiB" févr. 03 22:46:57 al1x-ai ollama[563895]: time=2026-02-03T22:46:57.306+01:00 level=INFO source=routes.go:1725 msg="entering low vram mode" "total vram"="12.0 GiB" threshold="20.0 GiB" ``` <img width="734" height="55" alt="Image" src="https://github.com/user-attachments/assets/c240af99-002e-4fd5-888c-a30dc6d1ced1" /> Seems to work. Thank you! So in the end, it was me who edited this file during Ollama 0.13.1 to make it work, perhaps? If so, I'm sorry for wasting your time, and thank you very much for the fix.
GiteaMirror commented 2026-04-22 18:58:37 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

Yes, when you added OLLAMA_LLM_LIBRARY ollama supported CUDA V11. That's no longer the case, ollama currently only supports CUDA V12 and V13.

<!-- gh-comment-id:3843865768 --> @rick-github commented on GitHub (Feb 3, 2026): Yes, when you added `OLLAMA_LLM_LIBRARY` ollama supported CUDA V11. That's no longer the case, ollama currently only supports CUDA V12 and V13.
GiteaMirror commented 2026-04-22 18:58:39 -05:00
Author
Owner
Copy Link

@Kieirra commented on GitHub (Feb 3, 2026):

Sorry for the noise, and thanks a lot for the quick and helpful fix.

For what it's worth, I'm the creator of Murmure, and Ollama is the default LLM backend we recommend, really appreciate the work you’re doing.

<!-- gh-comment-id:3843885479 --> @Kieirra commented on GitHub (Feb 3, 2026): Sorry for the noise, and thanks a lot for the quick and helpful fix. For what it's worth, I'm the creator of [Murmure](https://github.com/Kieirra/murmure), and Ollama is the default LLM backend we recommend, really appreciate the work you’re doing.
GiteaMirror commented 2026-04-22 18:58:39 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 3, 2026):

BTW, you can unset OLLAMA_DEBUG now, it will just clog up your logs.

<!-- gh-comment-id:3843887024 --> @rick-github commented on GitHub (Feb 3, 2026): BTW, you can unset `OLLAMA_DEBUG` now, it will just clog up your logs.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#34942
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?