[GH-ISSUE #13686] something wrong with vulkan implemented in ollama #34745

Closed
opened 2026-04-22 18:34:11 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @protechnopolis on GitHub (Jan 12, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/13686

What is the issue?

I have a rx 9060 xt
I installed ollama on ubuntu 24.04 with curl -fsSL https://ollama.com/install.sh | sh
then:
sudo systemctl edit ollama

and added Environment="OLLAMA_VULKAN=1" (in service tab)
and then:
systemctl daemon-reloard && systemctl restart ollama

Relevant log output

root@ubuntu:~# ls -l /usr/local/lib/ollama
total 6480
drwxr-xr-x 2 root root    4096 Dec 18 22:26 cuda_v12
drwxr-xr-x 2 root root    4096 Dec 18 22:22 cuda_v13
lrwxrwxrwx 1 root root      17 Dec 18 22:07 libggml-base.so -> libggml-base.so.0
lrwxrwxrwx 1 root root      21 Dec 18 22:07 libggml-base.so.0 -> libggml-base.so.0.0.0
-rwxr-xr-x 1 root root  744056 Dec 18 22:07 libggml-base.so.0.0.0
-rwxr-xr-x 1 root root  873912 Dec 18 22:07 libggml-cpu-alderlake.so
-rwxr-xr-x 1 root root  873912 Dec 18 22:07 libggml-cpu-haswell.so
-rwxr-xr-x 1 root root 1009080 Dec 18 22:07 libggml-cpu-icelake.so
-rwxr-xr-x 1 root root  820728 Dec 18 22:07 libggml-cpu-sandybridge.so
-rwxr-xr-x 1 root root 1009080 Dec 18 22:07 libggml-cpu-skylakex.so
-rwxr-xr-x 1 root root  636536 Dec 18 22:07 libggml-cpu-sse42.so
-rwxr-xr-x 1 root root  632472 Dec 18 22:07 libggml-cpu-x64.so
drwxr-xr-x 3 root root    4096 Dec 18 22:14 rocm
drwxr-xr-x 2 root root    4096 Dec 18 22:07 vulkan



journalctl -u ollama --no-pager --since "$(systemctl show ollama --property=ActiveEnterTimestamp --value)"

Dec 21 09:50:27 ollama systemd[1]: Started ollama.service - Ollama Service.
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.074Z level=INFO source=routes.go:1554 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG-4 OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/usr/share/ollama/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:true ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.076Z level=INFO source=images.go:493 msg="total blobs: 5"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.076Z level=INFO source=images.go:500 msg="total unused blobs removed: 0"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.076Z level=INFO source=routes.go:1607 msg="Listening on 127.0.0.1:11434 (version 0.13.5)"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.077Z level=DEBUG source=sched.go:120 msg="starting llm scheduler"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.078Z level=INFO source=runner.go:67 msg="discovering available GPUs..."
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.080Z level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extraEnvs=map[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.083Z level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 46073"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.083Z level=DEBUG source=server.go:430 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_VULKAN=1 OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.093Z level=INFO source=runner.go:1405 msg="starting ollama engine"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.093Z level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:46073"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.096Z level=DEBUG source=gguf.go:589 msg=general.architecture type=string
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.096Z level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.096Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.096Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.097Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.file_type default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.097Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.name default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.097Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.description default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.097Z level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.097Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama
Dec 21 09:50:27 ollama ollama[1048]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-sse42.so
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.110Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v13
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.113Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc)
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.pooling_type default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.expert_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.pre default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.embedding_length default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count_kv default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.key_length default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.dimension_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.freq_base default=100000
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.scaling.factor default=1
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=17.916029ms
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=541ns
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" devices=[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=34.360108ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs=map[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/rocm]" extraEnvs=map[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 41005"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=server.go:430 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_VULKAN=1 OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/rocm OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/rocm
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.123Z level=INFO source=runner.go:1405 msg="starting ollama engine"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.123Z level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:41005"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=gguf.go:589 msg=general.architecture type=string
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.file_type default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.name default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.description default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama
Dec 21 09:50:27 ollama ollama[1048]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-sse42.so
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.131Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/rocm
Dec 21 09:50:27 ollama ollama[1048]: ggml_cuda_init: failed to initialize ROCm: no ROCm-capable device is detected
Dec 21 09:50:27 ollama ollama[1048]: load_backend: loaded ROCm backend from /usr/local/lib/ollama/rocm/libggml-hip.so
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc)
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.pooling_type default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.expert_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.pre default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.embedding_length default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count_kv default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.key_length default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.dimension_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.freq_base default=100000
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.scaling.factor default=1
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=191.425444ms
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=501ns
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/rocm]" devices=[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=203.146852ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/rocm]" extra_envs=map[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/vulkan]" extraEnvs=map[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 39737"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=server.go:430 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_VULKAN=1 OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/vulkan OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/vulkan
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.325Z level=INFO source=runner.go:1405 msg="starting ollama engine"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.326Z level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:39737"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=gguf.go:589 msg=general.architecture type=string
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.file_type default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.name default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.description default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama
Dec 21 09:50:27 ollama ollama[1048]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-sse42.so
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.334Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/vulkan
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc)
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.pooling_type default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.expert_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.pre default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.embedding_length default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count_kv default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.key_length default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.dimension_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.freq_base default=100000
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.scaling.factor default=1
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=25.546203ms
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=691ns
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/vulkan]" devices=[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=37.633489ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/vulkan]" extra_envs=map[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extraEnvs=map[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 38167"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=DEBUG source=server.go:430 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_VULKAN=1 OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.363Z level=INFO source=runner.go:1405 msg="starting ollama engine"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.364Z level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:38167"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=gguf.go:589 msg=general.architecture type=string
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.file_type default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.name default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.description default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama
Dec 21 09:50:27 ollama ollama[1048]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-sse42.so
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.371Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v12
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.374Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc)
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.pooling_type default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.expert_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.pre default=""
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.embedding_length default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count_kv default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.key_length default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.dimension_count default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.freq_base default=100000
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.scaling.factor default=1
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=8.674343ms
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=531ns
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" devices=[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=20.256079ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs=map[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=0
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=TRACE source=runner.go:174 msg="supported GPU library combinations before filtering" supported=map[]
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=298.563479ms
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=INFO source=types.go:60 msg="inference compute" id=cpu library=cpu compute="" name=cpu description=cpu libdirs=ollama driver="" pci_id="" type="" total="19.5 GiB" available="18.9 GiB"
Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=INFO source=routes.go:1648 msg="entering low vram mode" "total vram"="0 B" threshold="20.0 GiB"

OS

Linux

GPU

AMD

CPU

AMD

Ollama version

0.13.5

Originally created by @protechnopolis on GitHub (Jan 12, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/13686 ### What is the issue? I have a rx 9060 xt I installed ollama on ubuntu 24.04 with curl -fsSL https://ollama.com/install.sh | sh then: sudo systemctl edit ollama and added Environment="OLLAMA_VULKAN=1" (in service tab) and then: systemctl daemon-reloard && systemctl restart ollama ### Relevant log output ```shell root@ubuntu:~# ls -l /usr/local/lib/ollama total 6480 drwxr-xr-x 2 root root 4096 Dec 18 22:26 cuda_v12 drwxr-xr-x 2 root root 4096 Dec 18 22:22 cuda_v13 lrwxrwxrwx 1 root root 17 Dec 18 22:07 libggml-base.so -> libggml-base.so.0 lrwxrwxrwx 1 root root 21 Dec 18 22:07 libggml-base.so.0 -> libggml-base.so.0.0.0 -rwxr-xr-x 1 root root 744056 Dec 18 22:07 libggml-base.so.0.0.0 -rwxr-xr-x 1 root root 873912 Dec 18 22:07 libggml-cpu-alderlake.so -rwxr-xr-x 1 root root 873912 Dec 18 22:07 libggml-cpu-haswell.so -rwxr-xr-x 1 root root 1009080 Dec 18 22:07 libggml-cpu-icelake.so -rwxr-xr-x 1 root root 820728 Dec 18 22:07 libggml-cpu-sandybridge.so -rwxr-xr-x 1 root root 1009080 Dec 18 22:07 libggml-cpu-skylakex.so -rwxr-xr-x 1 root root 636536 Dec 18 22:07 libggml-cpu-sse42.so -rwxr-xr-x 1 root root 632472 Dec 18 22:07 libggml-cpu-x64.so drwxr-xr-x 3 root root 4096 Dec 18 22:14 rocm drwxr-xr-x 2 root root 4096 Dec 18 22:07 vulkan journalctl -u ollama --no-pager --since "$(systemctl show ollama --property=ActiveEnterTimestamp --value)" Dec 21 09:50:27 ollama systemd[1]: Started ollama.service - Ollama Service. Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.074Z level=INFO source=routes.go:1554 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG-4 OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/usr/share/ollama/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:true ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.076Z level=INFO source=images.go:493 msg="total blobs: 5" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.076Z level=INFO source=images.go:500 msg="total unused blobs removed: 0" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.076Z level=INFO source=routes.go:1607 msg="Listening on 127.0.0.1:11434 (version 0.13.5)" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.077Z level=DEBUG source=sched.go:120 msg="starting llm scheduler" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.078Z level=INFO source=runner.go:67 msg="discovering available GPUs..." Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.080Z level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extraEnvs=map[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.083Z level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 46073" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.083Z level=DEBUG source=server.go:430 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_VULKAN=1 OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v13 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.093Z level=INFO source=runner.go:1405 msg="starting ollama engine" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.093Z level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:46073" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.096Z level=DEBUG source=gguf.go:589 msg=general.architecture type=string Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.096Z level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.096Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.096Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.097Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.file_type default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.097Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.name default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.097Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.description default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.097Z level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.097Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama Dec 21 09:50:27 ollama ollama[1048]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-sse42.so Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.110Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v13 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.113Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc) Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.pooling_type default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.expert_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.pre default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.embedding_length default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count_kv default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.key_length default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.dimension_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.freq_base default=100000 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.scaling.factor default=1 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=17.916029ms Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=541ns Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" devices=[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=34.360108ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v13]" extra_envs=map[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/rocm]" extraEnvs=map[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 41005" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.114Z level=DEBUG source=server.go:430 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_VULKAN=1 OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/rocm OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/rocm Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.123Z level=INFO source=runner.go:1405 msg="starting ollama engine" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.123Z level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:41005" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=gguf.go:589 msg=general.architecture type=string Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.file_type default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.name default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.description default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.126Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama Dec 21 09:50:27 ollama ollama[1048]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-sse42.so Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.131Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/rocm Dec 21 09:50:27 ollama ollama[1048]: ggml_cuda_init: failed to initialize ROCm: no ROCm-capable device is detected Dec 21 09:50:27 ollama ollama[1048]: load_backend: loaded ROCm backend from /usr/local/lib/ollama/rocm/libggml-hip.so Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc) Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.pooling_type default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.expert_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.pre default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.embedding_length default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count_kv default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.key_length default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.dimension_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.freq_base default=100000 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.scaling.factor default=1 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=191.425444ms Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=501ns Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/rocm]" devices=[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=203.146852ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/rocm]" extra_envs=map[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/vulkan]" extraEnvs=map[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 39737" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.317Z level=DEBUG source=server.go:430 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_VULKAN=1 OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/vulkan OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/vulkan Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.325Z level=INFO source=runner.go:1405 msg="starting ollama engine" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.326Z level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:39737" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=gguf.go:589 msg=general.architecture type=string Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.file_type default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.name default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.description default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.329Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama Dec 21 09:50:27 ollama ollama[1048]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-sse42.so Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.334Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/vulkan Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc) Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.pooling_type default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.expert_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.pre default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.embedding_length default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count_kv default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.key_length default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.dimension_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.354Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.freq_base default=100000 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.scaling.factor default=1 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=25.546203ms Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=691ns Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/vulkan]" devices=[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=37.633489ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/vulkan]" extra_envs=map[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=TRACE source=runner.go:440 msg="starting runner for device discovery" libDirs="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extraEnvs=map[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=INFO source=server.go:429 msg="starting runner" cmd="/usr/local/bin/ollama runner --ollama-engine --port 38167" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.355Z level=DEBUG source=server.go:430 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin OLLAMA_VULKAN=1 OLLAMA_DEBUG=2 LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.363Z level=INFO source=runner.go:1405 msg="starting ollama engine" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.364Z level=INFO source=runner.go:1440 msg="Server listening on 127.0.0.1:38167" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=gguf.go:589 msg=general.architecture type=string Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=gguf.go:589 msg=tokenizer.ggml.model type=string Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.alignment default=32 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.file_type default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.name default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=general.description default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=INFO source=ggml.go:136 msg="" architecture=llama file_type=unknown name="" description="" num_tensors=0 num_key_values=3 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.366Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama Dec 21 09:50:27 ollama ollama[1048]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-sse42.so Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.371Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama/cuda_v12 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.374Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc) Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.pooling_type default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.expert_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.tokens default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.scores default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.token_type default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.merges default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.add_eos_token default=false Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_id default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=tokenizer.ggml.pre default="" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.block_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.embedding_length default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.head_count_kv default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.key_length default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.dimension_count default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.attention.layer_norm_rms_epsilon default=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.freq_base default=100000 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=ggml.go:282 msg="key with type not found" key=llama.rope.scaling.factor default=1 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=runner.go:1380 msg="dummy model load took" duration=8.674343ms Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=runner.go:1385 msg="gathering device infos took" duration=531ns Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=TRACE source=runner.go:467 msg="runner enumerated devices" OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" devices=[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=20.256079ms OLLAMA_LIBRARY_PATH="[/usr/local/lib/ollama /usr/local/lib/ollama/cuda_v12]" extra_envs=map[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=0 Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=TRACE source=runner.go:174 msg="supported GPU library combinations before filtering" supported=map[] Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=298.563479ms Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=INFO source=types.go:60 msg="inference compute" id=cpu library=cpu compute="" name=cpu description=cpu libdirs=ollama driver="" pci_id="" type="" total="19.5 GiB" available="18.9 GiB" Dec 21 09:50:27 ollama ollama[1048]: time=2025-12-21T09:50:27.375Z level=INFO source=routes.go:1648 msg="entering low vram mode" "total vram"="0 B" threshold="20.0 GiB" ``` ### OS Linux ### GPU AMD ### CPU AMD ### Ollama version 0.13.5
GiteaMirror added the bug label 2026-04-22 18:34:11 -05:00
Author
Owner

@protechnopolis commented on GitHub (Jan 12, 2026):

I tried many things with the ollama community and still doesn't work. (https://discord.com/channels/1128867683291627614/1451348042623090772 if you're interested)

<!-- gh-comment-id:3739330412 --> @protechnopolis commented on GitHub (Jan 12, 2026): I tried many things with the ollama community and still doesn't work. (https://discord.com/channels/1128867683291627614/1451348042623090772 if you're interested)
Author
Owner

@rick-github commented on GitHub (Jan 22, 2026):

Fixed with upgrade.

<!-- gh-comment-id:3783835301 --> @rick-github commented on GitHub (Jan 22, 2026): [Fixed with upgrade.](https://discord.com/channels/1128867683291627614/1451348042623090772/1462477104288502061)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#34745