github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 08:02:14 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #13146] The qwen2.5-vl:30b model encounters an error when running under Vulkan. #34455

New Issue
Closed
opened 2026-04-22 18:03:28 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-04-22 18:03:28 -05:00
Owner
Copy Link

Originally created by @adamyang1980 on GitHub (Nov 19, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/13146

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

After setting OLLAMA_VULKAN=1 in the ollama 0.12.11 version and running the qwen2.5-vl:30b model, when the client uploads an image for OCR recognition inference, an error occurs: SIGSEGV in ggml_backend_sched_graph_compute_async. But qwen3vl series models can process it normally.

Relevant log output

time=2025-11-19T02:03:38.473Z level=DEBUG source=runner.go:246 msg="refreshing free memory"
ggml_backend_vk_get_device_memory called: uuid 00000000-c500-0000-0000-000000000000
ggml_backend_vk_get_device_memory called: luid 0x0000000000000000
ggml_backend_vk_get_device_memory called: uuid 00000000-c500-0000-0000-000000000000
ggml_backend_vk_get_device_memory called: luid 0x0000000000000000
time=2025-11-19T02:03:38.485Z level=DEBUG source=runner.go:1378 msg="gathering device infos took" duration=667.32µs
time=2025-11-19T02:03:38.485Z level=DEBUG source=runner.go:294 msg="existing runner discovery took" duration=12.177197ms
time=2025-11-19T02:03:38.485Z level=DEBUG source=runner.go:40 msg="overall device VRAM discovery took" duration=12.256865ms
time=2025-11-19T02:03:38.499Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.alignment default=32
time=2025-11-19T02:03:38.500Z level=DEBUG source=sched.go:572 msg="gpu reported" gpu=00000000-c500-0000-0000-000000000000 library=Vulkan available="128.8 GiB"
time=2025-11-19T02:03:38.500Z level=INFO source=sched.go:583 msg="updated VRAM based on existing loaded models" gpu=00000000-c500-0000-0000-000000000000 library=Vulkan total="129.0 GiB" available="104.0 GiB"
time=2025-11-19T02:03:38.544Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.alignment default=32
time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.pooling_type default=0
time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.dimension_count default=128
time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.scaling.factor default=1
time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.qwen25vl.vision.fullatt_block_indexes default="&{size:0 values:[7 15 23 31]}"
time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.vision.max_pixels default=1003520
time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.attention.key_length default=128
time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.attention.value_length default=128
time=2025-11-19T02:03:38.545Z level=INFO source=server.go:209 msg="enabling flash attention"
time=2025-11-19T02:03:38.546Z level=INFO source=server.go:392 msg="starting runner" cmd="/usr/bin/ollama runner --ollama-engine --model /root/.ollama/models/blobs/sha256-043a363c6ca35e3b1a29b8a5b0bbd28474820239bbc5ad943c9be18f0dc77b66 --port 37865"
time=2025-11-19T02:03:38.546Z level=DEBUG source=server.go:393 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin OLLAMA_FLASH_ATTENTION=true OLLAMA_DEBUG=1 OLLAMA_MAX_LOADED_MODELS=4 OLLAMA_KEEP_ALIVE=1h HSA_ENABLE_SDMA=0 OLLAMA_HOST=0.0.0.0:11434 OLLAMA_NUM_PARALLEL=2 OLLAMA_CONTEXT_LENGTH=65536 HSA_OVERRIDE_GFX_VERSION=11.5.1 OLLAMA_VULKAN=1 LD_LIBRARY_PATH=/usr/lib/ollama:/usr/lib/ollama/vulkan:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 OLLAMA_LIBRARY_PATH=/usr/lib/ollama:/usr/lib/ollama/vulkan
time=2025-11-19T02:03:38.546Z level=INFO source=sched.go:443 msg="system memory" total="124.5 GiB" free="92.0 GiB" free_swap="8.0 GiB"
time=2025-11-19T02:03:38.546Z level=INFO source=sched.go:450 msg="gpu memory" id=00000000-c500-0000-0000-000000000000 library=Vulkan available="103.6 GiB" free="104.0 GiB" minimum="457.0 MiB" overhead="0 B"
time=2025-11-19T02:03:38.546Z level=INFO source=server.go:702 msg="loading model" "model layers"=65 requested=-1
time=2025-11-19T02:03:38.555Z level=INFO source=runner.go:1398 msg="starting ollama engine"
time=2025-11-19T02:03:38.555Z level=INFO source=runner.go:1433 msg="Server listening on 127.0.0.1:37865"
time=2025-11-19T02:03:38.558Z level=INFO source=runner.go:1271 msg=load request="{Operation:fit LoraPath:[] Parallel:2 BatchSize:512 FlashAttention:true KvSize:131072 KvCacheType: NumThreads:16 GPULayers:65[ID:00000000-c500-0000-0000-000000000000 Layers:65(0..64)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
time=2025-11-19T02:03:38.581Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.alignment default=32
time=2025-11-19T02:03:38.582Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.name default=""
time=2025-11-19T02:03:38.582Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.description default=""
time=2025-11-19T02:03:38.582Z level=INFO source=ggml.go:136 msg="" architecture=qwen25vl file_type=Q4_K_M name="" description="" num_tensors=1290 num_key_values=36
time=2025-11-19T02:03:38.582Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/lib/ollama
load_backend: loaded CPU backend from /usr/lib/ollama/libggml-cpu-icelake.so
time=2025-11-19T02:03:38.586Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/lib/ollama/vulkan
ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = AMD Radeon Graphics (RADV GFX1151) (radv) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 64 | shared memory: 65536 | int dot: 1 | matrix cores: KHR_coopmat
load_backend: loaded Vulkan backend from /usr/lib/ollama/vulkan/libggml-vulkan.so
time=2025-11-19T02:03:38.610Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.AVX512=1 CPU.0.AVX512_VBMI=1 CPU.0.AVX512_VNNI=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc)
ggml_backend_vk_get_device_memory called: uuid 00000000-c500-0000-0000-000000000000
ggml_backend_vk_get_device_memory called: luid 0x0000000000000000
time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.pooling_type default=0
time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.dimension_count default=128
time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.scaling.factor default=1
time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.qwen25vl.vision.fullatt_block_indexes default="&{size:0 values:[7 15 23 31]}"
time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.vision.max_pixels default=1003520
time=2025-11-19T02:03:38.769Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0
time=2025-11-19T02:03:38.770Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=1716 splits=133
time=2025-11-19T02:03:39.032Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=2122 splits=2
time=2025-11-19T02:03:39.036Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=2120 splits=2
time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:240 msg="model weights" device=Vulkan0 size="19.3 GiB"
time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:245 msg="model weights" device=CPU size="417.7 MiB"
time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:251 msg="kv cache" device=Vulkan0 size="32.0 GiB"
time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:262 msg="compute graph" device=Vulkan0 size="1.1 GiB"
time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:267 msg="compute graph" device=CPU size="23.9 MiB"
time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:272 msg="total memory" size="52.8 GiB"
time=2025-11-19T02:03:39.037Z level=DEBUG source=server.go:727 msg=memory success=true required.InputWeights=437944320 required.CPU.Graph=25108480 required.Vulkan0.ID=00000000-c500-0000-0000-000000000000 required.Vulkan0.Weights="[312184832 312184832 312184832 312184832 312184832 312184832 312184832 312184832 275689472 275689472 312184832 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 312184832 310833152 310833152 312184832 310833152 310833152 312184832 310833152 1950071296]" required.Vulkan0.Cache="[536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 0]" required.Vulkan0.Graph=1132159792
time=2025-11-19T02:03:39.037Z level=DEBUG source=server.go:921 msg="available gpu" id=00000000-c500-0000-0000-000000000000 library=Vulkan "available layer vram"="102.5 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="1.1 GiB"
time=2025-11-19T02:03:39.037Z level=DEBUG source=server.go:738 msg="new layout created" layers="65[ID:00000000-c500-0000-0000-000000000000 Layers:65(0..64)]"
time=2025-11-19T02:03:39.037Z level=INFO source=runner.go:1271 msg=load request="{Operation:alloc LoraPath:[] Parallel:2 BatchSize:512 FlashAttention:true KvSize:131072 KvCacheType: NumThreads:16 GPULayers:65[ID:00000000-c500-0000-0000-000000000000 Layers:65(0..64)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
time=2025-11-19T02:03:39.051Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.alignment default=32
ggml_backend_vk_get_device_memory called: uuid 00000000-c500-0000-0000-000000000000
ggml_backend_vk_get_device_memory called: luid 0x0000000000000000
time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.pooling_type default=0
time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true
time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.dimension_count default=128
time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.scaling.factor default=1
time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.qwen25vl.vision.fullatt_block_indexes default="&{size:0 values:[7 15 23 31]}"
time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.vision.max_pixels default=1003520
time=2025-11-19T02:03:40.060Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0
time=2025-11-19T02:03:40.122Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=1716 splits=133
time=2025-11-19T02:03:42.613Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=2122 splits=2
time=2025-11-19T02:03:42.639Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=2120 splits=2
time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:240 msg="model weights" device=Vulkan0 size="19.3 GiB"
time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:245 msg="model weights" device=CPU size="417.7 MiB"
time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:251 msg="kv cache" device=Vulkan0 size="32.0 GiB"
time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:262 msg="compute graph" device=Vulkan0 size="1.1 GiB"
time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:267 msg="compute graph" device=CPU size="23.9 MiB"
time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:272 msg="total memory" size="52.8 GiB"
time=2025-11-19T02:03:42.641Z level=DEBUG source=server.go:727 msg=memory success=true required.InputWeights=437944320 required.CPU.Graph=25108480 required.Vulkan0.ID=00000000-c500-0000-0000-000000000000 required.Vulkan0.Weights="[312184832 312184832 312184832 312184832 312184832 312184832 312184832 312184832 275689472 275689472 312184832 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 312184832 310833152 310833152 312184832 310833152 310833152 312184832 310833152 1950071296]" required.Vulkan0.Cache="[536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 0]" required.Vulkan0.Graph=1132159792
time=2025-11-19T02:03:42.641Z level=DEBUG source=server.go:921 msg="available gpu" id=00000000-c500-0000-0000-000000000000 library=Vulkan "available layer vram"="102.5 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="1.1 GiB"
time=2025-11-19T02:03:42.641Z level=DEBUG source=server.go:738 msg="new layout created" layers="65[ID:00000000-c500-0000-0000-000000000000 Layers:65(0..64)]"
time=2025-11-19T02:03:42.642Z level=INFO source=runner.go:1271 msg=load request="{Operation:commit LoraPath:[] Parallel:2 BatchSize:512 FlashAttention:true KvSize:131072 KvCacheType: NumThreads:16 GPULayers:65[ID:00000000-c500-0000-0000-000000000000 Layers:65(0..64)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
time=2025-11-19T02:03:42.642Z level=INFO source=ggml.go:482 msg="offloading 64 repeating layers to GPU"
time=2025-11-19T02:03:42.642Z level=INFO source=ggml.go:489 msg="offloading output layer to GPU"
time=2025-11-19T02:03:42.642Z level=INFO source=ggml.go:494 msg="offloaded 65/65 layers to GPU"
time=2025-11-19T02:03:42.642Z level=INFO source=device.go:240 msg="model weights" device=Vulkan0 size="19.3 GiB"
time=2025-11-19T02:03:42.642Z level=INFO source=device.go:245 msg="model weights" device=CPU size="417.7 MiB"
time=2025-11-19T02:03:42.642Z level=INFO source=device.go:251 msg="kv cache" device=Vulkan0 size="32.0 GiB"
time=2025-11-19T02:03:42.642Z level=INFO source=device.go:262 msg="compute graph" device=Vulkan0 size="1.1 GiB"
time=2025-11-19T02:03:42.642Z level=INFO source=device.go:267 msg="compute graph" device=CPU size="23.9 MiB"
time=2025-11-19T02:03:42.642Z level=INFO source=device.go:272 msg="total memory" size="52.8 GiB"
time=2025-11-19T02:03:42.642Z level=INFO source=sched.go:517 msg="loaded runners" count=2
time=2025-11-19T02:03:42.642Z level=DEBUG source=sched.go:221 msg="new model fits with existing models, loading"
time=2025-11-19T02:03:42.642Z level=INFO source=server.go:1294 msg="waiting for llama runner to start responding"
time=2025-11-19T02:03:42.642Z level=INFO source=server.go:1328 msg="waiting for server to become available" status="llm server loading model"
time=2025-11-19T02:03:42.893Z level=DEBUG source=server.go:1338 msg="model load progress 0.03"
time=2025-11-19T02:03:43.144Z level=DEBUG source=server.go:1338 msg="model load progress 0.07"
time=2025-11-19T02:03:43.394Z level=DEBUG source=server.go:1338 msg="model load progress 0.11"
time=2025-11-19T02:03:43.645Z level=DEBUG source=server.go:1338 msg="model load progress 0.15"
time=2025-11-19T02:03:43.896Z level=DEBUG source=server.go:1338 msg="model load progress 0.19"
time=2025-11-19T02:03:44.147Z level=DEBUG source=server.go:1338 msg="model load progress 0.23"
time=2025-11-19T02:03:44.397Z level=DEBUG source=server.go:1338 msg="model load progress 0.27"
time=2025-11-19T02:03:44.648Z level=DEBUG source=server.go:1338 msg="model load progress 0.31"
time=2025-11-19T02:03:44.899Z level=DEBUG source=server.go:1338 msg="model load progress 0.35"
time=2025-11-19T02:03:45.149Z level=DEBUG source=server.go:1338 msg="model load progress 0.39"
time=2025-11-19T02:03:45.400Z level=DEBUG source=server.go:1338 msg="model load progress 0.43"
time=2025-11-19T02:03:45.651Z level=DEBUG source=server.go:1338 msg="model load progress 0.47"
time=2025-11-19T02:03:45.901Z level=DEBUG source=server.go:1338 msg="model load progress 0.51"
time=2025-11-19T02:03:46.152Z level=DEBUG source=server.go:1338 msg="model load progress 0.55"
time=2025-11-19T02:03:46.403Z level=DEBUG source=server.go:1338 msg="model load progress 0.59"
time=2025-11-19T02:03:46.653Z level=DEBUG source=server.go:1338 msg="model load progress 0.63"
time=2025-11-19T02:03:46.904Z level=DEBUG source=server.go:1338 msg="model load progress 0.67"
time=2025-11-19T02:03:47.155Z level=DEBUG source=server.go:1338 msg="model load progress 0.71"
time=2025-11-19T02:03:47.405Z level=DEBUG source=server.go:1338 msg="model load progress 0.75"
time=2025-11-19T02:03:47.656Z level=DEBUG source=server.go:1338 msg="model load progress 0.79"
time=2025-11-19T02:03:47.907Z level=DEBUG source=server.go:1338 msg="model load progress 0.83"
time=2025-11-19T02:03:48.157Z level=DEBUG source=server.go:1338 msg="model load progress 0.87"
time=2025-11-19T02:03:48.408Z level=DEBUG source=server.go:1338 msg="model load progress 0.91"
time=2025-11-19T02:03:48.659Z level=DEBUG source=server.go:1338 msg="model load progress 0.95"
time=2025-11-19T02:03:48.910Z level=DEBUG source=server.go:1338 msg="model load progress 0.98"
time=2025-11-19T02:03:49.161Z level=DEBUG source=server.go:1338 msg="model load progress 0.99"
time=2025-11-19T02:03:49.283Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.pooling_type default=0
time=2025-11-19T02:03:49.412Z level=INFO source=server.go:1332 msg="llama runner started in 10.87 seconds"
time=2025-11-19T02:03:49.412Z level=DEBUG source=sched.go:529 msg="finished setting up" runner.name=registry.ollama.ai/library/qwen2.5vl:32b runner.inference="[{ID:00000000-c500-0000-0000-000000000000 Library:Vulkan}]" runner.size="52.8 GiB" runner.vram="52.8 GiB" runner.parallel=2 runner.pid=216 runner.model=/root/.ollama/models/blobs/sha256-043a363c6ca35e3b1a29b8a5b0bbd28474820239bbc5ad943c9be18f0dc77b66 runner.num_ctx=65536
time=2025-11-19T02:03:49.424Z level=DEBUG source=server.go:1465 msg="completion request" images=2 prompt=445 format=""
time=2025-11-19T02:03:49.425Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0
time=2025-11-19T02:03:49.431Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0
time=2025-11-19T02:03:49.431Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0
time=2025-11-19T02:03:49.431Z level=DEBUG source=cache.go:142 msg="loading cache slot" id=0 cache=0 prompt=135 used=0 remaining=135
SIGSEGV: segmentation violation
PC=0x723155313e3c m=30 sigcode=1 addr=0x52
signal arrived during cgo execution

goroutine 13 gp=0xc000702fc0 m=30 mp=0xc000f88008 [syscall]:
runtime.cgocall(0x5a31c524e760, 0xc000de1568)
	runtime/cgocall.go:167 +0x4b fp=0xc000de1540 sp=0xc000de1508 pc=0x5a31c453f62b
github.com/ollama/ollama/ml/backend/ggml._Cfunc_ggml_backend_sched_graph_compute_async(0x723178100860, 0x7230d4cbdd60)
	_cgo_gotypes.go:961 +0x4a fp=0xc000de1568 sp=0xc000de1540 pc=0x5a31c497482a
github.com/ollama/ollama/ml/backend/ggml.(*Context).ComputeWithNotify.func2(...)
	github.com/ollama/ollama/ml/backend/ggml/ggml.go:826
github.com/ollama/ollama/ml/backend/ggml.(*Context).ComputeWithNotify(0xc0011a12c0, 0x5a31c45450a9?, {0xc000044c10, 0x1, 0xc000044c01?})
	github.com/ollama/ollama/ml/backend/ggml/ggml.go:826 +0x1b2 fp=0xc000de1640 sp=0xc000de1568 pc=0x5a31c4982232
github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute(0xc0011a12c0?, {0xc000044c10?, 0x1?, 0x5a31c4520c89?})
	github.com/ollama/ollama/ml/backend/ggml/ggml.go:812 +0x25 fp=0xc000de1678 sp=0xc000de1640 pc=0x5a31c4982045
github.com/ollama/ollama/runner/ollamarunner.multimodalStore.getTensor(0x5a31c5890be0?, {0x5a31c5a5ee58, 0xc000151760}, {0x5a31c5a638b0, 0xc0011a1200}, {0x5a31c5a6dd20, 0xc0041b7e60}, 0x0)
	github.com/ollama/ollama/runner/ollamarunner/multimodal.go:93 +0x2f4 fp=0xc000de1788 sp=0xc000de1678 pc=0x5a31c4a49e94
github.com/ollama/ollama/runner/ollamarunner.multimodalStore.getMultimodal(0xc00119f200, {0x5a31c5a5ee58, 0xc000151760}, {0x5a31c5a638b0, 0xc0011a1200}, {0xc0003ca3c0, 0x1, 0xfffffffffffffffc?}, 0x0)
	github.com/ollama/ollama/runner/ollamarunner/multimodal.go:56 +0xe5 fp=0xc000de17f0 sp=0xc000de1788 pc=0x5a31c4a49a85
github.com/ollama/ollama/runner/ollamarunner.(*Server).forwardBatch(_, {0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0, 0x0}, {{0x0, ...}, ...}, ...})
	github.com/ollama/ollama/runner/ollamarunner/runner.go:584 +0x1217 fp=0xc000de1b58 sp=0xc000de17f0 pc=0x5a31c4a4d0f7
github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0002230e0, {0x5a31c5a58f00, 0xc00051f770})
	github.com/ollama/ollama/runner/ollamarunner/runner.go:452 +0x18c fp=0xc000de1fb8 sp=0xc000de1b58 pc=0x5a31c4a4bc8c
github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap1()
	github.com/ollama/ollama/runner/ollamarunner/runner.go:1411 +0x28 fp=0xc000de1fe0 sp=0xc000de1fb8 pc=0x5a31c4a551e8
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000de1fe8 sp=0xc000de1fe0 pc=0x5a31c454a941
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
	github.com/ollama/ollama/runner/ollamarunner/runner.go:1411 +0x4c9

goroutine 1 gp=0xc000002380 m=nil [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000ddf790 sp=0xc000ddf770 pc=0x5a31c4542aae
runtime.netpollblock(0xc0004ad7e0?, 0xc44dc1e6?, 0x31?)
	runtime/netpoll.go:575 +0xf7 fp=0xc000ddf7c8 sp=0xc000ddf790 pc=0x5a31c4507dd7
internal/poll.runtime_pollWait(0x7231e5a1ade0, 0x72)
	runtime/netpoll.go:351 +0x85 fp=0xc000ddf7e8 sp=0xc000ddf7c8 pc=0x5a31c4541cc5
internal/poll.(*pollDesc).wait(0xc0006a2100?, 0x900000036?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000ddf810 sp=0xc000ddf7e8 pc=0x5a31c45c9c07
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0006a2100)
	internal/poll/fd_unix.go:620 +0x295 fp=0xc000ddf8b8 sp=0xc000ddf810 pc=0x5a31c45cefd5
net.(*netFD).accept(0xc0006a2100)
	net/fd_unix.go:172 +0x29 fp=0xc000ddf970 sp=0xc000ddf8b8 pc=0x5a31c4641ea9
net.(*TCPListener).accept(0xc000519800)
	net/tcpsock_posix.go:159 +0x1b fp=0xc000ddf9c0 sp=0xc000ddf970 pc=0x5a31c465785b
net.(*TCPListener).Accept(0xc000519800)
	net/tcpsock.go:380 +0x30 fp=0xc000ddf9f0 sp=0xc000ddf9c0 pc=0x5a31c4656710
net/http.(*onceCloseListener).Accept(0xc0002e43f0?)
	<autogenerated>:1 +0x24 fp=0xc000ddfa08 sp=0xc000ddf9f0 pc=0x5a31c486dee4
net/http.(*Server).Serve(0xc000051100, {0x5a31c5a56928, 0xc000519800})
	net/http/server.go:3424 +0x30c fp=0xc000ddfb38 sp=0xc000ddfa08 pc=0x5a31c48457ac
github.com/ollama/ollama/runner/ollamarunner.Execute({0xc00012a030, 0x4, 0x4})
	github.com/ollama/ollama/runner/ollamarunner/runner.go:1434 +0x94e fp=0xc000ddfd08 sp=0xc000ddfb38 pc=0x5a31c4a54f6e
github.com/ollama/ollama/runner.Execute({0xc00012a010?, 0x0?, 0x0?})
	github.com/ollama/ollama/runner/runner.go:20 +0xc9 fp=0xc000ddfd30 sp=0xc000ddfd08 pc=0x5a31c4a55869
github.com/ollama/ollama/cmd.NewCLI.func2(0xc000050f00?, {0x5a31c555e0ab?, 0x4?, 0x5a31c555e0af?})
	github.com/ollama/ollama/cmd/cmd.go:1841 +0x45 fp=0xc000ddfd58 sp=0xc000ddfd30 pc=0x5a31c51e05c5
github.com/spf13/cobra.(*Command).execute(0xc0002e9508, {0xc00051f6d0, 0x5, 0x5})
	github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000ddfe78 sp=0xc000ddfd58 pc=0x5a31c46bb4fc
github.com/spf13/cobra.(*Command).ExecuteC(0xc0000f2908)
	github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000ddff30 sp=0xc000ddfe78 pc=0x5a31c46bbd45
github.com/spf13/cobra.(*Command).Execute(...)
	github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
	github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
	github.com/ollama/ollama/main.go:12 +0x4d fp=0xc000ddff50 sp=0xc000ddff30 pc=0x5a31c51e10ad
runtime.main()
	runtime/proc.go:283 +0x29d fp=0xc000ddffe0 sp=0xc000ddff50 pc=0x5a31c450f45d
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000ddffe8 sp=0xc000ddffe0 pc=0x5a31c454a941

goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000aafa8 sp=0xc0000aaf88 pc=0x5a31c4542aae
runtime.goparkunlock(...)
	runtime/proc.go:441
runtime.forcegchelper()
	runtime/proc.go:348 +0xb8 fp=0xc0000aafe0 sp=0xc0000aafa8 pc=0x5a31c450f798
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000aafe8 sp=0xc0000aafe0 pc=0x5a31c454a941
created by runtime.init.7 in goroutine 1
	runtime/proc.go:336 +0x1a

goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000ab780 sp=0xc0000ab760 pc=0x5a31c4542aae
runtime.goparkunlock(...)
	runtime/proc.go:441
runtime.bgsweep(0xc0000d6000)
	runtime/mgcsweep.go:316 +0xdf fp=0xc0000ab7c8 sp=0xc0000ab780 pc=0x5a31c44f9f3f
runtime.gcenable.gowrap1()
	runtime/mgc.go:204 +0x25 fp=0xc0000ab7e0 sp=0xc0000ab7c8 pc=0x5a31c44ee325
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000ab7e8 sp=0xc0000ab7e0 pc=0x5a31c454a941
created by runtime.gcenable in goroutine 1
	runtime/mgc.go:204 +0x66

goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]:
runtime.gopark(0x10000?, 0x5a31c57268a0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000abf78 sp=0xc0000abf58 pc=0x5a31c4542aae
runtime.goparkunlock(...)
	runtime/proc.go:441
runtime.(*scavengerState).park(0x5a31c63120a0)
	runtime/mgcscavenge.go:425 +0x49 fp=0xc0000abfa8 sp=0xc0000abf78 pc=0x5a31c44f7989
runtime.bgscavenge(0xc0000d6000)
	runtime/mgcscavenge.go:658 +0x59 fp=0xc0000abfc8 sp=0xc0000abfa8 pc=0x5a31c44f7f19
runtime.gcenable.gowrap2()
	runtime/mgc.go:205 +0x25 fp=0xc0000abfe0 sp=0xc0000abfc8 pc=0x5a31c44ee2c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000abfe8 sp=0xc0000abfe0 pc=0x5a31c454a941
created by runtime.gcenable in goroutine 1
	runtime/mgc.go:205 +0xa5

goroutine 18 gp=0xc000104380 m=nil [finalizer wait]:
runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc0000aa688?)
	runtime/proc.go:435 +0xce fp=0xc0000aa630 sp=0xc0000aa610 pc=0x5a31c4542aae
runtime.runfinq()
	runtime/mfinal.go:196 +0x107 fp=0xc0000aa7e0 sp=0xc0000aa630 pc=0x5a31c44ed2e7
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000aa7e8 sp=0xc0000aa7e0 pc=0x5a31c454a941
created by runtime.createfing in goroutine 1
	runtime/mfinal.go:166 +0x3d

goroutine 19 gp=0xc000104e00 m=nil [chan receive]:
runtime.gopark(0xc000221860?, 0xc068300018?, 0x60?, 0x67?, 0x5a31c4628ae8?)
	runtime/proc.go:435 +0xce fp=0xc0000a6718 sp=0xc0000a66f8 pc=0x5a31c4542aae
runtime.chanrecv(0xc000100310, 0x0, 0x1)
	runtime/chan.go:664 +0x445 fp=0xc0000a6790 sp=0xc0000a6718 pc=0x5a31c44dedc5
runtime.chanrecv1(0x0?, 0x0?)
	runtime/chan.go:506 +0x12 fp=0xc0000a67b8 sp=0xc0000a6790 pc=0x5a31c44de952
runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
	runtime/mgc.go:1796
runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
	runtime/mgc.go:1799 +0x2f fp=0xc0000a67e0 sp=0xc0000a67b8 pc=0x5a31c44f14cf
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a67e8 sp=0xc0000a67e0 pc=0x5a31c454a941
created by unique.runtime_registerUniqueMapCleanup in goroutine 1
	runtime/mgc.go:1794 +0x85

goroutine 20 gp=0xc000105180 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000a6f38 sp=0xc0000a6f18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000a6fc8 sp=0xc0000a6f38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000a6fe0 sp=0xc0000a6fc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a6fe8 sp=0xc0000a6fe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 21 gp=0xc000105340 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000a7738 sp=0xc0000a7718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000a77c8 sp=0xc0000a7738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000a77e0 sp=0xc0000a77c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a77e8 sp=0xc0000a77e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 34 gp=0xc0002bc000 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002c2738 sp=0xc0002c2718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002c27c8 sp=0xc0002c2738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002c27e0 sp=0xc0002c27c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c27e8 sp=0xc0002c27e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 35 gp=0xc0002bc1c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002c2f38 sp=0xc0002c2f18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002c2fc8 sp=0xc0002c2f38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002c2fe0 sp=0xc0002c2fc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c2fe8 sp=0xc0002c2fe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 36 gp=0xc0002bc380 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002c3738 sp=0xc0002c3718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002c37c8 sp=0xc0002c3738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002c37e0 sp=0xc0002c37c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c37e8 sp=0xc0002c37e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 37 gp=0xc0002bc540 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002c3f38 sp=0xc0002c3f18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002c3fc8 sp=0xc0002c3f38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002c3fe0 sp=0xc0002c3fc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c3fe8 sp=0xc0002c3fe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 38 gp=0xc0002bc700 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002c4738 sp=0xc0002c4718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002c47c8 sp=0xc0002c4738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002c47e0 sp=0xc0002c47c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c47e8 sp=0xc0002c47e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 39 gp=0xc0002bc8c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002c4f38 sp=0xc0002c4f18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002c4fc8 sp=0xc0002c4f38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002c4fe0 sp=0xc0002c4fc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c4fe8 sp=0xc0002c4fe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 5 gp=0xc000003dc0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000ac738 sp=0xc0000ac718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000ac7c8 sp=0xc0000ac738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000ac7e0 sp=0xc0000ac7c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000ac7e8 sp=0xc0000ac7e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 6 gp=0xc0000ee000 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000acf38 sp=0xc0000acf18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000acfc8 sp=0xc0000acf38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000acfe0 sp=0xc0000acfc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000acfe8 sp=0xc0000acfe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 7 gp=0xc0000ee1c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000ad738 sp=0xc0000ad718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000ad7c8 sp=0xc0000ad738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000ad7e0 sp=0xc0000ad7c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000ad7e8 sp=0xc0000ad7e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 8 gp=0xc0000ee380 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000adf38 sp=0xc0000adf18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000adfc8 sp=0xc0000adf38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000adfe0 sp=0xc0000adfc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000adfe8 sp=0xc0000adfe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 9 gp=0xc0000ee540 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002be738 sp=0xc0002be718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002be7c8 sp=0xc0002be738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002be7e0 sp=0xc0002be7c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002be7e8 sp=0xc0002be7e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 22 gp=0xc000105500 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a6d7814?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000a7f38 sp=0xc0000a7f18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000a7fc8 sp=0xc0000a7f38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000a7fe0 sp=0xc0000a7fc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a7fe8 sp=0xc0000a7fe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 40 gp=0xc0002bca80 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a81d3ea?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002c5738 sp=0xc0002c5718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002c57c8 sp=0xc0002c5738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002c57e0 sp=0xc0002c57c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c57e8 sp=0xc0002c57e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 41 gp=0xc0002bcc40 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a6da92e?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002c5f38 sp=0xc0002c5f18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002c5fc8 sp=0xc0002c5f38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002c5fe0 sp=0xc0002c5fc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c5fe8 sp=0xc0002c5fe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 42 gp=0xc0002bce00 m=nil [GC worker (idle)]:
runtime.gopark(0x5a31c63c1e40?, 0x1?, 0xdf?, 0x7d?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002ca738 sp=0xc0002ca718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002ca7c8 sp=0xc0002ca738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002ca7e0 sp=0xc0002ca7c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002ca7e8 sp=0xc0002ca7e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 43 gp=0xc0002bcfc0 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a6e4d79?, 0x1?, 0xaa?, 0x13?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002caf38 sp=0xc0002caf18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002cafc8 sp=0xc0002caf38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002cafe0 sp=0xc0002cafc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002cafe8 sp=0xc0002cafe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 44 gp=0xc0002bd180 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a6dbb4e?, 0x1?, 0xfa?, 0xd1?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002cb738 sp=0xc0002cb718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002cb7c8 sp=0xc0002cb738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002cb7e0 sp=0xc0002cb7c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002cb7e8 sp=0xc0002cb7e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 45 gp=0xc0002bd340 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a6da212?, 0x1?, 0x81?, 0x44?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002cbf38 sp=0xc0002cbf18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002cbfc8 sp=0xc0002cbf38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002cbfe0 sp=0xc0002cbfc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002cbfe8 sp=0xc0002cbfe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 46 gp=0xc0002bd500 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a822cbe?, 0x3?, 0x8e?, 0xa5?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002cc738 sp=0xc0002cc718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002cc7c8 sp=0xc0002cc738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002cc7e0 sp=0xc0002cc7c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002cc7e8 sp=0xc0002cc7e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 47 gp=0xc0002bd6c0 m=nil [GC worker (idle)]:
runtime.gopark(0x5a31c63c1e40?, 0x1?, 0xc2?, 0xb7?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002ccf38 sp=0xc0002ccf18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002ccfc8 sp=0xc0002ccf38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002ccfe0 sp=0xc0002ccfc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002ccfe8 sp=0xc0002ccfe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 48 gp=0xc0002bd880 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a6e2c14?, 0x1?, 0x61?, 0xad?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002cd738 sp=0xc0002cd718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002cd7c8 sp=0xc0002cd738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002cd7e0 sp=0xc0002cd7c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002cd7e8 sp=0xc0002cd7e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 10 gp=0xc0000ee700 m=nil [GC worker (idle)]:
runtime.gopark(0x5a31c63c1e40?, 0x1?, 0xa8?, 0xc2?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002bef38 sp=0xc0002bef18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002befc8 sp=0xc0002bef38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002befe0 sp=0xc0002befc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002befe8 sp=0xc0002befe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 23 gp=0xc000105a40 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a6bce44?, 0x3?, 0xe4?, 0x2?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000a8738 sp=0xc0000a8718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000a87c8 sp=0xc0000a8738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000a87e0 sp=0xc0000a87c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a87e8 sp=0xc0000a87e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 24 gp=0xc000105c00 m=nil [GC worker (idle)]:
runtime.gopark(0x5a31c63c1e40?, 0x3?, 0xd7?, 0x19?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000a8f38 sp=0xc0000a8f18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000a8fc8 sp=0xc0000a8f38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000a8fe0 sp=0xc0000a8fc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a8fe8 sp=0xc0000a8fe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 25 gp=0xc000105dc0 m=nil [GC worker (idle)]:
runtime.gopark(0x5a31c63c1e40?, 0x1?, 0xd0?, 0x9f?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000a9738 sp=0xc0000a9718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000a97c8 sp=0xc0000a9738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000a97e0 sp=0xc0000a97c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a97e8 sp=0xc0000a97e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 26 gp=0xc00049c000 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a8244a6?, 0x3?, 0xd6?, 0x18?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0000a9f38 sp=0xc0000a9f18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000a9fc8 sp=0xc0000a9f38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000a9fe0 sp=0xc0000a9fc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a9fe8 sp=0xc0000a9fe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 50 gp=0xc000504000 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a823236?, 0x3?, 0x8f?, 0xf?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002c6738 sp=0xc0002c6718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002c67c8 sp=0xc0002c6738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002c67e0 sp=0xc0002c67c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c67e8 sp=0xc0002c67e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 27 gp=0xc00049c1c0 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a81e218?, 0x1?, 0x9a?, 0x36?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0004a2738 sp=0xc0004a2718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0004a27c8 sp=0xc0004a2738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0004a27e0 sp=0xc0004a27c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0004a27e8 sp=0xc0004a27e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 11 gp=0xc0000ee8c0 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a81e16e?, 0x1?, 0x9?, 0x5c?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002bf738 sp=0xc0002bf718 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002bf7c8 sp=0xc0002bf738 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002bf7e0 sp=0xc0002bf7c8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002bf7e8 sp=0xc0002bf7e0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 12 gp=0xc0000eea80 m=nil [GC worker (idle)]:
runtime.gopark(0x1c5a33a820982?, 0x1?, 0x92?, 0x38?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc0002bff38 sp=0xc0002bff18 pc=0x5a31c4542aae
runtime.gcBgMarkWorker(0xc000101570)
	runtime/mgc.go:1423 +0xe9 fp=0xc0002bffc8 sp=0xc0002bff38 pc=0x5a31c44f07e9
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0002bffe0 sp=0xc0002bffc8 pc=0x5a31c44f06c5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0002bffe8 sp=0xc0002bffe0 pc=0x5a31c454a941
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 14 gp=0xc000703180 m=nil [select]:
runtime.gopark(0xc000049a08?, 0x2?, 0x0?, 0x0?, 0xc00004986c?)
	runtime/proc.go:435 +0xce fp=0xc000049698 sp=0xc000049678 pc=0x5a31c4542aae
runtime.selectgo(0xc000049a08, 0xc000049868, 0x87?, 0x0, 0x1?, 0x1)
	runtime/select.go:351 +0x837 fp=0xc0000497d0 sp=0xc000049698 pc=0x5a31c4521957
github.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc0002230e0, {0x5a31c5a56b08, 0xc0011aa540}, 0xc0005208c0)
	github.com/ollama/ollama/runner/ollamarunner/runner.go:950 +0xc4e fp=0xc000049ac0 sp=0xc0000497d0 pc=0x5a31c4a503ae
github.com/ollama/ollama/runner/ollamarunner.(*Server).completion-fm({0x5a31c5a56b08?, 0xc0011aa540?}, 0xc000049b40?)
	<autogenerated>:1 +0x36 fp=0xc000049af0 sp=0xc000049ac0 pc=0x5a31c4a556d6
net/http.HandlerFunc.ServeHTTP(0xc00051a780?, {0x5a31c5a56b08?, 0xc0011aa540?}, 0xc000049b60?)
	net/http/server.go:2294 +0x29 fp=0xc000049b18 sp=0xc000049af0 pc=0x5a31c4841de9
net/http.(*ServeMux).ServeHTTP(0x5a31c44e7805?, {0x5a31c5a56b08, 0xc0011aa540}, 0xc0005208c0)
	net/http/server.go:2822 +0x1c4 fp=0xc000049b68 sp=0xc000049b18 pc=0x5a31c4843ce4
net/http.serverHandler.ServeHTTP({0x5a31c5a53110?}, {0x5a31c5a56b08?, 0xc0011aa540?}, 0x1?)
	net/http/server.go:3301 +0x8e fp=0xc000049b98 sp=0xc000049b68 pc=0x5a31c486176e
net/http.(*conn).serve(0xc0002e43f0, {0x5a31c5a58ec8, 0xc0002e0e10})
	net/http/server.go:2102 +0x625 fp=0xc000049fb8 sp=0xc000049b98 pc=0x5a31c48402e5
net/http.(*Server).Serve.gowrap3()
	net/http/server.go:3454 +0x28 fp=0xc000049fe0 sp=0xc000049fb8 pc=0x5a31c4845ba8
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000049fe8 sp=0xc000049fe0 pc=0x5a31c454a941
created by net/http.(*Server).Serve in goroutine 1
	net/http/server.go:3454 +0x485

goroutine 1098 gp=0xc000504fc0 m=nil [IO wait]:
runtime.gopark(0x4786b5804786b500?, 0x4786b6804786b600?, 0x0?, 0xb7?, 0xb?)
	runtime/proc.go:435 +0xce fp=0xc0039795d8 sp=0xc0039795b8 pc=0x5a31c4542aae
runtime.netpollblock(0x5a31c4566158?, 0xc44dc1e6?, 0x31?)
	runtime/netpoll.go:575 +0xf7 fp=0xc003979610 sp=0xc0039795d8 pc=0x5a31c4507dd7
internal/poll.runtime_pollWait(0x7231e5a1acc8, 0x72)
	runtime/netpoll.go:351 +0x85 fp=0xc003979630 sp=0xc003979610 pc=0x5a31c4541cc5
internal/poll.(*pollDesc).wait(0xc0006a2180?, 0xc0002e0f11?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc003979658 sp=0xc003979630 pc=0x5a31c45c9c07
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0006a2180, {0xc0002e0f11, 0x1, 0x1})
	internal/poll/fd_unix.go:165 +0x27a fp=0xc0039796f0 sp=0xc003979658 pc=0x5a31c45caefa
net.(*netFD).Read(0xc0006a2180, {0xc0002e0f11?, 0xc0005198d8?, 0xc003979770?})
	net/fd_posix.go:55 +0x25 fp=0xc003979738 sp=0xc0039796f0 pc=0x5a31c463ff05
net.(*conn).Read(0xc0000ae6e0, {0xc0002e0f11?, 0xc000127000?, 0x5a31c48ab200?})
	net/net.go:194 +0x45 fp=0xc003979780 sp=0xc003979738 pc=0x5a31c464e2c5
net/http.(*connReader).backgroundRead(0xc0002e0f00)
	net/http/server.go:690 +0x37 fp=0xc0039797c8 sp=0xc003979780 pc=0x5a31c483a1b7
net/http.(*connReader).startBackgroundRead.gowrap2()
	net/http/server.go:686 +0x25 fp=0xc0039797e0 sp=0xc0039797c8 pc=0x5a31c483a0e5
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0039797e8 sp=0xc0039797e0 pc=0x5a31c454a941
created by net/http.(*connReader).startBackgroundRead in goroutine 14
	net/http/server.go:686 +0xb6

rax    0x0
rbx    0x72315c0171c0
rcx    0x0
rdx    0x723155352a40
rdi    0x7231553134cd
rsi    0x43
rbp    0x72312a9089c0
rsp    0x72312a907ce0
r8     0x0
r9     0x7230d409b930
r10    0x7230d4cc1248
r11    0x22
r12    0x20
r13    0x72312a908aa0
r14    0x7231797a3e48
r15    0x7230d409b930
rip    0x723155313e3c
rflags 0x10206
cs     0x33
fs     0x0
gs     0x0
time=2025-11-19T02:03:49.568Z level=ERROR source=server.go:1539 msg="post predict" error="Post \"http://127.0.0.1:37865/completion\": EOF"
[GIN] 2025/11/19 - 02:03:49 | 500 | 11.199601469s |       10.1.3.13 | POST     "/api/generate"
time=2025-11-19T02:03:49.568Z level=DEBUG source=sched.go:537 msg="context for request finished"
time=2025-11-19T02:03:49.568Z level=DEBUG source=sched.go:290 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/qwen2.5vl:32b runner.inference="[{ID:00000000-c500-0000-0000-000000000000 Library:Vulkan}]" runner.size="52.8 GiB" runner.vram="52.8 GiB" runner.parallel=2 runner.pid=216 runner.model=/root/.ollama/models/blobs/sha256-043a363c6ca35e3b1a29b8a5b0bbd28474820239bbc5ad943c9be18f0dc77b66 runner.num_ctx=65536 duration=1h0m0s
time=2025-11-19T02:03:49.568Z level=DEBUG source=sched.go:308 msg="after processing request finished event" runner.name=registry.ollama.ai/library/qwen2.5vl:32b runner.inference="[{ID:00000000-c500-0000-0000-000000000000 Library:Vulkan}]" runner.size="52.8 GiB" runner.vram="52.8 GiB" runner.parallel=2 runner.pid=216

OS

Linux

GPU

AMD

CPU

AMD

Ollama version

0.12.11

Originally created by @adamyang1980 on GitHub (Nov 19, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/13146 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? After setting OLLAMA_VULKAN=1 in the ollama 0.12.11 version and running the qwen2.5-vl:30b model, when the client uploads an image for OCR recognition inference, an error occurs: SIGSEGV in ggml_backend_sched_graph_compute_async. But qwen3vl series models can process it normally. ### Relevant log output ```shell time=2025-11-19T02:03:38.473Z level=DEBUG source=runner.go:246 msg="refreshing free memory" ggml_backend_vk_get_device_memory called: uuid 00000000-c500-0000-0000-000000000000 ggml_backend_vk_get_device_memory called: luid 0x0000000000000000 ggml_backend_vk_get_device_memory called: uuid 00000000-c500-0000-0000-000000000000 ggml_backend_vk_get_device_memory called: luid 0x0000000000000000 time=2025-11-19T02:03:38.485Z level=DEBUG source=runner.go:1378 msg="gathering device infos took" duration=667.32µs time=2025-11-19T02:03:38.485Z level=DEBUG source=runner.go:294 msg="existing runner discovery took" duration=12.177197ms time=2025-11-19T02:03:38.485Z level=DEBUG source=runner.go:40 msg="overall device VRAM discovery took" duration=12.256865ms time=2025-11-19T02:03:38.499Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.alignment default=32 time=2025-11-19T02:03:38.500Z level=DEBUG source=sched.go:572 msg="gpu reported" gpu=00000000-c500-0000-0000-000000000000 library=Vulkan available="128.8 GiB" time=2025-11-19T02:03:38.500Z level=INFO source=sched.go:583 msg="updated VRAM based on existing loaded models" gpu=00000000-c500-0000-0000-000000000000 library=Vulkan total="129.0 GiB" available="104.0 GiB" time=2025-11-19T02:03:38.544Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.alignment default=32 time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.pooling_type default=0 time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.dimension_count default=128 time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.scaling.factor default=1 time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.qwen25vl.vision.fullatt_block_indexes default="&{size:0 values:[7 15 23 31]}" time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.vision.max_pixels default=1003520 time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.attention.key_length default=128 time=2025-11-19T02:03:38.545Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.attention.value_length default=128 time=2025-11-19T02:03:38.545Z level=INFO source=server.go:209 msg="enabling flash attention" time=2025-11-19T02:03:38.546Z level=INFO source=server.go:392 msg="starting runner" cmd="/usr/bin/ollama runner --ollama-engine --model /root/.ollama/models/blobs/sha256-043a363c6ca35e3b1a29b8a5b0bbd28474820239bbc5ad943c9be18f0dc77b66 --port 37865" time=2025-11-19T02:03:38.546Z level=DEBUG source=server.go:393 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin OLLAMA_FLASH_ATTENTION=true OLLAMA_DEBUG=1 OLLAMA_MAX_LOADED_MODELS=4 OLLAMA_KEEP_ALIVE=1h HSA_ENABLE_SDMA=0 OLLAMA_HOST=0.0.0.0:11434 OLLAMA_NUM_PARALLEL=2 OLLAMA_CONTEXT_LENGTH=65536 HSA_OVERRIDE_GFX_VERSION=11.5.1 OLLAMA_VULKAN=1 LD_LIBRARY_PATH=/usr/lib/ollama:/usr/lib/ollama/vulkan:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 OLLAMA_LIBRARY_PATH=/usr/lib/ollama:/usr/lib/ollama/vulkan time=2025-11-19T02:03:38.546Z level=INFO source=sched.go:443 msg="system memory" total="124.5 GiB" free="92.0 GiB" free_swap="8.0 GiB" time=2025-11-19T02:03:38.546Z level=INFO source=sched.go:450 msg="gpu memory" id=00000000-c500-0000-0000-000000000000 library=Vulkan available="103.6 GiB" free="104.0 GiB" minimum="457.0 MiB" overhead="0 B" time=2025-11-19T02:03:38.546Z level=INFO source=server.go:702 msg="loading model" "model layers"=65 requested=-1 time=2025-11-19T02:03:38.555Z level=INFO source=runner.go:1398 msg="starting ollama engine" time=2025-11-19T02:03:38.555Z level=INFO source=runner.go:1433 msg="Server listening on 127.0.0.1:37865" time=2025-11-19T02:03:38.558Z level=INFO source=runner.go:1271 msg=load request="{Operation:fit LoraPath:[] Parallel:2 BatchSize:512 FlashAttention:true KvSize:131072 KvCacheType: NumThreads:16 GPULayers:65[ID:00000000-c500-0000-0000-000000000000 Layers:65(0..64)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" time=2025-11-19T02:03:38.581Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.alignment default=32 time=2025-11-19T02:03:38.582Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.name default="" time=2025-11-19T02:03:38.582Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.description default="" time=2025-11-19T02:03:38.582Z level=INFO source=ggml.go:136 msg="" architecture=qwen25vl file_type=Q4_K_M name="" description="" num_tensors=1290 num_key_values=36 time=2025-11-19T02:03:38.582Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/lib/ollama load_backend: loaded CPU backend from /usr/lib/ollama/libggml-cpu-icelake.so time=2025-11-19T02:03:38.586Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/lib/ollama/vulkan ggml_vulkan: Found 1 Vulkan devices: ggml_vulkan: 0 = AMD Radeon Graphics (RADV GFX1151) (radv) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 64 | shared memory: 65536 | int dot: 1 | matrix cores: KHR_coopmat load_backend: loaded Vulkan backend from /usr/lib/ollama/vulkan/libggml-vulkan.so time=2025-11-19T02:03:38.610Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.AVX512=1 CPU.0.AVX512_VBMI=1 CPU.0.AVX512_VNNI=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc) ggml_backend_vk_get_device_memory called: uuid 00000000-c500-0000-0000-000000000000 ggml_backend_vk_get_device_memory called: luid 0x0000000000000000 time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.pooling_type default=0 time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.dimension_count default=128 time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.scaling.factor default=1 time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.qwen25vl.vision.fullatt_block_indexes default="&{size:0 values:[7 15 23 31]}" time=2025-11-19T02:03:38.617Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.vision.max_pixels default=1003520 time=2025-11-19T02:03:38.769Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0 time=2025-11-19T02:03:38.770Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=1716 splits=133 time=2025-11-19T02:03:39.032Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=2122 splits=2 time=2025-11-19T02:03:39.036Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=2120 splits=2 time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:240 msg="model weights" device=Vulkan0 size="19.3 GiB" time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:245 msg="model weights" device=CPU size="417.7 MiB" time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:251 msg="kv cache" device=Vulkan0 size="32.0 GiB" time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:262 msg="compute graph" device=Vulkan0 size="1.1 GiB" time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:267 msg="compute graph" device=CPU size="23.9 MiB" time=2025-11-19T02:03:39.037Z level=DEBUG source=device.go:272 msg="total memory" size="52.8 GiB" time=2025-11-19T02:03:39.037Z level=DEBUG source=server.go:727 msg=memory success=true required.InputWeights=437944320 required.CPU.Graph=25108480 required.Vulkan0.ID=00000000-c500-0000-0000-000000000000 required.Vulkan0.Weights="[312184832 312184832 312184832 312184832 312184832 312184832 312184832 312184832 275689472 275689472 312184832 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 312184832 310833152 310833152 312184832 310833152 310833152 312184832 310833152 1950071296]" required.Vulkan0.Cache="[536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 0]" required.Vulkan0.Graph=1132159792 time=2025-11-19T02:03:39.037Z level=DEBUG source=server.go:921 msg="available gpu" id=00000000-c500-0000-0000-000000000000 library=Vulkan "available layer vram"="102.5 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="1.1 GiB" time=2025-11-19T02:03:39.037Z level=DEBUG source=server.go:738 msg="new layout created" layers="65[ID:00000000-c500-0000-0000-000000000000 Layers:65(0..64)]" time=2025-11-19T02:03:39.037Z level=INFO source=runner.go:1271 msg=load request="{Operation:alloc LoraPath:[] Parallel:2 BatchSize:512 FlashAttention:true KvSize:131072 KvCacheType: NumThreads:16 GPULayers:65[ID:00000000-c500-0000-0000-000000000000 Layers:65(0..64)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" time=2025-11-19T02:03:39.051Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=general.alignment default=32 ggml_backend_vk_get_device_memory called: uuid 00000000-c500-0000-0000-000000000000 ggml_backend_vk_get_device_memory called: luid 0x0000000000000000 time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.pooling_type default=0 time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=true time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.dimension_count default=128 time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.rope.scaling.factor default=1 time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.qwen25vl.vision.fullatt_block_indexes default="&{size:0 values:[7 15 23 31]}" time=2025-11-19T02:03:39.907Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.vision.max_pixels default=1003520 time=2025-11-19T02:03:40.060Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0 time=2025-11-19T02:03:40.122Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=1716 splits=133 time=2025-11-19T02:03:42.613Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=2122 splits=2 time=2025-11-19T02:03:42.639Z level=DEBUG source=ggml.go:853 msg="compute graph" nodes=2120 splits=2 time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:240 msg="model weights" device=Vulkan0 size="19.3 GiB" time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:245 msg="model weights" device=CPU size="417.7 MiB" time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:251 msg="kv cache" device=Vulkan0 size="32.0 GiB" time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:262 msg="compute graph" device=Vulkan0 size="1.1 GiB" time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:267 msg="compute graph" device=CPU size="23.9 MiB" time=2025-11-19T02:03:42.641Z level=DEBUG source=device.go:272 msg="total memory" size="52.8 GiB" time=2025-11-19T02:03:42.641Z level=DEBUG source=server.go:727 msg=memory success=true required.InputWeights=437944320 required.CPU.Graph=25108480 required.Vulkan0.ID=00000000-c500-0000-0000-000000000000 required.Vulkan0.Weights="[312184832 312184832 312184832 312184832 312184832 312184832 312184832 312184832 275689472 275689472 312184832 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 275689472 274337792 310833152 312184832 310833152 310833152 312184832 310833152 310833152 312184832 310833152 1950071296]" required.Vulkan0.Cache="[536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 536870912 0]" required.Vulkan0.Graph=1132159792 time=2025-11-19T02:03:42.641Z level=DEBUG source=server.go:921 msg="available gpu" id=00000000-c500-0000-0000-000000000000 library=Vulkan "available layer vram"="102.5 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="1.1 GiB" time=2025-11-19T02:03:42.641Z level=DEBUG source=server.go:738 msg="new layout created" layers="65[ID:00000000-c500-0000-0000-000000000000 Layers:65(0..64)]" time=2025-11-19T02:03:42.642Z level=INFO source=runner.go:1271 msg=load request="{Operation:commit LoraPath:[] Parallel:2 BatchSize:512 FlashAttention:true KvSize:131072 KvCacheType: NumThreads:16 GPULayers:65[ID:00000000-c500-0000-0000-000000000000 Layers:65(0..64)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" time=2025-11-19T02:03:42.642Z level=INFO source=ggml.go:482 msg="offloading 64 repeating layers to GPU" time=2025-11-19T02:03:42.642Z level=INFO source=ggml.go:489 msg="offloading output layer to GPU" time=2025-11-19T02:03:42.642Z level=INFO source=ggml.go:494 msg="offloaded 65/65 layers to GPU" time=2025-11-19T02:03:42.642Z level=INFO source=device.go:240 msg="model weights" device=Vulkan0 size="19.3 GiB" time=2025-11-19T02:03:42.642Z level=INFO source=device.go:245 msg="model weights" device=CPU size="417.7 MiB" time=2025-11-19T02:03:42.642Z level=INFO source=device.go:251 msg="kv cache" device=Vulkan0 size="32.0 GiB" time=2025-11-19T02:03:42.642Z level=INFO source=device.go:262 msg="compute graph" device=Vulkan0 size="1.1 GiB" time=2025-11-19T02:03:42.642Z level=INFO source=device.go:267 msg="compute graph" device=CPU size="23.9 MiB" time=2025-11-19T02:03:42.642Z level=INFO source=device.go:272 msg="total memory" size="52.8 GiB" time=2025-11-19T02:03:42.642Z level=INFO source=sched.go:517 msg="loaded runners" count=2 time=2025-11-19T02:03:42.642Z level=DEBUG source=sched.go:221 msg="new model fits with existing models, loading" time=2025-11-19T02:03:42.642Z level=INFO source=server.go:1294 msg="waiting for llama runner to start responding" time=2025-11-19T02:03:42.642Z level=INFO source=server.go:1328 msg="waiting for server to become available" status="llm server loading model" time=2025-11-19T02:03:42.893Z level=DEBUG source=server.go:1338 msg="model load progress 0.03" time=2025-11-19T02:03:43.144Z level=DEBUG source=server.go:1338 msg="model load progress 0.07" time=2025-11-19T02:03:43.394Z level=DEBUG source=server.go:1338 msg="model load progress 0.11" time=2025-11-19T02:03:43.645Z level=DEBUG source=server.go:1338 msg="model load progress 0.15" time=2025-11-19T02:03:43.896Z level=DEBUG source=server.go:1338 msg="model load progress 0.19" time=2025-11-19T02:03:44.147Z level=DEBUG source=server.go:1338 msg="model load progress 0.23" time=2025-11-19T02:03:44.397Z level=DEBUG source=server.go:1338 msg="model load progress 0.27" time=2025-11-19T02:03:44.648Z level=DEBUG source=server.go:1338 msg="model load progress 0.31" time=2025-11-19T02:03:44.899Z level=DEBUG source=server.go:1338 msg="model load progress 0.35" time=2025-11-19T02:03:45.149Z level=DEBUG source=server.go:1338 msg="model load progress 0.39" time=2025-11-19T02:03:45.400Z level=DEBUG source=server.go:1338 msg="model load progress 0.43" time=2025-11-19T02:03:45.651Z level=DEBUG source=server.go:1338 msg="model load progress 0.47" time=2025-11-19T02:03:45.901Z level=DEBUG source=server.go:1338 msg="model load progress 0.51" time=2025-11-19T02:03:46.152Z level=DEBUG source=server.go:1338 msg="model load progress 0.55" time=2025-11-19T02:03:46.403Z level=DEBUG source=server.go:1338 msg="model load progress 0.59" time=2025-11-19T02:03:46.653Z level=DEBUG source=server.go:1338 msg="model load progress 0.63" time=2025-11-19T02:03:46.904Z level=DEBUG source=server.go:1338 msg="model load progress 0.67" time=2025-11-19T02:03:47.155Z level=DEBUG source=server.go:1338 msg="model load progress 0.71" time=2025-11-19T02:03:47.405Z level=DEBUG source=server.go:1338 msg="model load progress 0.75" time=2025-11-19T02:03:47.656Z level=DEBUG source=server.go:1338 msg="model load progress 0.79" time=2025-11-19T02:03:47.907Z level=DEBUG source=server.go:1338 msg="model load progress 0.83" time=2025-11-19T02:03:48.157Z level=DEBUG source=server.go:1338 msg="model load progress 0.87" time=2025-11-19T02:03:48.408Z level=DEBUG source=server.go:1338 msg="model load progress 0.91" time=2025-11-19T02:03:48.659Z level=DEBUG source=server.go:1338 msg="model load progress 0.95" time=2025-11-19T02:03:48.910Z level=DEBUG source=server.go:1338 msg="model load progress 0.98" time=2025-11-19T02:03:49.161Z level=DEBUG source=server.go:1338 msg="model load progress 0.99" time=2025-11-19T02:03:49.283Z level=DEBUG source=ggml.go:276 msg="key with type not found" key=qwen25vl.pooling_type default=0 time=2025-11-19T02:03:49.412Z level=INFO source=server.go:1332 msg="llama runner started in 10.87 seconds" time=2025-11-19T02:03:49.412Z level=DEBUG source=sched.go:529 msg="finished setting up" runner.name=registry.ollama.ai/library/qwen2.5vl:32b runner.inference="[{ID:00000000-c500-0000-0000-000000000000 Library:Vulkan}]" runner.size="52.8 GiB" runner.vram="52.8 GiB" runner.parallel=2 runner.pid=216 runner.model=/root/.ollama/models/blobs/sha256-043a363c6ca35e3b1a29b8a5b0bbd28474820239bbc5ad943c9be18f0dc77b66 runner.num_ctx=65536 time=2025-11-19T02:03:49.424Z level=DEBUG source=server.go:1465 msg="completion request" images=2 prompt=445 format="" time=2025-11-19T02:03:49.425Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0 time=2025-11-19T02:03:49.431Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0 time=2025-11-19T02:03:49.431Z level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0 time=2025-11-19T02:03:49.431Z level=DEBUG source=cache.go:142 msg="loading cache slot" id=0 cache=0 prompt=135 used=0 remaining=135 SIGSEGV: segmentation violation PC=0x723155313e3c m=30 sigcode=1 addr=0x52 signal arrived during cgo execution goroutine 13 gp=0xc000702fc0 m=30 mp=0xc000f88008 [syscall]: runtime.cgocall(0x5a31c524e760, 0xc000de1568) runtime/cgocall.go:167 +0x4b fp=0xc000de1540 sp=0xc000de1508 pc=0x5a31c453f62b github.com/ollama/ollama/ml/backend/ggml._Cfunc_ggml_backend_sched_graph_compute_async(0x723178100860, 0x7230d4cbdd60) _cgo_gotypes.go:961 +0x4a fp=0xc000de1568 sp=0xc000de1540 pc=0x5a31c497482a github.com/ollama/ollama/ml/backend/ggml.(*Context).ComputeWithNotify.func2(...) github.com/ollama/ollama/ml/backend/ggml/ggml.go:826 github.com/ollama/ollama/ml/backend/ggml.(*Context).ComputeWithNotify(0xc0011a12c0, 0x5a31c45450a9?, {0xc000044c10, 0x1, 0xc000044c01?}) github.com/ollama/ollama/ml/backend/ggml/ggml.go:826 +0x1b2 fp=0xc000de1640 sp=0xc000de1568 pc=0x5a31c4982232 github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute(0xc0011a12c0?, {0xc000044c10?, 0x1?, 0x5a31c4520c89?}) github.com/ollama/ollama/ml/backend/ggml/ggml.go:812 +0x25 fp=0xc000de1678 sp=0xc000de1640 pc=0x5a31c4982045 github.com/ollama/ollama/runner/ollamarunner.multimodalStore.getTensor(0x5a31c5890be0?, {0x5a31c5a5ee58, 0xc000151760}, {0x5a31c5a638b0, 0xc0011a1200}, {0x5a31c5a6dd20, 0xc0041b7e60}, 0x0) github.com/ollama/ollama/runner/ollamarunner/multimodal.go:93 +0x2f4 fp=0xc000de1788 sp=0xc000de1678 pc=0x5a31c4a49e94 github.com/ollama/ollama/runner/ollamarunner.multimodalStore.getMultimodal(0xc00119f200, {0x5a31c5a5ee58, 0xc000151760}, {0x5a31c5a638b0, 0xc0011a1200}, {0xc0003ca3c0, 0x1, 0xfffffffffffffffc?}, 0x0) github.com/ollama/ollama/runner/ollamarunner/multimodal.go:56 +0xe5 fp=0xc000de17f0 sp=0xc000de1788 pc=0x5a31c4a49a85 github.com/ollama/ollama/runner/ollamarunner.(*Server).forwardBatch(_, {0x0, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0, 0x0}, {{0x0, ...}, ...}, ...}) github.com/ollama/ollama/runner/ollamarunner/runner.go:584 +0x1217 fp=0xc000de1b58 sp=0xc000de17f0 pc=0x5a31c4a4d0f7 github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0002230e0, {0x5a31c5a58f00, 0xc00051f770}) github.com/ollama/ollama/runner/ollamarunner/runner.go:452 +0x18c fp=0xc000de1fb8 sp=0xc000de1b58 pc=0x5a31c4a4bc8c github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap1() github.com/ollama/ollama/runner/ollamarunner/runner.go:1411 +0x28 fp=0xc000de1fe0 sp=0xc000de1fb8 pc=0x5a31c4a551e8 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000de1fe8 sp=0xc000de1fe0 pc=0x5a31c454a941 created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1 github.com/ollama/ollama/runner/ollamarunner/runner.go:1411 +0x4c9 goroutine 1 gp=0xc000002380 m=nil [IO wait]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000ddf790 sp=0xc000ddf770 pc=0x5a31c4542aae runtime.netpollblock(0xc0004ad7e0?, 0xc44dc1e6?, 0x31?) runtime/netpoll.go:575 +0xf7 fp=0xc000ddf7c8 sp=0xc000ddf790 pc=0x5a31c4507dd7 internal/poll.runtime_pollWait(0x7231e5a1ade0, 0x72) runtime/netpoll.go:351 +0x85 fp=0xc000ddf7e8 sp=0xc000ddf7c8 pc=0x5a31c4541cc5 internal/poll.(*pollDesc).wait(0xc0006a2100?, 0x900000036?, 0x0) internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000ddf810 sp=0xc000ddf7e8 pc=0x5a31c45c9c07 internal/poll.(*pollDesc).waitRead(...) internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Accept(0xc0006a2100) internal/poll/fd_unix.go:620 +0x295 fp=0xc000ddf8b8 sp=0xc000ddf810 pc=0x5a31c45cefd5 net.(*netFD).accept(0xc0006a2100) net/fd_unix.go:172 +0x29 fp=0xc000ddf970 sp=0xc000ddf8b8 pc=0x5a31c4641ea9 net.(*TCPListener).accept(0xc000519800) net/tcpsock_posix.go:159 +0x1b fp=0xc000ddf9c0 sp=0xc000ddf970 pc=0x5a31c465785b net.(*TCPListener).Accept(0xc000519800) net/tcpsock.go:380 +0x30 fp=0xc000ddf9f0 sp=0xc000ddf9c0 pc=0x5a31c4656710 net/http.(*onceCloseListener).Accept(0xc0002e43f0?) <autogenerated>:1 +0x24 fp=0xc000ddfa08 sp=0xc000ddf9f0 pc=0x5a31c486dee4 net/http.(*Server).Serve(0xc000051100, {0x5a31c5a56928, 0xc000519800}) net/http/server.go:3424 +0x30c fp=0xc000ddfb38 sp=0xc000ddfa08 pc=0x5a31c48457ac github.com/ollama/ollama/runner/ollamarunner.Execute({0xc00012a030, 0x4, 0x4}) github.com/ollama/ollama/runner/ollamarunner/runner.go:1434 +0x94e fp=0xc000ddfd08 sp=0xc000ddfb38 pc=0x5a31c4a54f6e github.com/ollama/ollama/runner.Execute({0xc00012a010?, 0x0?, 0x0?}) github.com/ollama/ollama/runner/runner.go:20 +0xc9 fp=0xc000ddfd30 sp=0xc000ddfd08 pc=0x5a31c4a55869 github.com/ollama/ollama/cmd.NewCLI.func2(0xc000050f00?, {0x5a31c555e0ab?, 0x4?, 0x5a31c555e0af?}) github.com/ollama/ollama/cmd/cmd.go:1841 +0x45 fp=0xc000ddfd58 sp=0xc000ddfd30 pc=0x5a31c51e05c5 github.com/spf13/cobra.(*Command).execute(0xc0002e9508, {0xc00051f6d0, 0x5, 0x5}) github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000ddfe78 sp=0xc000ddfd58 pc=0x5a31c46bb4fc github.com/spf13/cobra.(*Command).ExecuteC(0xc0000f2908) github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000ddff30 sp=0xc000ddfe78 pc=0x5a31c46bbd45 github.com/spf13/cobra.(*Command).Execute(...) github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) github.com/spf13/cobra@v1.7.0/command.go:985 main.main() github.com/ollama/ollama/main.go:12 +0x4d fp=0xc000ddff50 sp=0xc000ddff30 pc=0x5a31c51e10ad runtime.main() runtime/proc.go:283 +0x29d fp=0xc000ddffe0 sp=0xc000ddff50 pc=0x5a31c450f45d runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000ddffe8 sp=0xc000ddffe0 pc=0x5a31c454a941 goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000aafa8 sp=0xc0000aaf88 pc=0x5a31c4542aae runtime.goparkunlock(...) runtime/proc.go:441 runtime.forcegchelper() runtime/proc.go:348 +0xb8 fp=0xc0000aafe0 sp=0xc0000aafa8 pc=0x5a31c450f798 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000aafe8 sp=0xc0000aafe0 pc=0x5a31c454a941 created by runtime.init.7 in goroutine 1 runtime/proc.go:336 +0x1a goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000ab780 sp=0xc0000ab760 pc=0x5a31c4542aae runtime.goparkunlock(...) runtime/proc.go:441 runtime.bgsweep(0xc0000d6000) runtime/mgcsweep.go:316 +0xdf fp=0xc0000ab7c8 sp=0xc0000ab780 pc=0x5a31c44f9f3f runtime.gcenable.gowrap1() runtime/mgc.go:204 +0x25 fp=0xc0000ab7e0 sp=0xc0000ab7c8 pc=0x5a31c44ee325 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000ab7e8 sp=0xc0000ab7e0 pc=0x5a31c454a941 created by runtime.gcenable in goroutine 1 runtime/mgc.go:204 +0x66 goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]: runtime.gopark(0x10000?, 0x5a31c57268a0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000abf78 sp=0xc0000abf58 pc=0x5a31c4542aae runtime.goparkunlock(...) runtime/proc.go:441 runtime.(*scavengerState).park(0x5a31c63120a0) runtime/mgcscavenge.go:425 +0x49 fp=0xc0000abfa8 sp=0xc0000abf78 pc=0x5a31c44f7989 runtime.bgscavenge(0xc0000d6000) runtime/mgcscavenge.go:658 +0x59 fp=0xc0000abfc8 sp=0xc0000abfa8 pc=0x5a31c44f7f19 runtime.gcenable.gowrap2() runtime/mgc.go:205 +0x25 fp=0xc0000abfe0 sp=0xc0000abfc8 pc=0x5a31c44ee2c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000abfe8 sp=0xc0000abfe0 pc=0x5a31c454a941 created by runtime.gcenable in goroutine 1 runtime/mgc.go:205 +0xa5 goroutine 18 gp=0xc000104380 m=nil [finalizer wait]: runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc0000aa688?) runtime/proc.go:435 +0xce fp=0xc0000aa630 sp=0xc0000aa610 pc=0x5a31c4542aae runtime.runfinq() runtime/mfinal.go:196 +0x107 fp=0xc0000aa7e0 sp=0xc0000aa630 pc=0x5a31c44ed2e7 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000aa7e8 sp=0xc0000aa7e0 pc=0x5a31c454a941 created by runtime.createfing in goroutine 1 runtime/mfinal.go:166 +0x3d goroutine 19 gp=0xc000104e00 m=nil [chan receive]: runtime.gopark(0xc000221860?, 0xc068300018?, 0x60?, 0x67?, 0x5a31c4628ae8?) runtime/proc.go:435 +0xce fp=0xc0000a6718 sp=0xc0000a66f8 pc=0x5a31c4542aae runtime.chanrecv(0xc000100310, 0x0, 0x1) runtime/chan.go:664 +0x445 fp=0xc0000a6790 sp=0xc0000a6718 pc=0x5a31c44dedc5 runtime.chanrecv1(0x0?, 0x0?) runtime/chan.go:506 +0x12 fp=0xc0000a67b8 sp=0xc0000a6790 pc=0x5a31c44de952 runtime.unique_runtime_registerUniqueMapCleanup.func2(...) runtime/mgc.go:1796 runtime.unique_runtime_registerUniqueMapCleanup.gowrap1() runtime/mgc.go:1799 +0x2f fp=0xc0000a67e0 sp=0xc0000a67b8 pc=0x5a31c44f14cf runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a67e8 sp=0xc0000a67e0 pc=0x5a31c454a941 created by unique.runtime_registerUniqueMapCleanup in goroutine 1 runtime/mgc.go:1794 +0x85 goroutine 20 gp=0xc000105180 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000a6f38 sp=0xc0000a6f18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000a6fc8 sp=0xc0000a6f38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000a6fe0 sp=0xc0000a6fc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a6fe8 sp=0xc0000a6fe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 21 gp=0xc000105340 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000a7738 sp=0xc0000a7718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000a77c8 sp=0xc0000a7738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000a77e0 sp=0xc0000a77c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a77e8 sp=0xc0000a77e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 34 gp=0xc0002bc000 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002c2738 sp=0xc0002c2718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002c27c8 sp=0xc0002c2738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002c27e0 sp=0xc0002c27c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c27e8 sp=0xc0002c27e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 35 gp=0xc0002bc1c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002c2f38 sp=0xc0002c2f18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002c2fc8 sp=0xc0002c2f38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002c2fe0 sp=0xc0002c2fc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c2fe8 sp=0xc0002c2fe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 36 gp=0xc0002bc380 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002c3738 sp=0xc0002c3718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002c37c8 sp=0xc0002c3738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002c37e0 sp=0xc0002c37c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c37e8 sp=0xc0002c37e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 37 gp=0xc0002bc540 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002c3f38 sp=0xc0002c3f18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002c3fc8 sp=0xc0002c3f38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002c3fe0 sp=0xc0002c3fc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c3fe8 sp=0xc0002c3fe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 38 gp=0xc0002bc700 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002c4738 sp=0xc0002c4718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002c47c8 sp=0xc0002c4738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002c47e0 sp=0xc0002c47c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c47e8 sp=0xc0002c47e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 39 gp=0xc0002bc8c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002c4f38 sp=0xc0002c4f18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002c4fc8 sp=0xc0002c4f38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002c4fe0 sp=0xc0002c4fc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c4fe8 sp=0xc0002c4fe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 5 gp=0xc000003dc0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000ac738 sp=0xc0000ac718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000ac7c8 sp=0xc0000ac738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000ac7e0 sp=0xc0000ac7c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000ac7e8 sp=0xc0000ac7e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 6 gp=0xc0000ee000 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000acf38 sp=0xc0000acf18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000acfc8 sp=0xc0000acf38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000acfe0 sp=0xc0000acfc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000acfe8 sp=0xc0000acfe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 7 gp=0xc0000ee1c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000ad738 sp=0xc0000ad718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000ad7c8 sp=0xc0000ad738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000ad7e0 sp=0xc0000ad7c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000ad7e8 sp=0xc0000ad7e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 8 gp=0xc0000ee380 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000adf38 sp=0xc0000adf18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000adfc8 sp=0xc0000adf38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000adfe0 sp=0xc0000adfc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000adfe8 sp=0xc0000adfe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 9 gp=0xc0000ee540 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002be738 sp=0xc0002be718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002be7c8 sp=0xc0002be738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002be7e0 sp=0xc0002be7c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002be7e8 sp=0xc0002be7e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 22 gp=0xc000105500 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a6d7814?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000a7f38 sp=0xc0000a7f18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000a7fc8 sp=0xc0000a7f38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000a7fe0 sp=0xc0000a7fc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a7fe8 sp=0xc0000a7fe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 40 gp=0xc0002bca80 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a81d3ea?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002c5738 sp=0xc0002c5718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002c57c8 sp=0xc0002c5738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002c57e0 sp=0xc0002c57c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c57e8 sp=0xc0002c57e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 41 gp=0xc0002bcc40 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a6da92e?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002c5f38 sp=0xc0002c5f18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002c5fc8 sp=0xc0002c5f38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002c5fe0 sp=0xc0002c5fc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c5fe8 sp=0xc0002c5fe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 42 gp=0xc0002bce00 m=nil [GC worker (idle)]: runtime.gopark(0x5a31c63c1e40?, 0x1?, 0xdf?, 0x7d?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002ca738 sp=0xc0002ca718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002ca7c8 sp=0xc0002ca738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002ca7e0 sp=0xc0002ca7c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002ca7e8 sp=0xc0002ca7e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 43 gp=0xc0002bcfc0 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a6e4d79?, 0x1?, 0xaa?, 0x13?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002caf38 sp=0xc0002caf18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002cafc8 sp=0xc0002caf38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002cafe0 sp=0xc0002cafc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002cafe8 sp=0xc0002cafe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 44 gp=0xc0002bd180 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a6dbb4e?, 0x1?, 0xfa?, 0xd1?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002cb738 sp=0xc0002cb718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002cb7c8 sp=0xc0002cb738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002cb7e0 sp=0xc0002cb7c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002cb7e8 sp=0xc0002cb7e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 45 gp=0xc0002bd340 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a6da212?, 0x1?, 0x81?, 0x44?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002cbf38 sp=0xc0002cbf18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002cbfc8 sp=0xc0002cbf38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002cbfe0 sp=0xc0002cbfc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002cbfe8 sp=0xc0002cbfe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 46 gp=0xc0002bd500 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a822cbe?, 0x3?, 0x8e?, 0xa5?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002cc738 sp=0xc0002cc718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002cc7c8 sp=0xc0002cc738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002cc7e0 sp=0xc0002cc7c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002cc7e8 sp=0xc0002cc7e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 47 gp=0xc0002bd6c0 m=nil [GC worker (idle)]: runtime.gopark(0x5a31c63c1e40?, 0x1?, 0xc2?, 0xb7?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002ccf38 sp=0xc0002ccf18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002ccfc8 sp=0xc0002ccf38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002ccfe0 sp=0xc0002ccfc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002ccfe8 sp=0xc0002ccfe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 48 gp=0xc0002bd880 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a6e2c14?, 0x1?, 0x61?, 0xad?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002cd738 sp=0xc0002cd718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002cd7c8 sp=0xc0002cd738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002cd7e0 sp=0xc0002cd7c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002cd7e8 sp=0xc0002cd7e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 10 gp=0xc0000ee700 m=nil [GC worker (idle)]: runtime.gopark(0x5a31c63c1e40?, 0x1?, 0xa8?, 0xc2?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002bef38 sp=0xc0002bef18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002befc8 sp=0xc0002bef38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002befe0 sp=0xc0002befc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002befe8 sp=0xc0002befe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 23 gp=0xc000105a40 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a6bce44?, 0x3?, 0xe4?, 0x2?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000a8738 sp=0xc0000a8718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000a87c8 sp=0xc0000a8738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000a87e0 sp=0xc0000a87c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a87e8 sp=0xc0000a87e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 24 gp=0xc000105c00 m=nil [GC worker (idle)]: runtime.gopark(0x5a31c63c1e40?, 0x3?, 0xd7?, 0x19?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000a8f38 sp=0xc0000a8f18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000a8fc8 sp=0xc0000a8f38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000a8fe0 sp=0xc0000a8fc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a8fe8 sp=0xc0000a8fe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 25 gp=0xc000105dc0 m=nil [GC worker (idle)]: runtime.gopark(0x5a31c63c1e40?, 0x1?, 0xd0?, 0x9f?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000a9738 sp=0xc0000a9718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000a97c8 sp=0xc0000a9738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000a97e0 sp=0xc0000a97c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a97e8 sp=0xc0000a97e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 26 gp=0xc00049c000 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a8244a6?, 0x3?, 0xd6?, 0x18?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0000a9f38 sp=0xc0000a9f18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0000a9fc8 sp=0xc0000a9f38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000a9fe0 sp=0xc0000a9fc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a9fe8 sp=0xc0000a9fe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 50 gp=0xc000504000 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a823236?, 0x3?, 0x8f?, 0xf?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002c6738 sp=0xc0002c6718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002c67c8 sp=0xc0002c6738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002c67e0 sp=0xc0002c67c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002c67e8 sp=0xc0002c67e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 27 gp=0xc00049c1c0 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a81e218?, 0x1?, 0x9a?, 0x36?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0004a2738 sp=0xc0004a2718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0004a27c8 sp=0xc0004a2738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0004a27e0 sp=0xc0004a27c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0004a27e8 sp=0xc0004a27e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 11 gp=0xc0000ee8c0 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a81e16e?, 0x1?, 0x9?, 0x5c?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002bf738 sp=0xc0002bf718 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002bf7c8 sp=0xc0002bf738 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002bf7e0 sp=0xc0002bf7c8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002bf7e8 sp=0xc0002bf7e0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 12 gp=0xc0000eea80 m=nil [GC worker (idle)]: runtime.gopark(0x1c5a33a820982?, 0x1?, 0x92?, 0x38?, 0x0?) runtime/proc.go:435 +0xce fp=0xc0002bff38 sp=0xc0002bff18 pc=0x5a31c4542aae runtime.gcBgMarkWorker(0xc000101570) runtime/mgc.go:1423 +0xe9 fp=0xc0002bffc8 sp=0xc0002bff38 pc=0x5a31c44f07e9 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0002bffe0 sp=0xc0002bffc8 pc=0x5a31c44f06c5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0002bffe8 sp=0xc0002bffe0 pc=0x5a31c454a941 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 14 gp=0xc000703180 m=nil [select]: runtime.gopark(0xc000049a08?, 0x2?, 0x0?, 0x0?, 0xc00004986c?) runtime/proc.go:435 +0xce fp=0xc000049698 sp=0xc000049678 pc=0x5a31c4542aae runtime.selectgo(0xc000049a08, 0xc000049868, 0x87?, 0x0, 0x1?, 0x1) runtime/select.go:351 +0x837 fp=0xc0000497d0 sp=0xc000049698 pc=0x5a31c4521957 github.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc0002230e0, {0x5a31c5a56b08, 0xc0011aa540}, 0xc0005208c0) github.com/ollama/ollama/runner/ollamarunner/runner.go:950 +0xc4e fp=0xc000049ac0 sp=0xc0000497d0 pc=0x5a31c4a503ae github.com/ollama/ollama/runner/ollamarunner.(*Server).completion-fm({0x5a31c5a56b08?, 0xc0011aa540?}, 0xc000049b40?) <autogenerated>:1 +0x36 fp=0xc000049af0 sp=0xc000049ac0 pc=0x5a31c4a556d6 net/http.HandlerFunc.ServeHTTP(0xc00051a780?, {0x5a31c5a56b08?, 0xc0011aa540?}, 0xc000049b60?) net/http/server.go:2294 +0x29 fp=0xc000049b18 sp=0xc000049af0 pc=0x5a31c4841de9 net/http.(*ServeMux).ServeHTTP(0x5a31c44e7805?, {0x5a31c5a56b08, 0xc0011aa540}, 0xc0005208c0) net/http/server.go:2822 +0x1c4 fp=0xc000049b68 sp=0xc000049b18 pc=0x5a31c4843ce4 net/http.serverHandler.ServeHTTP({0x5a31c5a53110?}, {0x5a31c5a56b08?, 0xc0011aa540?}, 0x1?) net/http/server.go:3301 +0x8e fp=0xc000049b98 sp=0xc000049b68 pc=0x5a31c486176e net/http.(*conn).serve(0xc0002e43f0, {0x5a31c5a58ec8, 0xc0002e0e10}) net/http/server.go:2102 +0x625 fp=0xc000049fb8 sp=0xc000049b98 pc=0x5a31c48402e5 net/http.(*Server).Serve.gowrap3() net/http/server.go:3454 +0x28 fp=0xc000049fe0 sp=0xc000049fb8 pc=0x5a31c4845ba8 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000049fe8 sp=0xc000049fe0 pc=0x5a31c454a941 created by net/http.(*Server).Serve in goroutine 1 net/http/server.go:3454 +0x485 goroutine 1098 gp=0xc000504fc0 m=nil [IO wait]: runtime.gopark(0x4786b5804786b500?, 0x4786b6804786b600?, 0x0?, 0xb7?, 0xb?) runtime/proc.go:435 +0xce fp=0xc0039795d8 sp=0xc0039795b8 pc=0x5a31c4542aae runtime.netpollblock(0x5a31c4566158?, 0xc44dc1e6?, 0x31?) runtime/netpoll.go:575 +0xf7 fp=0xc003979610 sp=0xc0039795d8 pc=0x5a31c4507dd7 internal/poll.runtime_pollWait(0x7231e5a1acc8, 0x72) runtime/netpoll.go:351 +0x85 fp=0xc003979630 sp=0xc003979610 pc=0x5a31c4541cc5 internal/poll.(*pollDesc).wait(0xc0006a2180?, 0xc0002e0f11?, 0x0) internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc003979658 sp=0xc003979630 pc=0x5a31c45c9c07 internal/poll.(*pollDesc).waitRead(...) internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc0006a2180, {0xc0002e0f11, 0x1, 0x1}) internal/poll/fd_unix.go:165 +0x27a fp=0xc0039796f0 sp=0xc003979658 pc=0x5a31c45caefa net.(*netFD).Read(0xc0006a2180, {0xc0002e0f11?, 0xc0005198d8?, 0xc003979770?}) net/fd_posix.go:55 +0x25 fp=0xc003979738 sp=0xc0039796f0 pc=0x5a31c463ff05 net.(*conn).Read(0xc0000ae6e0, {0xc0002e0f11?, 0xc000127000?, 0x5a31c48ab200?}) net/net.go:194 +0x45 fp=0xc003979780 sp=0xc003979738 pc=0x5a31c464e2c5 net/http.(*connReader).backgroundRead(0xc0002e0f00) net/http/server.go:690 +0x37 fp=0xc0039797c8 sp=0xc003979780 pc=0x5a31c483a1b7 net/http.(*connReader).startBackgroundRead.gowrap2() net/http/server.go:686 +0x25 fp=0xc0039797e0 sp=0xc0039797c8 pc=0x5a31c483a0e5 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0039797e8 sp=0xc0039797e0 pc=0x5a31c454a941 created by net/http.(*connReader).startBackgroundRead in goroutine 14 net/http/server.go:686 +0xb6 rax 0x0 rbx 0x72315c0171c0 rcx 0x0 rdx 0x723155352a40 rdi 0x7231553134cd rsi 0x43 rbp 0x72312a9089c0 rsp 0x72312a907ce0 r8 0x0 r9 0x7230d409b930 r10 0x7230d4cc1248 r11 0x22 r12 0x20 r13 0x72312a908aa0 r14 0x7231797a3e48 r15 0x7230d409b930 rip 0x723155313e3c rflags 0x10206 cs 0x33 fs 0x0 gs 0x0 time=2025-11-19T02:03:49.568Z level=ERROR source=server.go:1539 msg="post predict" error="Post \"http://127.0.0.1:37865/completion\": EOF" [GIN] 2025/11/19 - 02:03:49 | 500 | 11.199601469s | 10.1.3.13 | POST "/api/generate" time=2025-11-19T02:03:49.568Z level=DEBUG source=sched.go:537 msg="context for request finished" time=2025-11-19T02:03:49.568Z level=DEBUG source=sched.go:290 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/qwen2.5vl:32b runner.inference="[{ID:00000000-c500-0000-0000-000000000000 Library:Vulkan}]" runner.size="52.8 GiB" runner.vram="52.8 GiB" runner.parallel=2 runner.pid=216 runner.model=/root/.ollama/models/blobs/sha256-043a363c6ca35e3b1a29b8a5b0bbd28474820239bbc5ad943c9be18f0dc77b66 runner.num_ctx=65536 duration=1h0m0s time=2025-11-19T02:03:49.568Z level=DEBUG source=sched.go:308 msg="after processing request finished event" runner.name=registry.ollama.ai/library/qwen2.5vl:32b runner.inference="[{ID:00000000-c500-0000-0000-000000000000 Library:Vulkan}]" runner.size="52.8 GiB" runner.vram="52.8 GiB" runner.parallel=2 runner.pid=216 ``` ### OS Linux ### GPU AMD ### CPU AMD ### Ollama version 0.12.11
GiteaMirror added the vulkanbug labels 2026-04-22 18:03:28 -05:00
GiteaMirror commented 2026-04-22 18:03:30 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (Dec 5, 2025):

Please give the 0.13.2 RC a try and see if you see better results
https://github.com/ollama/ollama/releases

<!-- gh-comment-id:3614879304 --> @dhiltgen commented on GitHub (Dec 5, 2025): Please give the 0.13.2 RC a try and see if you see better results https://github.com/ollama/ollama/releases
GiteaMirror commented 2026-04-22 18:03:30 -05:00
Author
Owner
Copy Link

@adamyang1980 commented on GitHub (Dec 5, 2025):

After testing, version 0.13.2-rc1 can now run and invoke the qwen2.5-vl model for OCR processing normally when OLLAMA_VULKAN is set to 1. thank you.

<!-- gh-comment-id:3615392172 --> @adamyang1980 commented on GitHub (Dec 5, 2025): After testing, version 0.13.2-rc1 can now run and invoke the qwen2.5-vl model for OCR processing normally when OLLAMA_VULKAN is set to 1. thank you.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug vulkan
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#34455
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?