[GH-ISSUE #14939] Qwen3.5 0.8b keeps printing 'kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation', and finally times out and crashes. #35372

New Issue

Closed

opened 2026-04-22 19:50:42 -05:00 by GiteaMirror · 1 comment

GiteaMirror commented 2026-04-22 19:50:42 -05:00

Owner

Copy Link

Originally created by @zhangyy130 on GitHub (Mar 18, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/14939

What is the issue?

"Qwen3.5 0.8b keeps printing 'kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation', and finally times out and crashes."

time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.pooling_type default=0
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.head_count_kv default=0
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.type default=""
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.type default=""
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.factor default=1
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.original_context_length default=0
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.scale default=0
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_used_count default=0
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.norm_top_k_prob default=true
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.mrope_interleaved default=false
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.attention.layer_norm_epsilon default=9.999999974752427e-07
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.rope.freq_base default=10000
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.num_positional_embeddings default=2304
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=false
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
time=2026-03-18T23:52:26.546+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=583 splits=1
time=2026-03-18T23:52:26.681+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=12549 splits=4
time=2026-03-18T23:52:26.714+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=1813 splits=2
time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:240 msg="model weights" device=CUDA0 size="974.5 MiB"
time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:245 msg="model weights" device=CPU size="259.8 MiB"
time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:251 msg="kv cache" device=CUDA0 size="577.6 MiB"
time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:262 msg="compute graph" device=CUDA0 size="498.1 MiB"
time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:267 msg="compute graph" device=CPU size="7.9 MiB"
time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:272 msg="total memory" size="2.3 GiB"
time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=server.go:782 msg=memory success=true required.InputWeights=272412672 required.CPU.Graph=8302592 required.CUDA0.ID=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 required.CUDA0.Weights="[42488576 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 471614464]" required.CUDA0.Cache="[28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 0]" required.CUDA0.Graph=522301440
time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=server.go:976 msg="available gpu" id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 library=CUDA "available layer vram"="21.6 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="498.1 MiB"
time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=server.go:793 msg="new layout created" layers="25[ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Layers:25(0..24)]"
time=2026-03-18T23:52:26.716+08:00 level=INFO source=runner.go:1284 msg=load request="{Operation:alloc LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:8192 KvCacheType: NumThreads:8 GPULayers:25[ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Layers:25(0..24)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
time=2026-03-18T23:52:26.738+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.alignment default=32
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.pooling_type default=0
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.head_count_kv default=0
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.type default=""
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.type default=""
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.factor default=1
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.original_context_length default=0
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.scale default=0
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_used_count default=0
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.norm_top_k_prob default=true
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.mrope_interleaved default=false
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.attention.layer_norm_epsilon default=9.999999974752427e-07
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.rope.freq_base default=10000
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.num_positional_embeddings default=2304
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=false
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
time=2026-03-18T23:52:26.917+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=583 splits=1
time=2026-03-18T23:52:27.040+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=12549 splits=4
time=2026-03-18T23:52:27.044+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=1813 splits=2
time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:240 msg="model weights" device=CUDA0 size="974.5 MiB"
time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:245 msg="model weights" device=CPU size="259.8 MiB"
time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:251 msg="kv cache" device=CUDA0 size="577.6 MiB"
time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:262 msg="compute graph" device=CUDA0 size="498.1 MiB"
time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:267 msg="compute graph" device=CPU size="7.9 MiB"
time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:272 msg="total memory" size="2.3 GiB"
time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=server.go:782 msg=memory success=true required.InputWeights=272412672 required.CPU.Graph=8302592 required.CUDA0.ID=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 required.CUDA0.Weights="[42488576 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 471614464]" required.CUDA0.Cache="[28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 0]" required.CUDA0.Graph=522301440
time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=server.go:976 msg="available gpu" id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 library=CUDA "available layer vram"="21.6 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="498.1 MiB"
time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=server.go:793 msg="new layout created" layers="25[ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Layers:25(0..24)]"
time=2026-03-18T23:52:27.045+08:00 level=INFO source=runner.go:1284 msg=load request="{Operation:commit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:8192 KvCacheType: NumThreads:8 GPULayers:25[ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Layers:25(0..24)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
time=2026-03-18T23:52:27.045+08:00 level=INFO source=ggml.go:482 msg="offloading 24 repeating layers to GPU"
time=2026-03-18T23:52:27.045+08:00 level=INFO source=ggml.go:489 msg="offloading output layer to GPU"
time=2026-03-18T23:52:27.045+08:00 level=INFO source=ggml.go:494 msg="offloaded 25/25 layers to GPU"
time=2026-03-18T23:52:27.045+08:00 level=INFO source=device.go:240 msg="model weights" device=CUDA0 size="974.5 MiB"
time=2026-03-18T23:52:27.045+08:00 level=INFO source=device.go:245 msg="model weights" device=CPU size="259.8 MiB"
time=2026-03-18T23:52:27.045+08:00 level=INFO source=device.go:251 msg="kv cache" device=CUDA0 size="577.6 MiB"
time=2026-03-18T23:52:27.046+08:00 level=INFO source=device.go:262 msg="compute graph" device=CUDA0 size="498.1 MiB"
time=2026-03-18T23:52:27.046+08:00 level=INFO source=device.go:267 msg="compute graph" device=CPU size="7.9 MiB"
time=2026-03-18T23:52:27.046+08:00 level=INFO source=device.go:272 msg="total memory" size="2.3 GiB"
time=2026-03-18T23:52:27.046+08:00 level=INFO source=sched.go:565 msg="loaded runners" count=1
time=2026-03-18T23:52:27.046+08:00 level=DEBUG source=sched.go:729 msg="evaluating already loaded" model=C:\Users\Administrator.ollama\models\blobs\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5
time=2026-03-18T23:52:27.046+08:00 level=INFO source=server.go:1350 msg="waiting for llama runner to start responding"
time=2026-03-18T23:52:27.046+08:00 level=INFO source=server.go:1384 msg="waiting for server to become available" status="llm server loading model"
time=2026-03-18T23:52:27.046+08:00 level=DEBUG source=server.go:1394 msg="model load progress 0.00"
time=2026-03-18T23:52:27.251+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.pooling_type default=0
time=2026-03-18T23:52:27.297+08:00 level=INFO source=server.go:1388 msg="llama runner started in 1.23 seconds"
time=2026-03-18T23:52:27.297+08:00 level=DEBUG source=sched.go:577 msg="finished setting up" runner.name=registry.ollama.ai/library/qwen3.5:0.8b runner.inference="[{ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Library:CUDA}]" runner.size="2.3 GiB" runner.vram="2.3 GiB" runner.parallel=1 runner.pid=73136 runner.model=C:\Users\Administrator.ollama\models\blobs\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5 runner.num_ctx=8192
time=2026-03-18T23:52:27.297+08:00 level=DEBUG source=sched.go:729 msg="evaluating already loaded" model=C:\Users\Administrator.ollama\models\blobs\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5
time=2026-03-18T23:52:27.298+08:00 level=DEBUG source=sched.go:729 msg="evaluating already loaded" model=C:\Users\Administrator.ollama\models\blobs\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5
time=2026-03-18T23:52:27.318+08:00 level=DEBUG source=server.go:1536 msg="completion request" images=0 prompt=984 format=""
time=2026-03-18T23:52:27.318+08:00 level=DEBUG source=server.go:1536 msg="completion request" images=0 prompt=969 format=""
time=2026-03-18T23:52:27.318+08:00 level=DEBUG source=server.go:1536 msg="completion request" images=0 prompt=997 format=""
time=2026-03-18T23:52:27.318+08:00 level=DEBUG source=server.go:1536 msg="completion request" images=0 prompt=1160 format=""
time=2026-03-18T23:52:27.336+08:00 level=DEBUG source=cache.go:151 msg="loading cache slot" id=0 cache=0 prompt=228 used=0 remaining=228
time=2026-03-18T23:52:59.323+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:52:59.323+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:53:16.441+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:53:16.441+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:53:33.563+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:53:33.563+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:53:50.655+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:53:50.655+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:54:07.745+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:54:07.745+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:54:24.773+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:54:24.773+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:54:41.875+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:54:41.875+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:54:58.948+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:54:58.948+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:55:16.062+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:55:16.062+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:55:33.131+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:55:33.131+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:55:50.262+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:55:50.262+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:56:07.325+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:56:07.325+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:56:24.404+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:56:24.404+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:56:41.476+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:56:41.476+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:56:58.541+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:56:58.541+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:57:15.760+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094
time=2026-03-18T23:57:15.760+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation"
time=2026-03-18T23:57:24.659+08:00 level=INFO source=server.go:1568 msg="aborting completion request due to client closing the connection"
time=2026-03-18T23:57:24.659+08:00 level=DEBUG source=sched.go:431 msg="context for request finished" runner.name=registry.ollama.ai/library/qwen3.5:0.8b runner.inference="[{ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Library:CUDA}]" runner.size="2.3 GiB" runner.vram="2.3 GiB" runner.parallel=1 runner.pid=73136

log.txt

Relevant log output

C:\Users\Administrator>ollama serve
Error: listen tcp 0.0.0.0:11434: bind: Only one usage of each socket address (protocol/network address/port) is normally permitted.

C:\Users\Administrator>ollama serve
time=2026-03-18T23:52:24.556+08:00 level=INFO source=routes.go:1727 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:8192 OLLAMA_DEBUG:DEBUG OLLAMA_EDITOR: OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\Administrator\\.ollama\\models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NO_CLOUD:false OLLAMA_NUM_PARALLEL:4 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES:]"
time=2026-03-18T23:52:24.568+08:00 level=INFO source=routes.go:1729 msg="Ollama cloud disabled: false"
time=2026-03-18T23:52:24.582+08:00 level=INFO source=images.go:477 msg="total blobs: 72"
time=2026-03-18T23:52:24.589+08:00 level=INFO source=images.go:484 msg="total unused blobs removed: 0"
time=2026-03-18T23:52:24.593+08:00 level=INFO source=routes.go:1782 msg="Listening on [::]:11434 (version 0.18.1)"
time=2026-03-18T23:52:24.593+08:00 level=DEBUG source=sched.go:145 msg="starting llm scheduler"
time=2026-03-18T23:52:24.594+08:00 level=INFO source=runner.go:67 msg="discovering available GPUs..."
time=2026-03-18T23:52:24.622+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61432"
time=2026-03-18T23:52:24.622+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v12;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12
time=2026-03-18T23:52:24.886+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=272.9297ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v12]" extra_envs=map[]
time=2026-03-18T23:52:24.888+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61447"
time=2026-03-18T23:52:24.888+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13
time=2026-03-18T23:52:25.134+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=247.62ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13]" extra_envs=map[]
time=2026-03-18T23:52:25.135+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61461"
time=2026-03-18T23:52:25.135+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\rocm;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\rocm
time=2026-03-18T23:52:25.314+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=179.8718ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\rocm]" extra_envs=map[]
time=2026-03-18T23:52:25.314+08:00 level=INFO source=runner.go:106 msg="experimental Vulkan support disabled.  To enable, set OLLAMA_VULKAN=1"
time=2026-03-18T23:52:25.314+08:00 level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=2
time=2026-03-18T23:52:25.314+08:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12 description="NVIDIA GeForce RTX 3090" compute=8.6 id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 pci_id=0000:01:00.0
time=2026-03-18T23:52:25.314+08:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13 description="NVIDIA GeForce RTX 3090" compute=8.6 id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 pci_id=0000:01:00.0
time=2026-03-18T23:52:25.316+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61476"
time=2026-03-18T23:52:25.316+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61475"
time=2026-03-18T23:52:25.316+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13 CUDA_VISIBLE_DEVICES=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 GGML_CUDA_INIT=1
time=2026-03-18T23:52:25.316+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v12;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12 GGML_CUDA_INIT=1 CUDA_VISIBLE_DEVICES=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178
time=2026-03-18T23:52:25.585+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=271.3152ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 GGML_CUDA_INIT:1]"
time=2026-03-18T23:52:25.617+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=303.0219ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v12]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 GGML_CUDA_INIT:1]"
time=2026-03-18T23:52:25.617+08:00 level=DEBUG source=runner.go:401 msg="filtering device with overlapping libraries" id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 library=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12 delete_index=0 kept_library=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13
time=2026-03-18T23:52:25.617+08:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=1.0241201s
time=2026-03-18T23:52:25.617+08:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 filter_id="" library=CUDA compute=8.6 name=CUDA0 description="NVIDIA GeForce RTX 3090" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="24.0 GiB" available="22.5 GiB"
time=2026-03-18T23:52:25.617+08:00 level=INFO source=routes.go:1832 msg="vram-based default context" total_vram="24.0 GiB" default_num_ctx=32768
time=2026-03-18T23:52:25.732+08:00 level=DEBUG source=runner.go:264 msg="refreshing free memory"
time=2026-03-18T23:52:25.732+08:00 level=DEBUG source=runner.go:328 msg="unable to refresh all GPUs with existing runners, performing bootstrap discovery"
time=2026-03-18T23:52:25.734+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61509"
time=2026-03-18T23:52:25.734+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13
time=2026-03-18T23:52:25.974+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=242.5026ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13]" extra_envs=map[]
time=2026-03-18T23:52:25.974+08:00 level=DEBUG source=runner.go:40 msg="overall device VRAM discovery took" duration=242.5026ms
time=2026-03-18T23:52:25.974+08:00 level=INFO source=cpu_windows.go:148 msg=packages count=1
time=2026-03-18T23:52:25.974+08:00 level=INFO source=cpu_windows.go:164 msg="efficiency cores detected" maxEfficiencyClass=1
time=2026-03-18T23:52:25.975+08:00 level=INFO source=cpu_windows.go:195 msg="" package=0 cores=24 efficiency=16 threads=32
time=2026-03-18T23:52:25.975+08:00 level=DEBUG source=sched.go:220 msg="updating default concurrency" OLLAMA_MAX_LOADED_MODELS=3 gpu_count=1
time=2026-03-18T23:52:25.993+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.alignment default=32
time=2026-03-18T23:52:25.994+08:00 level=DEBUG source=sched.go:256 msg="loading first model" model=C:\Users\Administrator\.ollama\models\blobs\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5
time=2026-03-18T23:52:26.021+08:00 level=WARN source=sched.go:450 msg="model architecture does not currently support parallel requests" architecture=qwen35
time=2026-03-18T23:52:26.044+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.alignment default=32
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.pooling_type default=0
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.head_count_kv default=0
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.type default=""
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.type default=""
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.factor default=1
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.original_context_length default=0
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.scale default=0
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_used_count default=0
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.norm_top_k_prob default=true
time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.mrope_interleaved default=false
time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.attention.layer_norm_epsilon default=9.999999974752427e-07
time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.rope.freq_base default=10000
time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.num_positional_embeddings default=2304
time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=false
time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0
time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}"
time=2026-03-18T23:52:26.046+08:00 level=INFO source=server.go:246 msg="enabling flash attention"
time=2026-03-18T23:52:26.047+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --model C:\\Users\\Administrator\\.ollama\\models\\blobs\\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5 --port 61523"
time=2026-03-18T23:52:26.047+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13
time=2026-03-18T23:52:26.062+08:00 level=INFO source=sched.go:489 msg="system memory" total="127.8 GiB" free="98.9 GiB" free_swap="89.6 GiB"
time=2026-03-18T23:52:26.062+08:00 level=INFO source=sched.go:496 msg="gpu memory" id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 library=CUDA available="22.1 GiB" free="22.5 GiB" minimum="457.0 MiB" overhead="0 B"
time=2026-03-18T23:52:26.062+08:00 level=INFO source=server.go:757 msg="loading model" "model layers"=25 requested=-1
time=2026-03-18T23:52:26.182+08:00 level=INFO source=runner.go:1411 msg="starting ollama engine"
time=2026-03-18T23:52:26.193+08:00 level=INFO source=runner.go:1446 msg="Server listening on 127.0.0.1:61523"
time=2026-03-18T23:52:26.201+08:00 level=INFO source=runner.go:1284 msg=load request="{Operation:fit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:8192 KvCacheType: NumThreads:8 GPULayers:25[ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Layers:25(0..24)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
time=2026-03-18T23:52:26.228+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.alignment default=32
time=2026-03-18T23:52:26.228+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.name default=""
time=2026-03-18T23:52:26.228+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.description default=""
time=2026-03-18T23:52:26.228+08:00 level=INFO source=ggml.go:136 msg="" architecture=qwen35 file_type=Q8_0 name="" description="" num_tensors=536 num_key_values=52
time=2026-03-18T23:52:26.228+08:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama
load_backend: loaded CPU backend from C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\ggml-cpu-alderlake.dll
time=2026-03-18T23:52:26.242+08:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13
ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 3090, compute capability 8.6, VMM: yes, ID: GPU-b9245cc3-269c-28c7-2c20-c18ad4876178
load_backend: loaded CUDA backend from C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13\ggml-cuda.dll
time=2026-03-18T23:52:26.293+08:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=750,800,860,870,890,900,1000,1030,1100,1200,1210 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(clang)

OS

Windows

GPU

Nvidia

CPU

Intel

Ollama version

0.18.1

Originally created by @zhangyy130 on GitHub (Mar 18, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/14939 ### What is the issue? "Qwen3.5 0.8b keeps printing 'kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation', and finally times out and crashes." time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.pooling_type default=0 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.head_count_kv default=0 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.type default="" time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.type default="" time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.factor default=1 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.original_context_length default=0 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.scale default=0 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_used_count default=0 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.norm_top_k_prob default=true time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.mrope_interleaved default=false time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.attention.layer_norm_epsilon default=9.999999974752427e-07 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.rope.freq_base default=10000 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.num_positional_embeddings default=2304 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=false time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 time=2026-03-18T23:52:26.294+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" time=2026-03-18T23:52:26.546+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=583 splits=1 time=2026-03-18T23:52:26.681+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=12549 splits=4 time=2026-03-18T23:52:26.714+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=1813 splits=2 time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:240 msg="model weights" device=CUDA0 size="974.5 MiB" time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:245 msg="model weights" device=CPU size="259.8 MiB" time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:251 msg="kv cache" device=CUDA0 size="577.6 MiB" time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:262 msg="compute graph" device=CUDA0 size="498.1 MiB" time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:267 msg="compute graph" device=CPU size="7.9 MiB" time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=device.go:272 msg="total memory" size="2.3 GiB" time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=server.go:782 msg=memory success=true required.InputWeights=272412672 required.CPU.Graph=8302592 required.CUDA0.ID=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 required.CUDA0.Weights="[42488576 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 471614464]" required.CUDA0.Cache="[28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 0]" required.CUDA0.Graph=522301440 time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=server.go:976 msg="available gpu" id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 library=CUDA "available layer vram"="21.6 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="498.1 MiB" time=2026-03-18T23:52:26.716+08:00 level=DEBUG source=server.go:793 msg="new layout created" layers="25[ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Layers:25(0..24)]" time=2026-03-18T23:52:26.716+08:00 level=INFO source=runner.go:1284 msg=load request="{Operation:alloc LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:8192 KvCacheType: NumThreads:8 GPULayers:25[ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Layers:25(0..24)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" time=2026-03-18T23:52:26.738+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.alignment default=32 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.pooling_type default=0 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.head_count_kv default=0 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.type default="" time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.type default="" time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.factor default=1 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.original_context_length default=0 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.scale default=0 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_used_count default=0 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.norm_top_k_prob default=true time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.mrope_interleaved default=false time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.attention.layer_norm_epsilon default=9.999999974752427e-07 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.rope.freq_base default=10000 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.num_positional_embeddings default=2304 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=false time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 time=2026-03-18T23:52:26.742+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" time=2026-03-18T23:52:26.917+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=583 splits=1 time=2026-03-18T23:52:27.040+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=12549 splits=4 time=2026-03-18T23:52:27.044+08:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=1813 splits=2 time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:240 msg="model weights" device=CUDA0 size="974.5 MiB" time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:245 msg="model weights" device=CPU size="259.8 MiB" time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:251 msg="kv cache" device=CUDA0 size="577.6 MiB" time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:262 msg="compute graph" device=CUDA0 size="498.1 MiB" time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:267 msg="compute graph" device=CPU size="7.9 MiB" time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=device.go:272 msg="total memory" size="2.3 GiB" time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=server.go:782 msg=memory success=true required.InputWeights=272412672 required.CPU.Graph=8302592 required.CUDA0.ID=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 required.CUDA0.Weights="[42488576 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 22981376 22981376 22981376 19507200 471614464]" required.CUDA0.Cache="[28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 28057600 28057600 28057600 16777216 0]" required.CUDA0.Graph=522301440 time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=server.go:976 msg="available gpu" id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 library=CUDA "available layer vram"="21.6 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="498.1 MiB" time=2026-03-18T23:52:27.045+08:00 level=DEBUG source=server.go:793 msg="new layout created" layers="25[ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Layers:25(0..24)]" time=2026-03-18T23:52:27.045+08:00 level=INFO source=runner.go:1284 msg=load request="{Operation:commit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:8192 KvCacheType: NumThreads:8 GPULayers:25[ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Layers:25(0..24)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" time=2026-03-18T23:52:27.045+08:00 level=INFO source=ggml.go:482 msg="offloading 24 repeating layers to GPU" time=2026-03-18T23:52:27.045+08:00 level=INFO source=ggml.go:489 msg="offloading output layer to GPU" time=2026-03-18T23:52:27.045+08:00 level=INFO source=ggml.go:494 msg="offloaded 25/25 layers to GPU" time=2026-03-18T23:52:27.045+08:00 level=INFO source=device.go:240 msg="model weights" device=CUDA0 size="974.5 MiB" time=2026-03-18T23:52:27.045+08:00 level=INFO source=device.go:245 msg="model weights" device=CPU size="259.8 MiB" time=2026-03-18T23:52:27.045+08:00 level=INFO source=device.go:251 msg="kv cache" device=CUDA0 size="577.6 MiB" time=2026-03-18T23:52:27.046+08:00 level=INFO source=device.go:262 msg="compute graph" device=CUDA0 size="498.1 MiB" time=2026-03-18T23:52:27.046+08:00 level=INFO source=device.go:267 msg="compute graph" device=CPU size="7.9 MiB" time=2026-03-18T23:52:27.046+08:00 level=INFO source=device.go:272 msg="total memory" size="2.3 GiB" time=2026-03-18T23:52:27.046+08:00 level=INFO source=sched.go:565 msg="loaded runners" count=1 time=2026-03-18T23:52:27.046+08:00 level=DEBUG source=sched.go:729 msg="evaluating already loaded" model=C:\Users\Administrator\.ollama\models\blobs\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5 time=2026-03-18T23:52:27.046+08:00 level=INFO source=server.go:1350 msg="waiting for llama runner to start responding" time=2026-03-18T23:52:27.046+08:00 level=INFO source=server.go:1384 msg="waiting for server to become available" status="llm server loading model" time=2026-03-18T23:52:27.046+08:00 level=DEBUG source=server.go:1394 msg="model load progress 0.00" time=2026-03-18T23:52:27.251+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.pooling_type default=0 time=2026-03-18T23:52:27.297+08:00 level=INFO source=server.go:1388 msg="llama runner started in 1.23 seconds" time=2026-03-18T23:52:27.297+08:00 level=DEBUG source=sched.go:577 msg="finished setting up" runner.name=registry.ollama.ai/library/qwen3.5:0.8b runner.inference="[{ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Library:CUDA}]" runner.size="2.3 GiB" runner.vram="2.3 GiB" runner.parallel=1 runner.pid=73136 runner.model=C:\Users\Administrator\.ollama\models\blobs\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5 runner.num_ctx=8192 time=2026-03-18T23:52:27.297+08:00 level=DEBUG source=sched.go:729 msg="evaluating already loaded" model=C:\Users\Administrator\.ollama\models\blobs\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5 time=2026-03-18T23:52:27.298+08:00 level=DEBUG source=sched.go:729 msg="evaluating already loaded" model=C:\Users\Administrator\.ollama\models\blobs\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5 time=2026-03-18T23:52:27.318+08:00 level=DEBUG source=server.go:1536 msg="completion request" images=0 prompt=984 format="" time=2026-03-18T23:52:27.318+08:00 level=DEBUG source=server.go:1536 msg="completion request" images=0 prompt=969 format="" time=2026-03-18T23:52:27.318+08:00 level=DEBUG source=server.go:1536 msg="completion request" images=0 prompt=997 format="" time=2026-03-18T23:52:27.318+08:00 level=DEBUG source=server.go:1536 msg="completion request" images=0 prompt=1160 format="" time=2026-03-18T23:52:27.336+08:00 level=DEBUG source=cache.go:151 msg="loading cache slot" id=0 cache=0 prompt=228 used=0 remaining=228 time=2026-03-18T23:52:59.323+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:52:59.323+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:53:16.441+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:53:16.441+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:53:33.563+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:53:33.563+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:53:50.655+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:53:50.655+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:54:07.745+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:54:07.745+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:54:24.773+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:54:24.773+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:54:41.875+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:54:41.875+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:54:58.948+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:54:58.948+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:55:16.062+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:55:16.062+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:55:33.131+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:55:33.131+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:55:50.262+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:55:50.262+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:56:07.325+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:56:07.325+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:56:24.404+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:56:24.404+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:56:41.476+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:56:41.476+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:56:58.541+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:56:58.541+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:57:15.760+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 time=2026-03-18T23:57:15.760+08:00 level=DEBUG source=cache.go:301 msg="kv cache removal unsupported, clearing cache and returning inputs for reprocessing" id=0 error="model does not support operation" time=2026-03-18T23:57:24.659+08:00 level=INFO source=server.go:1568 msg="aborting completion request due to client closing the connection" time=2026-03-18T23:57:24.659+08:00 level=DEBUG source=sched.go:431 msg="context for request finished" runner.name=registry.ollama.ai/library/qwen3.5:0.8b runner.inference="[{ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Library:CUDA}]" runner.size="2.3 GiB" runner.vram="2.3 GiB" runner.parallel=1 runner.pid=73136 [log.txt](https://github.com/user-attachments/files/26092200/log.txt) ### Relevant log output ```shell C:\Users\Administrator>ollama serve Error: listen tcp 0.0.0.0:11434: bind: Only one usage of each socket address (protocol/network address/port) is normally permitted. C:\Users\Administrator>ollama serve time=2026-03-18T23:52:24.556+08:00 level=INFO source=routes.go:1727 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:8192 OLLAMA_DEBUG:DEBUG OLLAMA_EDITOR: OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\Administrator\\.ollama\\models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NO_CLOUD:false OLLAMA_NUM_PARALLEL:4 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:false ROCR_VISIBLE_DEVICES:]" time=2026-03-18T23:52:24.568+08:00 level=INFO source=routes.go:1729 msg="Ollama cloud disabled: false" time=2026-03-18T23:52:24.582+08:00 level=INFO source=images.go:477 msg="total blobs: 72" time=2026-03-18T23:52:24.589+08:00 level=INFO source=images.go:484 msg="total unused blobs removed: 0" time=2026-03-18T23:52:24.593+08:00 level=INFO source=routes.go:1782 msg="Listening on [::]:11434 (version 0.18.1)" time=2026-03-18T23:52:24.593+08:00 level=DEBUG source=sched.go:145 msg="starting llm scheduler" time=2026-03-18T23:52:24.594+08:00 level=INFO source=runner.go:67 msg="discovering available GPUs..." time=2026-03-18T23:52:24.622+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61432" time=2026-03-18T23:52:24.622+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v12;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12 time=2026-03-18T23:52:24.886+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=272.9297ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v12]" extra_envs=map[] time=2026-03-18T23:52:24.888+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61447" time=2026-03-18T23:52:24.888+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13 time=2026-03-18T23:52:25.134+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=247.62ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13]" extra_envs=map[] time=2026-03-18T23:52:25.135+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61461" time=2026-03-18T23:52:25.135+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\rocm;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\rocm time=2026-03-18T23:52:25.314+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=179.8718ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\rocm]" extra_envs=map[] time=2026-03-18T23:52:25.314+08:00 level=INFO source=runner.go:106 msg="experimental Vulkan support disabled. To enable, set OLLAMA_VULKAN=1" time=2026-03-18T23:52:25.314+08:00 level=DEBUG source=runner.go:124 msg="evaluating which, if any, devices to filter out" initial_count=2 time=2026-03-18T23:52:25.314+08:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12 description="NVIDIA GeForce RTX 3090" compute=8.6 id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 pci_id=0000:01:00.0 time=2026-03-18T23:52:25.314+08:00 level=DEBUG source=runner.go:146 msg="verifying if device is supported" library=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13 description="NVIDIA GeForce RTX 3090" compute=8.6 id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 pci_id=0000:01:00.0 time=2026-03-18T23:52:25.316+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61476" time=2026-03-18T23:52:25.316+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61475" time=2026-03-18T23:52:25.316+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13 CUDA_VISIBLE_DEVICES=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 GGML_CUDA_INIT=1 time=2026-03-18T23:52:25.316+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v12;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12 GGML_CUDA_INIT=1 CUDA_VISIBLE_DEVICES=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 time=2026-03-18T23:52:25.585+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=271.3152ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 GGML_CUDA_INIT:1]" time=2026-03-18T23:52:25.617+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=303.0219ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v12]" extra_envs="map[CUDA_VISIBLE_DEVICES:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 GGML_CUDA_INIT:1]" time=2026-03-18T23:52:25.617+08:00 level=DEBUG source=runner.go:401 msg="filtering device with overlapping libraries" id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 library=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12 delete_index=0 kept_library=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13 time=2026-03-18T23:52:25.617+08:00 level=DEBUG source=runner.go:40 msg="GPU bootstrap discovery took" duration=1.0241201s time=2026-03-18T23:52:25.617+08:00 level=INFO source=types.go:42 msg="inference compute" id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 filter_id="" library=CUDA compute=8.6 name=CUDA0 description="NVIDIA GeForce RTX 3090" libdirs=ollama,cuda_v13 driver=13.0 pci_id=0000:01:00.0 type=discrete total="24.0 GiB" available="22.5 GiB" time=2026-03-18T23:52:25.617+08:00 level=INFO source=routes.go:1832 msg="vram-based default context" total_vram="24.0 GiB" default_num_ctx=32768 time=2026-03-18T23:52:25.732+08:00 level=DEBUG source=runner.go:264 msg="refreshing free memory" time=2026-03-18T23:52:25.732+08:00 level=DEBUG source=runner.go:328 msg="unable to refresh all GPUs with existing runners, performing bootstrap discovery" time=2026-03-18T23:52:25.734+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --port 61509" time=2026-03-18T23:52:25.734+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13 time=2026-03-18T23:52:25.974+08:00 level=DEBUG source=runner.go:437 msg="bootstrap discovery took" duration=242.5026ms OLLAMA_LIBRARY_PATH="[C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13]" extra_envs=map[] time=2026-03-18T23:52:25.974+08:00 level=DEBUG source=runner.go:40 msg="overall device VRAM discovery took" duration=242.5026ms time=2026-03-18T23:52:25.974+08:00 level=INFO source=cpu_windows.go:148 msg=packages count=1 time=2026-03-18T23:52:25.974+08:00 level=INFO source=cpu_windows.go:164 msg="efficiency cores detected" maxEfficiencyClass=1 time=2026-03-18T23:52:25.975+08:00 level=INFO source=cpu_windows.go:195 msg="" package=0 cores=24 efficiency=16 threads=32 time=2026-03-18T23:52:25.975+08:00 level=DEBUG source=sched.go:220 msg="updating default concurrency" OLLAMA_MAX_LOADED_MODELS=3 gpu_count=1 time=2026-03-18T23:52:25.993+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.alignment default=32 time=2026-03-18T23:52:25.994+08:00 level=DEBUG source=sched.go:256 msg="loading first model" model=C:\Users\Administrator\.ollama\models\blobs\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5 time=2026-03-18T23:52:26.021+08:00 level=WARN source=sched.go:450 msg="model architecture does not currently support parallel requests" architecture=qwen35 time=2026-03-18T23:52:26.044+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.alignment default=32 time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.pooling_type default=0 time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.head_count_kv default=0 time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0 time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.type default="" time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.type default="" time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.factor default=1 time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.rope.scaling.original_context_length default=0 time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.attention.scale default=0 time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_count default=0 time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.expert_used_count default=0 time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.norm_top_k_prob default=true time=2026-03-18T23:52:26.045+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.mrope_interleaved default=false time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.attention.layer_norm_epsilon default=9.999999974752427e-07 time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.rope.freq_base default=10000 time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=qwen35.vision.num_positional_embeddings default=2304 time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.add_bos_token default=false time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.bos_token_id default=0 time=2026-03-18T23:52:26.046+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.eos_token_ids default="&{size:0 values:[]}" time=2026-03-18T23:52:26.046+08:00 level=INFO source=server.go:246 msg="enabling flash attention" time=2026-03-18T23:52:26.047+08:00 level=INFO source=server.go:430 msg="starting runner" cmd="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --ollama-engine --model C:\\Users\\Administrator\\.ollama\\models\\blobs\\sha256-afb707b6b8fac6e475acc42bc8380fc0b8d2e0e4190be5a969fbf62fcc897db5 --port 61523" time=2026-03-18T23:52:26.047+08:00 level=DEBUG source=server.go:431 msg=subprocess CUDA_PATH="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" CUDA_PATH_V12_1="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1" CUDA_PATH_V12_2="C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2" OLLAMA_CONTEXT_LENGTH=8192 OLLAMA_DEBUG=1 OLLAMA_HOST=0.0.0.0 OLLAMA_NUM_PARALLEL=4 PATH="C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama\\lib\\ollama\\cuda_v13;C:\\ProgramData\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp;C:\\Program Files\\Common Files\\Oracle\\Java\\javapath;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\lib;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\include;C:\\Program Files\\Git\\cmd;C:\\Program Files\\Git LFS;C:\\Program Files\\LibreOffice\\program;C:\\Program Files\\dotnet\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.0\\;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\Program Files\\nodejs\\;C:\\Users\\Administrator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Administrator\\AppData\\Local\\Programs\\Ollama;C:\\ProgramData\\anaconda3;C:\\ProgramData\\anaconda3\\Scripts;C:\\ProgramData\\anaconda3\\Library\\bin;C:\\ProgramData\\anaconda3\\Library\\mingw-w64\\bin;C:\\ProgramData\\anaconda3\\Library\\usr\\bin;C:\\Users\\Administrator\\AppData\\Roaming\\npm" OLLAMA_LIBRARY_PATH=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama;C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13 time=2026-03-18T23:52:26.062+08:00 level=INFO source=sched.go:489 msg="system memory" total="127.8 GiB" free="98.9 GiB" free_swap="89.6 GiB" time=2026-03-18T23:52:26.062+08:00 level=INFO source=sched.go:496 msg="gpu memory" id=GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 library=CUDA available="22.1 GiB" free="22.5 GiB" minimum="457.0 MiB" overhead="0 B" time=2026-03-18T23:52:26.062+08:00 level=INFO source=server.go:757 msg="loading model" "model layers"=25 requested=-1 time=2026-03-18T23:52:26.182+08:00 level=INFO source=runner.go:1411 msg="starting ollama engine" time=2026-03-18T23:52:26.193+08:00 level=INFO source=runner.go:1446 msg="Server listening on 127.0.0.1:61523" time=2026-03-18T23:52:26.201+08:00 level=INFO source=runner.go:1284 msg=load request="{Operation:fit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Enabled KvSize:8192 KvCacheType: NumThreads:8 GPULayers:25[ID:GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 Layers:25(0..24)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" time=2026-03-18T23:52:26.228+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.alignment default=32 time=2026-03-18T23:52:26.228+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.name default="" time=2026-03-18T23:52:26.228+08:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.description default="" time=2026-03-18T23:52:26.228+08:00 level=INFO source=ggml.go:136 msg="" architecture=qwen35 file_type=Q8_0 name="" description="" num_tensors=536 num_key_values=52 time=2026-03-18T23:52:26.228+08:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama load_backend: loaded CPU backend from C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\ggml-cpu-alderlake.dll time=2026-03-18T23:52:26.242+08:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13 ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 3090, compute capability 8.6, VMM: yes, ID: GPU-b9245cc3-269c-28c7-2c20-c18ad4876178 load_backend: loaded CUDA backend from C:\Users\Administrator\AppData\Local\Programs\Ollama\lib\ollama\cuda_v13\ggml-cuda.dll time=2026-03-18T23:52:26.293+08:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=750,800,860,870,890,900,1000,1030,1100,1200,1210 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(clang) ``` ### OS Windows ### GPU Nvidia ### CPU Intel ### Ollama version 0.18.1

GiteaMirror added the bug label 2026-04-22 19:50:42 -05:00

GiteaMirror closed this issue 2026-04-22 19:50:43 -05:00

GiteaMirror commented 2026-04-22 19:50:45 -05:00

Author

Owner

Copy Link

@rick-github commented on GitHub (Mar 18, 2026):

time=2026-03-18T23:52:59.323+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting"
 id=0 limit=8192 input=8192 keep=4 discard=4094

The model filled up the context buffer and lost coherence, and then started looping generating tokens without hitting an end-of-sequence token. Either increase the size of the context buffer (OLLAMA_CONTEXT_LENGTH) or limit the number of tokens that can be generated (num_predict).

<!-- gh-comment-id:4083949374 --> @rick-github commented on GitHub (Mar 18, 2026): ``` time=2026-03-18T23:52:59.323+08:00 level=DEBUG source=cache.go:295 msg="context limit hit - shifting" id=0 limit=8192 input=8192 keep=4 discard=4094 ``` The model filled up the context buffer and lost coherence, and then started looping generating tokens without hitting an end-of-sequence token. Either increase the size of the context buffer ([`OLLAMA_CONTEXT_LENGTH`](https://github.com/ollama/ollama/blob/main/docs/faq.mdx#how-can-i-specify-the-context-window-size)) or limit the number of tokens that can be generated ([`num_predict`](https://github.com/ollama/ollama/blob/main/docs/modelfile.mdx#valid-parameters-and-values:~:text=stop%20%22AI%20assistant%3A%22-,num_predict,-Maximum%20number%20of)).

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

parth-mlx-decode-checkpoints

dhiltgen/ci

hoyyeva/editor-config-repair

parth-launch-codex-app

hoyyeva/fix-codex-model-metadata-warning

hoyyeva/qwen

hoyyeva/launch-backup-ux

parth/hide-claude-desktop-till-release

hoyyeva/opencode-image-modality

parth-add-claude-code-autoinstall

release_v0.22.0

pdevine/manifest-list

codex/fix-codex-model-metadata-warning

pdevine/addressable-manifest

brucemacd/launch-fetch-reccomended

jmorganca/llama-compat

launch-copilot-cli

hoyyeva/opencode-thinking

release_v0.20.7

parth-auto-save-backup

parth-test

jmorganca/gemma4-audio-replacements

fix-manifest-digest-on-pull

hoyyeva/vscode-improve

brucemacd/install-server-wait

brucemacd/download-before-remove

parth/update-claude-docs

parth-anthropic-reference-images-path

brucemac/start-ap-install

pdevine/mlx-update

pdevine/qwen35_vision

drifkin/api-show-fallback

mintlify/image-generation-1773352582

hoyyeva/server-context-length-local-config

jmorganca/faster-reptition-penalties

jmorganca/convert-nemotron

parth-pi-thinking

pdevine/sampling-penalties

jmorganca/fix-create-quantization-memory

dongchen/resumable_transfer_fix

pdevine/sampling-cache-error

jessegross/mlx-usage

hoyyeva/openclaw-config

hoyyeva/app-html

pdevine/qwen3next

brucemacd/sign-sh-install

brucemacd/tui-update

brucemacd/usage-api

jmorganca/launch-empty

fix-app-dist-embed

mxyng/mlx-compile

mxyng/mlx-quant

mxyng/mlx-glm4.7

mxyng/mlx

brucemacd/simplify-model-picker

jmorganca/qwen3-concurrent

fix-glm-4.7-flash-mla-config

drifkin/qwen3-coder-opening-tag

brucemacd/usage-cli

fix-cuda12-fattn-shmem

ollama-imagegen-docs

parth/fix-multiline-inputs

brucemacd/config-docs

mxyng/model-files

mxyng/simple-execute

fix-imagegen-ollama-models

mxyng/async-upload

jmorganca/lazy-no-dtype-changes

imagegen-auto-detect-create

parth/decrease-concurrent-download-hf

fix-mlx-quantize-init

jmorganca/x-cleanup

usage

imagegen-readme

jmorganca/glm-image

mlx-gpu-cd

jmorganca/imagegen-modelfile

parth/agent-skills

parth/agent-allowlist

parth/signed-in-offline

parth/agents

parth/fix-context-chopping

improve-cloud-flow

parth/add-models-websearch

parth/prompt-renderer-mcp

jmorganca/native-settings

jmorganca/download-stream-hash

jmorganca/client2-rebased

brucemacd/oai-chat-req-multipart

jessegross/multi_chunk_reserve

grace/additional-omit-empty

grace/mistral-3-large

mxyng/tokenizer2

mxyng/tokenizer

jessegross/flash

hoyyeva/windows-nacked-app

mxyng/cleanup-attention

grace/deepseek-parser

hoyyeva/remember-unsent-prompt

parth/add-lfs-pointer-error-conversion

parth/olmo2-test2

hoyyeva/ollama-launchagent-plist

nicole/olmo-model

parth/olmo-test

mxyng/remove-embedded

parth/render-template

jmorganca/intellect-3

parth/remove-prealloc-linter

jmorganca/cmd-eval

nicole/nomic-embed-text-fix

mxyng/lint-2

hoyyeva/add-gemini-3-pro-preview

hoyyeva/load-model-list

mxyng/expand-path

mxyng/environ-2

hoyyeva/deeplink-json-encoding

parth/improve-tool-calling-tests

hoyyeva/conversation

hoyyeva/assistant-edit-response

hoyyeva/thinking

origin/brucemacd/invalid-char-i-err

parth/improve-tool-calling

jmorganca/required-omitempty

grace/qwen3-vl-tests

mxyng/iter-client

parth/docs-readme

nicole/embed-test

pdevine/integration-benchstat

parth/remove-generate-cmd

parth/add-toolcall-id

mxyng/server-tests

jmorganca/glm-4.6

jmorganca/gin-h-compat

drifkin/stable-tool-args

pdevine/qwen3-more-thinking

parth/add-websearch-client

nicole/websearch_local

jmorganca/qwen3-coder-updates

grace/deepseek-v3-migration-tests

mxyng/fix-create

jmorganca/cloud-errors

pdevine/parser-tidy

revert-12233-parth/simplify-entrypoints-runner

parth/enable-so-gpt-oss

brucemacd/qwen3vl

jmorganca/readme-simplify

parth/gpt-oss-structured-outputs

revert-12039-jmorganca/tools-braces

mxyng/embeddings

mxyng/gguf

mxyng/benchmark

mxyng/types-null

parth/move-parsing

mxyng/gemma2

jmorganca/docs

mxyng/16-bit

mxyng/create-stdin

pdevine/authorizedkeys

mxyng/quant

parth/opt-in-error-context-window

brucemacd/cache-models

brucemacd/runner-completion

jmorganca/llama-update-6

brucemacd/benchmark-list

brucemacd/partial-read-caps

parth/deepseek-r1-tools

mxyng/omit-array

parth/tool-prefix-temp

brucemacd/runner-test

jmorganca/qwen25vl

brucemacd/model-forward-test-ext

parth/python-function-parsing

jmorganca/cuda-compression-none

drifkin/num-parallel

drifkin/chat-truncation-fix

jmorganca/sync

parth/python-tools-calling

drifkin/array-head-count

brucemacd/create-no-loop

parth/server-enable-content-stream-with-tools

qwen25omni

mxyng/v3

brucemacd/ropeconfig

jmorganca/silence-tokenizer

parth/sample-so-test

parth/sampling-structured-outputs

brucemacd/doc-go-engine

parth/constrained-sampling-json

jmorganca/mistral-wip

brucemacd/mistral-small-convert

parth/sample-unmarshal-json-for-params

brucemacd/jomorganca/mistral

pdevine/bfloat16

jmorganca/mistral

brucemacd/mistral

pdevine/logging

parth/sample-correctness-fix

parth/sample-fix-sorting

jmorgan/sample-fix-sorting-extras

jmorganca/temp-0-images

brucemacd/parallel-embed-models

brucemacd/shim-grammar

jmorganca/fix-gguf-error

bmizerany/nameswork

jmorganca/faster-releases

bmizerany/validatenames

brucemacd/err-no-vocab

brucemacd/rope-config

brucemacd/err-hint

brucemacd/qwen2_5

brucemacd/logprobs

brucemacd/new_runner_graph_bench

progress-flicker

brucemacd/forward-test

brucemacd/go_qwen2

pdevine/gemma2

jmorganca/add-missing-symlink-eval

mxyng/next-debug

parth/set-context-size-openai

brucemacd/next-bpe-bench

brucemacd/next-bpe-test

brucemacd/new_runner_e2e

brucemacd/new_runner_qwen2

pdevine/convert-cohere2

brucemacd/convert-cli

parth/log-probs

mxyng/next-mlx

mxyng/cmd-history

parth/templating

parth/tokenize-detokenize

brucemacd/check-key-register

bmizerany/grammar

jmorganca/vendor-081b29bd

mxyng/func-checks

jmorganca/fix-null-format

parth/fix-default-to-warn-json

jmorganca/qwen2vl

jmorganca/no-concat

parth/cmd-cleanup-SO

brucemacd/check-key-register-structured-err

parth/openai-stream-usage

parth/fix-referencing-so

stream-tools-stop

jmorganca/degin-1

brucemacd/install-path-clean

brucemacd/push-name-validation

brucemacd/browser-key-register

jmorganca/openai-fix-first-message

jmorganca/fix-proxy

jessegross/sample

parth/disallow-streaming-tools

dhiltgen/remove_submodule

jmorganca/ga

jmorganca/mllama

pdevine/newlines

pdevine/geems-2b

jmorganca/llama-bump

mxyng/modelname-7

mxyng/gin-slog

mxyng/modelname-6

jyan/convert-prog

jyan/quant5

paligemma-support

pdevine/import-docs

jmorganca/openai-context

jyan/paligemma

jyan/p2

jyan/palitest

bmizerany/embedspeedup

jmorganca/llama-vit

brucemacd/allow-ollama

royh/ep-methods

royh/whisper

mxyng/api-models

mxyng/fix-memory

jyan/q4_4/8

jyan/ollama-v

royh/stream-tools

roy-embed-parallel

bmizerany/hrm

revert-5963-revert-5924-mxyng/llama3.1-rope

royh/embed-viz

jyan/local2

jyan/auth

jyan/local

jyan/parse-temp

jmorganca/template-mistral

jyan/reord-g

royh-openai-suffixdocs

royh-imgembed

royh-embed-parallel

jyan/quant4

royh-precision

jyan/progress

pdevine/fix-template

jyan/quant3

pdevine/ggla

mxyng/update-registry-domain

jmorganca/ggml-static

mxyng/create-context

jyan/v0.146

mxyng/layers-from-files

build_dist

bmizerany/noseek

royh-ls

royh-name

timeout

mxyng/server-timestamp

bmizerany/nosillyggufslurps

royh-params

jmorganca/llama-cpp-7c26775

royh-openai-delete

royh-show-rigid

jmorganca/enable-fa

jmorganca/no-error-template

jyan/format

royh-testdelete

bmizerany/fastverify

language_support

pdevine/ps-glitches

brucemacd/tokenize

bruce/iq-quants

bmizerany/filepathwithcoloninhost

mxyng/split-bin

bmizerany/client-registry

jmorganca/if-none-match

native

jmorganca/native

jmorganca/batch-embeddings

jmorganca/initcmake

jmorganca/mm

pdevine/showggmlinfo

modenameenforcealphanum

bmizerany/modenameenforcealphanum

jmorganca/done-reason

jmorganca/llama-cpp-8960fe8

ollama.com

bmizerany/filepathnobuild

bmizerany/types/model/defaultfix

rmdisplaylong

nogogen

bmizerany/x

modelfile-readme

bmizerany/replacecolon

jmorganca/limit

jmorganca/execstack

jmorganca/replace-assets

mxyng/tune-concurrency

jmorganca/testing

whitespace-detection

jmorganca/options

upgrade-all

scratch

cuda-search

mattw/airenamer

mattw/allmodelsonhuggingface

mattw/quantcontext

mattw/whatneedstorun

brucemacd/llama-mem-calc

mattw/faq-context

mattw/communitylinks

mattw/noprune

mattw/python-functioncalling

rename

mxyng/install

pulse

remove-first

editor

mattw/selfqueryingretrieval

cgo

mattw/howtoquant

api

matt/streamingapi

format-config

mxyng/extra-args

shell

update-nous-hermes

cp-model

upload-progress

fix-unknown-model

fix-model-names

delete-fix

insecure-registry

ls

deletemodels

progressbar

readme-updates

license-layers

skip-list

list-models

modelpath

matt/examplemodelfiles

distribution

go-opts

v0.23.1

v0.23.1-rc0

v0.23.0

v0.23.0-rc0

v0.22.1

v0.22.1-rc1

v0.22.1-rc0

v0.22.0

v0.22.0-rc1

v0.21.3-rc0

v0.21.2-rc1

v0.21.2

v0.21.2-rc0

v0.21.1

v0.21.1-rc1

v0.21.1-rc0

v0.21.0

v0.21.0-rc1

v0.21.0-rc0

v0.20.8-rc0

v0.20.7

v0.20.7-rc1

v0.20.7-rc0

v0.20.6

v0.20.6-rc1

v0.20.6-rc0

v0.20.5

v0.20.5-rc2

v0.20.5-rc1

v0.20.5-rc0

v0.20.4

v0.20.4-rc2

v0.20.4-rc1

v0.20.4-rc0

v0.20.3

v0.20.3-rc0

v0.20.2

v0.20.1

v0.20.1-rc2

v0.20.1-rc1

v0.20.1-rc0

v0.20.0

v0.20.0-rc1

v0.20.0-rc0

v0.19.0

v0.19.0-rc2

v0.19.0-rc1

v0.19.0-rc0

v0.18.4-rc1

v0.18.4-rc0

v0.18.3

v0.18.3-rc2

v0.18.3-rc1

v0.18.3-rc0

v0.18.2

v0.18.2-rc1

v0.18.2-rc0

v0.18.1

v0.18.1-rc1

v0.18.1-rc0

v0.18.0

v0.18.0-rc2

v0.18.0-rc1

v0.18.0-rc0

v0.17.8-rc4

v0.17.8-rc3

v0.17.8-rc2

v0.17.8-rc1

v0.17.8-rc0

v0.17.7

v0.17.7-rc2

v0.17.7-rc1

v0.17.7-rc0

v0.17.6

v0.17.5

v0.17.4

v0.17.3

v0.17.2

v0.17.1

v0.17.1-rc2

v0.17.1-rc1

v0.17.1-rc0

v0.17.0

v0.17.0-rc2

v0.17.0-rc1

v0.17.0-rc0

v0.16.3

v0.16.3-rc2

v0.16.3-rc1

v0.16.3-rc0

v0.16.2

v0.16.2-rc0

v0.16.1

v0.16.0

v0.16.0-rc2

v0.16.0-rc0

v0.16.0-rc1

v0.15.6

v0.15.5

v0.15.5-rc5

v0.15.5-rc4

v0.15.5-rc3

v0.15.5-rc2

v0.15.5-rc1

v0.15.5-rc0

v0.15.4

v0.15.3

v0.15.2

v0.15.1

v0.15.1-rc1

v0.15.1-rc0

v0.15.0-rc6

v0.15.0

v0.15.0-rc5

v0.15.0-rc4

v0.15.0-rc3

v0.15.0-rc2

v0.15.0-rc1

v0.15.0-rc0

v0.14.3

v0.14.3-rc3

v0.14.3-rc2

v0.14.3-rc1

v0.14.3-rc0

v0.14.2

v0.14.2-rc1

v0.14.2-rc0

v0.14.1

v0.14.0-rc11

v0.14.0

v0.14.0-rc10

v0.14.0-rc9

v0.14.0-rc8

v0.14.0-rc7

v0.14.0-rc6

v0.14.0-rc5

v0.14.0-rc4

v0.14.0-rc3

v0.14.0-rc2

v0.14.0-rc1

v0.14.0-rc0

v0.13.5

v0.13.5-rc1

v0.13.5-rc0

v0.13.4-rc2

v0.13.4

v0.13.4-rc1

v0.13.4-rc0

v0.13.3

v0.13.3-rc1

v0.13.3-rc0

v0.13.2

v0.13.2-rc2

v0.13.2-rc1

v0.13.2-rc0

v0.13.1

v0.13.1-rc2

v0.13.1-rc1

v0.13.1-rc0

v0.13.0

v0.13.0-rc0

v0.12.11

v0.12.11-rc1

v0.12.11-rc0

v0.12.10

v0.12.10-rc1

v0.12.10-rc0

v0.12.9-rc0

v0.12.9

v0.12.8

v0.12.8-rc0

v0.12.7

v0.12.7-rc1

v0.12.7-rc0

v0.12.7-citest0

v0.12.6

v0.12.6-rc1

v0.12.6-rc0

v0.12.5

v0.12.5-rc0

v0.12.4

v0.12.4-rc7

v0.12.4-rc6

v0.12.4-rc5

v0.12.4-rc4

v0.12.4-rc3

v0.12.4-rc2

v0.12.4-rc1

v0.12.4-rc0

v0.12.3

v0.12.2

v0.12.2-rc0

v0.12.1

v0.12.1-rc1

v0.12.1-rc2

v0.12.1-rc0

v0.12.0

v0.12.0-rc1

v0.12.0-rc0

v0.11.11

v0.11.11-rc3

v0.11.11-rc2

v0.11.11-rc1

v0.11.11-rc0

v0.11.10

v0.11.9

v0.11.9-rc0

v0.11.8

v0.11.8-rc0

v0.11.7-rc1

v0.11.7-rc0

v0.11.7

v0.11.6

v0.11.6-rc0

v0.11.5-rc4

v0.11.5-rc3

v0.11.5

v0.11.5-rc5

v0.11.5-rc2

v0.11.5-rc1

v0.11.5-rc0

v0.11.4

v0.11.4-rc0

v0.11.3

v0.11.3-rc0

v0.11.2

v0.11.1

v0.11.0-rc0

v0.11.0-rc1

v0.11.0-rc2

v0.11.0

v0.10.2-int1

v0.10.1

v0.10.0

v0.10.0-rc4

v0.10.0-rc3

v0.10.0-rc2

v0.10.0-rc1

v0.10.0-rc0

v0.9.7-rc1

v0.9.7-rc0

v0.9.6

v0.9.6-rc0

v0.9.6-ci0

v0.9.5

v0.9.4-rc5

v0.9.4-rc6

v0.9.4

v0.9.4-rc3

v0.9.4-rc4

v0.9.4-rc1

v0.9.4-rc2

v0.9.4-rc0

v0.9.3

v0.9.3-rc5

v0.9.4-citest0

v0.9.3-rc4

v0.9.3-rc3

v0.9.3-rc2

v0.9.3-rc1

v0.9.3-rc0

v0.9.2

v0.9.1

v0.9.1-rc1

v0.9.1-rc0

v0.9.1-ci1

v0.9.1-ci0

v0.9.0

v0.9.0-rc0

v0.8.0

v0.8.0-rc0

v0.7.1-rc2

v0.7.1

v0.7.1-rc1

v0.7.1-rc0

v0.7.0

v0.7.0-rc1

v0.7.0-rc0

v0.6.9-rc0

v0.6.8

v0.6.8-rc0

v0.6.7

v0.6.7-rc2

v0.6.7-rc1

v0.6.7-rc0

v0.6.6

v0.6.6-rc2

v0.6.6-rc1

v0.6.6-rc0

v0.6.5-rc1

v0.6.5

v0.6.5-rc0

v0.6.4-rc0

v0.6.4

v0.6.3-rc1

v0.6.3

v0.6.3-rc0

v0.6.2

v0.6.2-rc0

v0.6.1

v0.6.1-rc0

v0.6.0-rc0

v0.6.0

v0.5.14-rc0

v0.5.13

v0.5.13-rc6

v0.5.13-rc5

v0.5.13-rc4

v0.5.13-rc3

v0.5.13-rc2

v0.5.13-rc1

v0.5.13-rc0

v0.5.12

v0.5.12-rc1

v0.5.12-rc0

v0.5.11

v0.5.10

v0.5.9

v0.5.9-rc0

v0.5.8-rc13

v0.5.8

v0.5.8-rc12

v0.5.8-rc11

v0.5.8-rc10

v0.5.8-rc9

v0.5.8-rc8

v0.5.8-rc7

v0.5.8-rc6

v0.5.8-rc5

v0.5.8-rc4

v0.5.8-rc3

v0.5.8-rc2

v0.5.8-rc1

v0.5.8-rc0

v0.5.7

v0.5.6

v0.5.5

v0.5.5-rc0

v0.5.4

v0.5.3

v0.5.3-rc0

v0.5.2

v0.5.2-rc3

v0.5.2-rc2

v0.5.2-rc1

v0.5.2-rc0

v0.5.1

v0.5.0

v0.5.0-rc1

v0.4.8-rc0

v0.4.7

v0.4.6

v0.4.5

v0.4.4

v0.4.3

v0.4.3-rc0

v0.4.2

v0.4.2-rc1

v0.4.2-rc0

v0.4.1

v0.4.1-rc0

v0.4.0

v0.4.0-rc8

v0.4.0-rc7

v0.4.0-rc6

v0.4.0-rc5

v0.4.0-rc4

v0.4.0-rc3

v0.4.0-rc2

v0.4.0-rc1

v0.4.0-rc0

v0.4.0-ci3

v0.3.14

v0.3.14-rc0

v0.3.13

v0.3.12

v0.3.12-rc5

v0.3.12-rc4

v0.3.12-rc3

v0.3.12-rc2

v0.3.12-rc1

v0.3.11

v0.3.11-rc4

v0.3.11-rc3

v0.3.11-rc2

v0.3.11-rc1

v0.3.10

v0.3.10-rc1

v0.3.9

v0.3.8

v0.3.7

v0.3.7-rc6

v0.3.7-rc5

v0.3.7-rc4

v0.3.7-rc3

v0.3.7-rc2

v0.3.7-rc1

v0.3.6

v0.3.5

v0.3.4

v0.3.3

v0.3.2

v0.3.1

v0.3.0

v0.2.8

v0.2.8-rc2

v0.2.8-rc1

v0.2.7

v0.2.6

v0.2.5

v0.2.4

v0.2.3

v0.2.2

v0.2.2-rc2

v0.2.2-rc1

v0.2.1

v0.2.0

v0.1.49-rc14

v0.1.49-rc13

v0.1.49-rc12

v0.1.49-rc11

v0.1.49-rc10

v0.1.49-rc9

v0.1.49-rc8

v0.1.49-rc7

v0.1.49-rc6

v0.1.49-rc4

v0.1.49-rc5

v0.1.49-rc3

v0.1.49-rc2

v0.1.49-rc1

v0.1.48

v0.1.47

v0.1.46

v0.1.45-rc5

v0.1.45

v0.1.45-rc4

v0.1.45-rc3

v0.1.45-rc2

v0.1.45-rc1

v0.1.44

v0.1.43

v0.1.42

v0.1.41

v0.1.40

v0.1.40-rc1

v0.1.39

v0.1.39-rc2

v0.1.39-rc1

v0.1.38

v0.1.37

v0.1.36

v0.1.35

v0.1.35-rc1

v0.1.34

v0.1.34-rc1

v0.1.33

v0.1.33-rc7

v0.1.33-rc6

v0.1.33-rc5

v0.1.33-rc4

v0.1.33-rc3

v0.1.33-rc2

v0.1.33-rc1

v0.1.32

v0.1.32-rc2

v0.1.32-rc1

v0.1.31

v0.1.30

v0.1.29

v0.1.28

v0.1.27

v0.1.26

v0.1.25

v0.1.24

v0.1.23

v0.1.22

v0.1.21

v0.1.20

v0.1.19

v0.1.18

v0.1.17

v0.1.16

v0.1.15

v0.1.14

v0.1.13

v0.1.12

v0.1.11

v0.1.10

v0.1.9

v0.1.8

v0.1.7

v0.1.6

v0.1.5

v0.1.4

v0.1.3

v0.1.2

v0.1.1

v0.1.0

v0.0.21

v0.0.20

v0.0.19

v0.0.18

v0.0.17

v0.0.16

v0.0.15

v0.0.14

v0.0.13

v0.0.12

v0.0.11

v0.0.10

v0.0.9

v0.0.8

v0.0.7

v0.0.6

v0.0.5

v0.0.4

v0.0.3

v0.0.2

v0.0.1

Labels

Clear labels

amd

api

app

bug

build

cli

cloud

compatibility

context-length

create

docker

documentation

embeddings

feature request

feedback wanted

good first issue

gpt-oss

gpu

harmony

help wanted

image

install

intel

js

launch

linux

macos

memory

mlx

model

needs more info

networking

nvidia

ollama.com

performance

pull-request

Mirrored from GitHub Pull Request

python

question

registry

rendering

thinking

tools

top

vulkan

windows

wsl

No Label bug

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

GiteaMirror ninjasurge

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/ollama#35372