github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-07-16 13:19:40 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #15348] Gemma4 it 26B-4AB default conversion from original tensorfiles crash at inference. #87507

New Issue
Open
opened 2026-05-10 05:47:40 -05:00 by GiteaMirror · 6 comments
GiteaMirror commented 2026-05-10 05:47:40 -05:00
Owner
Copy Link

Originally created by @rjmalagon on GitHub (Apr 5, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/15348

What is the issue?

When loaded from https://huggingface.co/google/gemma-4-26B-A4B-it ( ollama create -f Modelfile-fromGemma4Modelfile ./gemma-4-26B-A4B-it gemma4:26b-a4b-bf16 ), it crashes after loading the model just after prompt input.

If the model is converted/quantized to F16 (ollama create -quantize F16 -f Modelfile-fromGemma4Modelfile ./gemma-4-26B-A4B-it gemma4:26b-a4b-f16 , it crashes too.

My inference server is an AMD Ryzen 7 7735HS with a Radeon 680M APU with 80 GB shared iGPU RAM from 96 GB main RAM, Fedora CoreOS F43, and a Podman container environment with a ROCm runtime Ollama image (all around works great! Thanks to Ollama team and its code contributors).

Ollama logs when it fails.

time=2026-04-05T16:24:03.311Z level=DEBUG source=ggml.go:325 msg="key with type not found" key=gemma4.pooling_type default=0
time=2026-04-05T16:24:03.311Z level=TRACE source=runner.go:480 msg="forwardBatch no pending batch detected" batchID=0
time=2026-04-05T16:24:03.518Z level=INFO source=server.go:1390 msg="llama runner started in 42.20 seconds"
time=2026-04-05T16:24:03.518Z level=DEBUG source=sched.go:573 msg="finished setting up" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="68.3 GiB" runner.vram="68.3 GiB" runner.parallel=1 runner.pid=82 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144
[GIN] 2026/04/05 - 16:24:03 | 200 | 42.667543514s |       127.0.0.1 | POST     "/api/generate"
time=2026-04-05T16:24:03.524Z level=DEBUG source=sched.go:581 msg="context for request finished"
time=2026-04-05T16:24:03.524Z level=DEBUG source=sched.go:309 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="68.3 GiB" runner.vram="68.3 GiB" runner.parallel=1 runner.pid=82 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144 duration=5m0s
time=2026-04-05T16:24:03.524Z level=DEBUG source=sched.go:327 msg="after processing request finished event" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="68.3 GiB" runner.vram="68.3 GiB" runner.parallel=1 runner.pid=82 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144 refCount=0
time=2026-04-05T16:24:29.480Z level=DEBUG source=sched.go:672 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f
time=2026-04-05T16:24:29.574Z level=TRACE source=bytepairencoding.go:287 msg=encoded string="<bos><|turn>system\n<|think|><turn|>\n<|turn>user\ntest<turn|>\n<|turn>model\n" ids="[2 105 9731 107 98 106 107 105 2364 107 2181 106 107 105 4368 107]"
time=2026-04-05T16:24:29.575Z level=DEBUG source=server.go:1538 msg="completion request" images=0 prompt=73 format=""
time=2026-04-05T16:24:29.575Z level=TRACE source=server.go:1539 msg="completion request" prompt="<bos><|turn>system\n<|think|><turn|>\n<|turn>user\ntest<turn|>\n<|turn>model\n"
time=2026-04-05T16:24:29.708Z level=TRACE source=bytepairencoding.go:287 msg=encoded string="<bos><|turn>system\n<|think|><turn|>\n<|turn>user\ntest<turn|>\n<|turn>model\n" ids="[2 105 9731 107 98 106 107 105 2364 107 2181 106 107 105 4368 107]"
time=2026-04-05T16:24:29.709Z level=DEBUG source=cache.go:151 msg="loading cache slot" id=0 cache=0 prompt=16 used=0 remaining=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=2 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iB_No response_atch=0 i+1=3 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=4 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=5 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=6 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=7 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=8 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=9 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=10 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=11 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=12 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=13 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=14 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=15 len(seq.inputs)=16
time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=16 len(seq.inputs)=16
time=2026-04-05T16:24:29.716Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=0
time=2026-04-05T16:24:29.716Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=0
time=2026-04-05T16:24:29.716Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=0
time=2026-04-05T16:24:29.716Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=0
time=2026-04-05T16:24:29.716Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=0 id=1
time=2026-04-05T16:24:29.717Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=1 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-04-05T16:24:29.719Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=1
time=2026-04-05T16:24:29.719Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=1
time=2026-04-05T16:24:33.811Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=0
time=2026-04-05T16:24:33.811Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=0
time=2026-04-05T16:24:33.811Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=0 seqIdx=0 len(logits)=262144 len(activeBatch.batch.Outputs)=1 vocabSize=262144 iBatches=[0]
time=2026-04-05T16:24:33.813Z level=TRACE source=bytepairencoding.go:328 msg=decoded string=<|channel> from=[100]
time=2026-04-05T16:24:33.814Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=0
time=2026-04-05T16:24:33.814Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=1
time=2026-04-05T16:24:33.814Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=1
time=2026-04-05T16:24:33.814Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=1 id=2
time=2026-04-05T16:24:33.814Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=2 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-04-05T16:24:33.814Z level=TRACE source=routes.go:2440 msg="builtin parser input" parser=gemma4 content=<|channel>
time=2026-04-05T16:24:33.814Z level=TRACE source=routes.go:2467 msg="builtin parser empty output" parser=gemma4
time=2026-04-05T16:24:33.816Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=2
time=2026-04-05T16:24:33.816Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=2
time=2026-04-05T16:24:33.969Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=1
time=2026-04-05T16:24:33.970Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=1
time=2026-04-05T16:24:33.970Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=1 seqIdx=0 len(logits)=262144 len(activeBatch.batch.Outputs)=1 vocabSize=262144 iBatches=[0]
time=2026-04-05T16:24:33.971Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=1
time=2026-04-05T16:24:33.971Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=2
panic: failed to sample token

goroutine 1039 [running]:
github.com/ollama/ollama/runner/ollamarunner.(*Server).computeBatch(0xc0002370e0, {0x1, {0x55a60e03e910, 0xc0000ae000}, {0x55a60e04c140, 0xc000011b90}, {0xc00007e1f0, 0x1, 0x1}, {{0x55a60e04c140, ...}, ...}, ...})
	github.com/ollama/ollama/runner/ollamarunner/runner.go:762 +0x1c25
created by github.com/ollama/ollama/runner/ollamarunner.(*Server).run in goroutine 12
	github.com/ollama/ollama/runner/ollamarunner/runner.go:459 +0x2cd

OS

Fedora CoreOS F43 (Linux version 6.19.7-200.fc43.x86_64)

GPU

Radeon 680m

CPU

AMD Ryzen 7 7735HS

Ollama version

Ollama 0.20.2 (Docker built)

Originally created by @rjmalagon on GitHub (Apr 5, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/15348 ### What is the issue? When loaded from https://huggingface.co/google/gemma-4-26B-A4B-it ( `ollama create -f Modelfile-fromGemma4Modelfile ./gemma-4-26B-A4B-it gemma4:26b-a4b-bf16` ), it crashes after loading the model just after prompt input. If the model is converted/quantized to F16 (`ollama create -quantize F16 -f Modelfile-fromGemma4Modelfile ./gemma-4-26B-A4B-it gemma4:26b-a4b-f16` , it crashes too. My inference server is an AMD Ryzen 7 7735HS with a Radeon 680M APU with 80 GB shared iGPU RAM from 96 GB main RAM, Fedora CoreOS F43, and a Podman container environment with a ROCm runtime Ollama image (all around works great! Thanks to Ollama team and its code contributors). Ollama logs when it fails. ``` time=2026-04-05T16:24:03.311Z level=DEBUG source=ggml.go:325 msg="key with type not found" key=gemma4.pooling_type default=0 time=2026-04-05T16:24:03.311Z level=TRACE source=runner.go:480 msg="forwardBatch no pending batch detected" batchID=0 time=2026-04-05T16:24:03.518Z level=INFO source=server.go:1390 msg="llama runner started in 42.20 seconds" time=2026-04-05T16:24:03.518Z level=DEBUG source=sched.go:573 msg="finished setting up" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="68.3 GiB" runner.vram="68.3 GiB" runner.parallel=1 runner.pid=82 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144 [GIN] 2026/04/05 - 16:24:03 | 200 | 42.667543514s | 127.0.0.1 | POST "/api/generate" time=2026-04-05T16:24:03.524Z level=DEBUG source=sched.go:581 msg="context for request finished" time=2026-04-05T16:24:03.524Z level=DEBUG source=sched.go:309 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="68.3 GiB" runner.vram="68.3 GiB" runner.parallel=1 runner.pid=82 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144 duration=5m0s time=2026-04-05T16:24:03.524Z level=DEBUG source=sched.go:327 msg="after processing request finished event" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="68.3 GiB" runner.vram="68.3 GiB" runner.parallel=1 runner.pid=82 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144 refCount=0 time=2026-04-05T16:24:29.480Z level=DEBUG source=sched.go:672 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f time=2026-04-05T16:24:29.574Z level=TRACE source=bytepairencoding.go:287 msg=encoded string="<bos><|turn>system\n<|think|><turn|>\n<|turn>user\ntest<turn|>\n<|turn>model\n" ids="[2 105 9731 107 98 106 107 105 2364 107 2181 106 107 105 4368 107]" time=2026-04-05T16:24:29.575Z level=DEBUG source=server.go:1538 msg="completion request" images=0 prompt=73 format="" time=2026-04-05T16:24:29.575Z level=TRACE source=server.go:1539 msg="completion request" prompt="<bos><|turn>system\n<|think|><turn|>\n<|turn>user\ntest<turn|>\n<|turn>model\n" time=2026-04-05T16:24:29.708Z level=TRACE source=bytepairencoding.go:287 msg=encoded string="<bos><|turn>system\n<|think|><turn|>\n<|turn>user\ntest<turn|>\n<|turn>model\n" ids="[2 105 9731 107 98 106 107 105 2364 107 2181 106 107 105 4368 107]" time=2026-04-05T16:24:29.709Z level=DEBUG source=cache.go:151 msg="loading cache slot" id=0 cache=0 prompt=16 used=0 remaining=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=2 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iB_No response_atch=0 i+1=3 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=4 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=5 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=6 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=7 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=8 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=9 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=10 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=11 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=12 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=13 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=14 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=15 len(seq.inputs)=16 time=2026-04-05T16:24:29.709Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=16 len(seq.inputs)=16 time=2026-04-05T16:24:29.716Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=0 time=2026-04-05T16:24:29.716Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=0 time=2026-04-05T16:24:29.716Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=0 time=2026-04-05T16:24:29.716Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=0 time=2026-04-05T16:24:29.716Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=0 id=1 time=2026-04-05T16:24:29.717Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=1 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-04-05T16:24:29.719Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=1 time=2026-04-05T16:24:29.719Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=1 time=2026-04-05T16:24:33.811Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=0 time=2026-04-05T16:24:33.811Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=0 time=2026-04-05T16:24:33.811Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=0 seqIdx=0 len(logits)=262144 len(activeBatch.batch.Outputs)=1 vocabSize=262144 iBatches=[0] time=2026-04-05T16:24:33.813Z level=TRACE source=bytepairencoding.go:328 msg=decoded string=<|channel> from=[100] time=2026-04-05T16:24:33.814Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=0 time=2026-04-05T16:24:33.814Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=1 time=2026-04-05T16:24:33.814Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=1 time=2026-04-05T16:24:33.814Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=1 id=2 time=2026-04-05T16:24:33.814Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=2 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-04-05T16:24:33.814Z level=TRACE source=routes.go:2440 msg="builtin parser input" parser=gemma4 content=<|channel> time=2026-04-05T16:24:33.814Z level=TRACE source=routes.go:2467 msg="builtin parser empty output" parser=gemma4 time=2026-04-05T16:24:33.816Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=2 time=2026-04-05T16:24:33.816Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=2 time=2026-04-05T16:24:33.969Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=1 time=2026-04-05T16:24:33.970Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=1 time=2026-04-05T16:24:33.970Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=1 seqIdx=0 len(logits)=262144 len(activeBatch.batch.Outputs)=1 vocabSize=262144 iBatches=[0] time=2026-04-05T16:24:33.971Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=1 time=2026-04-05T16:24:33.971Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=2 panic: failed to sample token goroutine 1039 [running]: github.com/ollama/ollama/runner/ollamarunner.(*Server).computeBatch(0xc0002370e0, {0x1, {0x55a60e03e910, 0xc0000ae000}, {0x55a60e04c140, 0xc000011b90}, {0xc00007e1f0, 0x1, 0x1}, {{0x55a60e04c140, ...}, ...}, ...}) github.com/ollama/ollama/runner/ollamarunner/runner.go:762 +0x1c25 created by github.com/ollama/ollama/runner/ollamarunner.(*Server).run in goroutine 12 github.com/ollama/ollama/runner/ollamarunner/runner.go:459 +0x2cd ``` ### OS Fedora CoreOS F43 (Linux version 6.19.7-200.fc43.x86_64) ### GPU Radeon 680m ### CPU AMD Ryzen 7 7735HS ### Ollama version Ollama 0.20.2 (Docker built)
GiteaMirror added the bugneeds more info labels 2026-05-10 05:47:41 -05:00
GiteaMirror commented 2026-05-10 05:47:43 -05:00
Author
Owner
Copy Link

@pdevine commented on GitHub (Apr 7, 2026):

@rjmalagon What does your Modelfile look like?

<!-- gh-comment-id:4201139174 --> @pdevine commented on GitHub (Apr 7, 2026): @rjmalagon What does your Modelfile look like?
GiteaMirror commented 2026-05-10 05:47:44 -05:00
Author
Owner
Copy Link

@rjmalagon commented on GitHub (Apr 7, 2026):

Excerpt

FROM /root/.ollama/otros/gemma-4-26B-A4B-it
TEMPLATE {{ .Prompt }}
RENDERER gemma4
PARSER gemma4
PARAMETER temperature 1
PARAMETER top_k 64
PARAMETER top_p 0.95
LICENSE """                                Apache License
                           Version 2.0, January 2004
                        http://www.apache.org/licenses/
   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
   1. Definitions.
      "License" shall mean the terms and c ....```
<!-- gh-comment-id:4202600293 --> @rjmalagon commented on GitHub (Apr 7, 2026): Excerpt ``` FROM /root/.ollama/otros/gemma-4-26B-A4B-it TEMPLATE {{ .Prompt }} RENDERER gemma4 PARSER gemma4 PARAMETER temperature 1 PARAMETER top_k 64 PARAMETER top_p 0.95 LICENSE """ Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION 1. Definitions. "License" shall mean the terms and c ....```
GiteaMirror commented 2026-05-10 05:47:45 -05:00
Author
Owner
Copy Link

@pdevine commented on GitHub (Apr 7, 2026):

I'll see if I can repro, but one thing caught my eye which is if you have specified the renderer you don't need the template.

<!-- gh-comment-id:4202854484 --> @pdevine commented on GitHub (Apr 7, 2026): I'll see if I can repro, but one thing caught my eye which is if you have specified the renderer you don't need the template.
GiteaMirror commented 2026-05-10 05:47:45 -05:00
Author
Owner
Copy Link

@rjmalagon commented on GitHub (Apr 10, 2026):

I took out the template line.
I update to Ollama 0.20.5-rc2.
Is this huge RAM usage normal with these model conversions? It OOM kills the conversion.

Image Image
<!-- gh-comment-id:4220186729 --> @rjmalagon commented on GitHub (Apr 10, 2026): I took out the template line. I update to Ollama 0.20.5-rc2. Is this huge RAM usage normal with these model conversions? It OOM kills the conversion. <img width="908" height="225" alt="Image" src="https://github.com/user-attachments/assets/8e6e2be7-b8c9-4b53-a101-23f3def06058" /> <img width="1630" height="318" alt="Image" src="https://github.com/user-attachments/assets/d60e76aa-ccd4-470f-bd93-7355e7a3bf82" />
GiteaMirror commented 2026-05-10 05:47:46 -05:00
Author
Owner
Copy Link

@rjmalagon commented on GitHub (Apr 10, 2026):

I assign just one CPU core to the creation to circumvent the OOM.
I upload this model to repo.
rjmalagon/gemma4:26b-a4b-bf16

However, Ollama crashes once more at inference.

time=2026-04-10T15:09:36.708Z level=DEBUG source=server.go:1408 msg="model load progress 0.99"
time=2026-04-10T15:09:36.959Z level=DEBUG source=server.go:1408 msg="model load progress 1.00"
time=2026-04-10T15:09:37.152Z level=DEBUG source=ggml.go:325 msg="key with type not found" key=gemma4.pooling_type default=0
time=2026-04-10T15:09:37.152Z level=TRACE source=runner.go:480 msg="forwardBatch no pending batch detected" batchID=0
time=2026-04-10T15:09:37.210Z level=INFO source=server.go:1402 msg="llama runner started in 222.57 seconds"
time=2026-04-10T15:09:37.211Z level=DEBUG source=sched.go:573 msg="finished setting up" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="56.2 GiB" runner.vram="56.2 GiB" runner.parallel=1 runner.pid=164 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144
time=2026-04-10T15:09:37.323Z level=TRACE source=bytepairencoding.go:287 msg=encoded string="<bos><|turn>user\nthis is a test<turn|>\n<|turn>model\n" ids="[2 105 2364 107 1580 563 496 1594 106 107 105 4368 107]"
time=2026-04-10T15:09:37.324Z level=DEBUG source=server.go:1550 msg="completion request" images=0 prompt=52 format=""
time=2026-04-10T15:09:37.324Z level=TRACE source=server.go:1551 msg="completion request" prompt="<bos><|turn>user\nthis is a test<turn|>\n<|turn>model\n"
time=2026-04-10T15:09:37.410Z level=TRACE source=bytepairencoding.go:287 msg=encoded string="<bos><|turn>user\nthis is a test<turn|>\n<|turn>model\n" ids="[2 105 2364 107 1580 563 496 1594 106 107 105 4368 107]"
time=2026-04-10T15:09:37.411Z level=DEBUG source=cache.go:151 msg="loading cache slot" id=0 cache=0 prompt=13 used=0 remaining=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=2 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=3 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=4 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=5 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=6 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=7 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=8 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=9 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=10 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=11 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=12 len(seq.inputs)=13
time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=13 len(seq.inputs)=13
time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=0
time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=0
time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=0
time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=0
time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=0 id=1
time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=1 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-04-10T15:09:37.414Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=1
time=2026-04-10T15:09:37.414Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=1
time=2026-04-10T15:09:42.898Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=0
time=2026-04-10T15:09:42.898Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=0
time=2026-04-10T15:09:42.898Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=0 seqIdx=0 len(logits)=262144 len(activeBatch.batch.Outputs)=1 vocabSize=262144 iBatches=[0]
time=2026-04-10T15:09:42.901Z level=TRACE source=bytepairencoding.go:328 msg=decoded string=<|channel> from=[100]
time=2026-04-10T15:09:42.901Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=0
time=2026-04-10T15:09:42.901Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=1
time=2026-04-10T15:09:42.901Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=1
time=2026-04-10T15:09:42.901Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=1 id=2
time=2026-04-10T15:09:42.901Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=2 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-04-10T15:09:42.902Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=2
time=2026-04-10T15:09:42.902Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=2
time=2026-04-10T15:09:42.902Z level=TRACE source=routes.go:2448 msg="builtin parser input" parser=gemma4 content=<|channel>
time=2026-04-10T15:09:42.902Z level=TRACE source=routes.go:2475 msg="builtin parser empty output" parser=gemma4
time=2026-04-10T15:09:43.079Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=1
time=2026-04-10T15:09:43.079Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=1
time=2026-04-10T15:09:43.079Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=1 seqIdx=0 len(logits)=262144 len(activeBatch.batch.Outputs)=1 vocabSize=262144 iBatches=[0]
time=2026-04-10T15:09:43.081Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=1
panic: failed to sample token

goroutine 1153 [running]:
github.com/ollama/ollama/runner/ollamarunner.(*Server).computeBatch(0xc0002270e0, {0x1, {0x5626ae2aab70, 0xc00164a000}, {0x5626ae2b83c0, 0xc001248d08}, {0xc0015bc008, 0x1, 0x1}, {{0x5626ae2b83c0, ...}, ...}, ...})
	github.com/ollama/ollama/runner/ollamarunner/runner.go:762 +0x1c25
created by github.com/ollama/ollama/runner/ollamarunner.(*Server).run in goroutine 12
	github.com/ollama/ollama/runner/ollamarunner/runner.go:459 +0x2cd
time=2026-04-10T15:09:43.263Z level=DEBUG source=server.go:1844 msg="stopping llama server" pid=164
[GIN] 2026/04/10 - 15:09:43 | 500 |         3m49s |       127.0.0.1 | POST     "/api/chat"
time=2026-04-10T15:09:43.263Z level=DEBUG source=sched.go:581 msg="context for request finished"
time=2026-04-10T15:09:43.263Z level=DEBUG source=sched.go:309 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="56.2 GiB" runner.vram="56.2 GiB" runner.parallel=1 runner.pid=164 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144 duration=5m0s
time=2026-04-10T15:09:43.264Z level=DEBUG source=sched.go:327 msg="after processing request finished event" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="56.2 GiB" runner.vram="56.2 GiB" runner.parallel=1 runner.pid=164 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144 refCount=0
<!-- gh-comment-id:4224787823 --> @rjmalagon commented on GitHub (Apr 10, 2026): I assign just one CPU core to the creation to circumvent the OOM. I upload this model to repo. `rjmalagon/gemma4:26b-a4b-bf16` However, Ollama crashes once more at inference. ``` time=2026-04-10T15:09:36.708Z level=DEBUG source=server.go:1408 msg="model load progress 0.99" time=2026-04-10T15:09:36.959Z level=DEBUG source=server.go:1408 msg="model load progress 1.00" time=2026-04-10T15:09:37.152Z level=DEBUG source=ggml.go:325 msg="key with type not found" key=gemma4.pooling_type default=0 time=2026-04-10T15:09:37.152Z level=TRACE source=runner.go:480 msg="forwardBatch no pending batch detected" batchID=0 time=2026-04-10T15:09:37.210Z level=INFO source=server.go:1402 msg="llama runner started in 222.57 seconds" time=2026-04-10T15:09:37.211Z level=DEBUG source=sched.go:573 msg="finished setting up" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="56.2 GiB" runner.vram="56.2 GiB" runner.parallel=1 runner.pid=164 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144 time=2026-04-10T15:09:37.323Z level=TRACE source=bytepairencoding.go:287 msg=encoded string="<bos><|turn>user\nthis is a test<turn|>\n<|turn>model\n" ids="[2 105 2364 107 1580 563 496 1594 106 107 105 4368 107]" time=2026-04-10T15:09:37.324Z level=DEBUG source=server.go:1550 msg="completion request" images=0 prompt=52 format="" time=2026-04-10T15:09:37.324Z level=TRACE source=server.go:1551 msg="completion request" prompt="<bos><|turn>user\nthis is a test<turn|>\n<|turn>model\n" time=2026-04-10T15:09:37.410Z level=TRACE source=bytepairencoding.go:287 msg=encoded string="<bos><|turn>user\nthis is a test<turn|>\n<|turn>model\n" ids="[2 105 2364 107 1580 563 496 1594 106 107 105 4368 107]" time=2026-04-10T15:09:37.411Z level=DEBUG source=cache.go:151 msg="loading cache slot" id=0 cache=0 prompt=13 used=0 remaining=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=2 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=3 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=4 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=5 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=6 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=7 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=8 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=9 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=10 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=11 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=12 len(seq.inputs)=13 time=2026-04-10T15:09:37.411Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=0 seqIdx=0 seq.iBatch=0 i+1=13 len(seq.inputs)=13 time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=0 time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=0 time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=0 time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=0 time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=0 id=1 time=2026-04-10T15:09:37.413Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=1 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-04-10T15:09:37.414Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=1 time=2026-04-10T15:09:37.414Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=1 time=2026-04-10T15:09:42.898Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=0 time=2026-04-10T15:09:42.898Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=0 time=2026-04-10T15:09:42.898Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=0 seqIdx=0 len(logits)=262144 len(activeBatch.batch.Outputs)=1 vocabSize=262144 iBatches=[0] time=2026-04-10T15:09:42.901Z level=TRACE source=bytepairencoding.go:328 msg=decoded string=<|channel> from=[100] time=2026-04-10T15:09:42.901Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=0 time=2026-04-10T15:09:42.901Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=1 time=2026-04-10T15:09:42.901Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=1 time=2026-04-10T15:09:42.901Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=1 id=2 time=2026-04-10T15:09:42.901Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=2 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-04-10T15:09:42.902Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=2 time=2026-04-10T15:09:42.902Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=2 time=2026-04-10T15:09:42.902Z level=TRACE source=routes.go:2448 msg="builtin parser input" parser=gemma4 content=<|channel> time=2026-04-10T15:09:42.902Z level=TRACE source=routes.go:2475 msg="builtin parser empty output" parser=gemma4 time=2026-04-10T15:09:43.079Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=1 time=2026-04-10T15:09:43.079Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=1 time=2026-04-10T15:09:43.079Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=1 seqIdx=0 len(logits)=262144 len(activeBatch.batch.Outputs)=1 vocabSize=262144 iBatches=[0] time=2026-04-10T15:09:43.081Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=1 panic: failed to sample token goroutine 1153 [running]: github.com/ollama/ollama/runner/ollamarunner.(*Server).computeBatch(0xc0002270e0, {0x1, {0x5626ae2aab70, 0xc00164a000}, {0x5626ae2b83c0, 0xc001248d08}, {0xc0015bc008, 0x1, 0x1}, {{0x5626ae2b83c0, ...}, ...}, ...}) github.com/ollama/ollama/runner/ollamarunner/runner.go:762 +0x1c25 created by github.com/ollama/ollama/runner/ollamarunner.(*Server).run in goroutine 12 github.com/ollama/ollama/runner/ollamarunner/runner.go:459 +0x2cd time=2026-04-10T15:09:43.263Z level=DEBUG source=server.go:1844 msg="stopping llama server" pid=164 [GIN] 2026/04/10 - 15:09:43 | 500 | 3m49s | 127.0.0.1 | POST "/api/chat" time=2026-04-10T15:09:43.263Z level=DEBUG source=sched.go:581 msg="context for request finished" time=2026-04-10T15:09:43.263Z level=DEBUG source=sched.go:309 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="56.2 GiB" runner.vram="56.2 GiB" runner.parallel=1 runner.pid=164 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144 duration=5m0s time=2026-04-10T15:09:43.264Z level=DEBUG source=sched.go:327 msg="after processing request finished event" runner.name=registry.ollama.ai/rjmalagon/gemma4:26b-a4b-bf16 runner.inference="[{ID:0 Library:ROCm}]" runner.size="56.2 GiB" runner.vram="56.2 GiB" runner.parallel=1 runner.pid=164 runner.model=/root/.ollama/models/blobs/sha256-82aee8b779e33a43efb75e4c7a4ff25ce05cd256a8cae73343f1fe6a4b5afa2f runner.num_ctx=262144 refCount=0 ```
GiteaMirror commented 2026-05-10 05:47:46 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (Apr 21, 2026):

We've been fixing various renderer bugs which may be related. Can you retest on the latest release?

<!-- gh-comment-id:4285275635 --> @dhiltgen commented on GitHub (Apr 21, 2026): We've been fixing various renderer bugs which may be related. Can you retest on the latest release?
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug needs more info
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#87507
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?