[GH-ISSUE #13705] Ministral tool call parser can't deal with nested objects and results in 500 #55501

Closed
opened 2026-04-29 09:18:18 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @iamjackg on GitHub (Jan 13, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/13705

What is the issue?

The tool call parser for ministral will stop at the first } it finds and try to unmarshal everything preceding it as JSON, which fails with nested structures.

98079ddd79/model/parsers/ministral.go (L111)

This results in a 500 error saying unexpected end of JSON input, since the parser tries to unmarshal incomplete JSON.

As an example, a tool call like this fails to parse:

[TOOL_CALLS]create_entities[ARGS]{"entities": [{"entityType": "Person", "name": "Jack", "observations": ["Works as a baker at Big Baker Co."]}]}

The parser will see the first } right after Co."], stop there, and try to unmarshal {"entities": [{"entityType": "Person", "name": "Jack", "observations": ["Works as a baker at Big Baker Co."]}, which obviously fails.

See the (abridged) logs below for an example -- you can see GIN return a 500 right after the first ]} as the parser errors out, while the runner keeps decoding the remaining ]} and EOS.

Relevant log output

Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=bytepairencoding.go:280 msg=decoded string=" Co" from=[5361]
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=38
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=runner.go:652 msg="computeBatch: inputs are ready" batchID=39
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=runner.go:725 msg="computeBatch: signaling computeStartedCh" batchID=39
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=runner.go:476 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=39 id=40
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=runner.go:598 msg="forwardBatch iBatch" batchID=40 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=routes.go:2176 msg="builtin parser input" parser=ministral content=" Co"
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=routes.go:2203 msg="builtin parser empty output" parser=ministral
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.034-05:00 level=TRACE source=runner.go:474 msg="forwardBatch waiting for compute to start" pendingBatch.id=40
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.034-05:00 level=TRACE source=runner.go:650 msg="computeBatch: waiting for inputs to be ready" batchID=40
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.105-05:00 level=TRACE source=runner.go:733 msg="computeBatch: logits ready" batchID=39
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.105-05:00 level=TRACE source=runner.go:738 msg="computeBatch: decoding" batchID=39
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.105-05:00 level=TRACE source=runner.go:759 msg="computeBatch: vocab details" batchID=39 seqIdx=0 len(logits)=131072 len(activeBatch.batch.Outputs)=1 vocabSize=131072 iBatches=[0]
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=bytepairencoding.go:280 msg=decoded string=".\"" from=[2613]
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=39
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=runner.go:652 msg="computeBatch: inputs are ready" batchID=40
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=routes.go:2176 msg="builtin parser input" parser=ministral content=".\""
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=routes.go:2203 msg="builtin parser empty output" parser=ministral
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=runner.go:725 msg="computeBatch: signaling computeStartedCh" batchID=40
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=runner.go:476 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=40 id=41
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=runner.go:598 msg="forwardBatch iBatch" batchID=41 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.107-05:00 level=TRACE source=runner.go:474 msg="forwardBatch waiting for compute to start" pendingBatch.id=41
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.107-05:00 level=TRACE source=runner.go:650 msg="computeBatch: waiting for inputs to be ready" batchID=41
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:733 msg="computeBatch: logits ready" batchID=40
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:738 msg="computeBatch: decoding" batchID=40
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:759 msg="computeBatch: vocab details" batchID=40 seqIdx=0 len(logits)=131072 len(activeBatch.batch.Outputs)=1 vocabSize=131072 iBatches=[0]
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=bytepairencoding.go:280 msg=decoded string=]} from=[16474]
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=40
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:652 msg="computeBatch: inputs are ready" batchID=41
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:725 msg="computeBatch: signaling computeStartedCh" batchID=41
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:476 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=41 id=42
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:598 msg="forwardBatch iBatch" batchID=42 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=TRACE source=routes.go:2176 msg="builtin parser input" parser=ministral content=]}
Jan 13 14:03:46 beast ollama[551642]: [GIN] 2026/01/13 - 14:03:46 | 500 |  8.202634104s |   192.168.2.130 | POST     "/api/chat"
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=DEBUG source=sched.go:537 msg="context for request finished"
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=DEBUG source=sched.go:290 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/ministral-3:14b-fixtools runner.inference="[{ID:GPU-aebc1acf-8c25-c81d-2a78-2a9aae86afb8 Library:CUDA}]" runner.size="10.9 GiB" runner.vram="7.2 GiB" runner.parallel=1 runner.pid=552323 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-bfb40fc6bb9c3b2ed529b480e04f824c005ea8f86733d4ebbf0c204de484891e runner.num_ctx=8192 duration=5m0s
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=DEBUG source=sched.go:308 msg="after processing request finished event" runner.name=registry.ollama.ai/library/ministral-3:14b-fixtools runner.inference="[{ID:GPU-aebc1acf-8c25-c81d-2a78-2a9aae86afb8 Library:CUDA}]" runner.size="10.9 GiB" runner.vram="7.2 GiB" runner.parallel=1 runner.pid=552323 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-bfb40fc6bb9c3b2ed529b480e04f824c005ea8f86733d4ebbf0c204de484891e runner.num_ctx=8192 refCount=0
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=TRACE source=runner.go:474 msg="forwardBatch waiting for compute to start" pendingBatch.id=42
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=TRACE source=runner.go:650 msg="computeBatch: waiting for inputs to be ready" batchID=42
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:733 msg="computeBatch: logits ready" batchID=41
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:738 msg="computeBatch: decoding" batchID=41
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:759 msg="computeBatch: vocab details" batchID=41 seqIdx=0 len(logits)=131072 len(activeBatch.batch.Outputs)=1 vocabSize=131072 iBatches=[0]
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=bytepairencoding.go:280 msg=decoded string=]} from=[16474]
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=41
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:652 msg="computeBatch: inputs are ready" batchID=42
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:725 msg="computeBatch: signaling computeStartedCh" batchID=42
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:476 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=42 id=43
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:598 msg="forwardBatch iBatch" batchID=43 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.259-05:00 level=TRACE source=runner.go:474 msg="forwardBatch waiting for compute to start" pendingBatch.id=43
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.259-05:00 level=TRACE source=runner.go:650 msg="computeBatch: waiting for inputs to be ready" batchID=43
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:733 msg="computeBatch: logits ready" batchID=42
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:738 msg="computeBatch: decoding" batchID=42
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:759 msg="computeBatch: vocab details" batchID=42 seqIdx=0 len(logits)=131072 len(activeBatch.batch.Outputs)=1 vocabSize=131072 iBatches=[0]
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:773 msg="computeBatch: EOS" batchID=42 seqIdx=0
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=42
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:652 msg="computeBatch: inputs are ready" batchID=43
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:725 msg="computeBatch: signaling computeStartedCh" batchID=43
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:476 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=43 id=44
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.405-05:00 level=TRACE source=runner.go:733 msg="computeBatch: logits ready" batchID=43
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.405-05:00 level=TRACE source=runner.go:738 msg="computeBatch: decoding" batchID=43
Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.405-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=43

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.13.4

Originally created by @iamjackg on GitHub (Jan 13, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/13705 ### What is the issue? The tool call parser for ministral will stop at the first `}` it finds and try to unmarshal everything preceding it as JSON, which fails with nested structures. https://github.com/ollama/ollama/blob/98079ddd79ad681957ef101dadd8fbb5060c7f6e/model/parsers/ministral.go#L111 This results in a `500` error saying `unexpected end of JSON input`, since the parser tries to unmarshal incomplete JSON. As an example, a tool call like this fails to parse: ``` [TOOL_CALLS]create_entities[ARGS]{"entities": [{"entityType": "Person", "name": "Jack", "observations": ["Works as a baker at Big Baker Co."]}]} ``` The parser will see the first `}` right after `Co."]`, stop there, and try to unmarshal `{"entities": [{"entityType": "Person", "name": "Jack", "observations": ["Works as a baker at Big Baker Co."]}`, which obviously fails. See the (abridged) logs below for an example -- you can see GIN return a 500 right after the first `]}` as the parser errors out, while the runner keeps decoding the remaining `]}` and EOS. ### Relevant log output ```shell Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=bytepairencoding.go:280 msg=decoded string=" Co" from=[5361] Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=38 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=runner.go:652 msg="computeBatch: inputs are ready" batchID=39 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=runner.go:725 msg="computeBatch: signaling computeStartedCh" batchID=39 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=runner.go:476 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=39 id=40 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=runner.go:598 msg="forwardBatch iBatch" batchID=40 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=routes.go:2176 msg="builtin parser input" parser=ministral content=" Co" Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.033-05:00 level=TRACE source=routes.go:2203 msg="builtin parser empty output" parser=ministral Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.034-05:00 level=TRACE source=runner.go:474 msg="forwardBatch waiting for compute to start" pendingBatch.id=40 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.034-05:00 level=TRACE source=runner.go:650 msg="computeBatch: waiting for inputs to be ready" batchID=40 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.105-05:00 level=TRACE source=runner.go:733 msg="computeBatch: logits ready" batchID=39 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.105-05:00 level=TRACE source=runner.go:738 msg="computeBatch: decoding" batchID=39 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.105-05:00 level=TRACE source=runner.go:759 msg="computeBatch: vocab details" batchID=39 seqIdx=0 len(logits)=131072 len(activeBatch.batch.Outputs)=1 vocabSize=131072 iBatches=[0] Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=bytepairencoding.go:280 msg=decoded string=".\"" from=[2613] Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=39 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=runner.go:652 msg="computeBatch: inputs are ready" batchID=40 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=routes.go:2176 msg="builtin parser input" parser=ministral content=".\"" Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=routes.go:2203 msg="builtin parser empty output" parser=ministral Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=runner.go:725 msg="computeBatch: signaling computeStartedCh" batchID=40 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=runner.go:476 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=40 id=41 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.106-05:00 level=TRACE source=runner.go:598 msg="forwardBatch iBatch" batchID=41 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.107-05:00 level=TRACE source=runner.go:474 msg="forwardBatch waiting for compute to start" pendingBatch.id=41 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.107-05:00 level=TRACE source=runner.go:650 msg="computeBatch: waiting for inputs to be ready" batchID=41 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:733 msg="computeBatch: logits ready" batchID=40 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:738 msg="computeBatch: decoding" batchID=40 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:759 msg="computeBatch: vocab details" batchID=40 seqIdx=0 len(logits)=131072 len(activeBatch.batch.Outputs)=1 vocabSize=131072 iBatches=[0] Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=bytepairencoding.go:280 msg=decoded string=]} from=[16474] Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=40 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:652 msg="computeBatch: inputs are ready" batchID=41 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:725 msg="computeBatch: signaling computeStartedCh" batchID=41 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:476 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=41 id=42 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.182-05:00 level=TRACE source=runner.go:598 msg="forwardBatch iBatch" batchID=42 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=TRACE source=routes.go:2176 msg="builtin parser input" parser=ministral content=]} Jan 13 14:03:46 beast ollama[551642]: [GIN] 2026/01/13 - 14:03:46 | 500 | 8.202634104s | 192.168.2.130 | POST "/api/chat" Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=DEBUG source=sched.go:537 msg="context for request finished" Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=DEBUG source=sched.go:290 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/ministral-3:14b-fixtools runner.inference="[{ID:GPU-aebc1acf-8c25-c81d-2a78-2a9aae86afb8 Library:CUDA}]" runner.size="10.9 GiB" runner.vram="7.2 GiB" runner.parallel=1 runner.pid=552323 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-bfb40fc6bb9c3b2ed529b480e04f824c005ea8f86733d4ebbf0c204de484891e runner.num_ctx=8192 duration=5m0s Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=DEBUG source=sched.go:308 msg="after processing request finished event" runner.name=registry.ollama.ai/library/ministral-3:14b-fixtools runner.inference="[{ID:GPU-aebc1acf-8c25-c81d-2a78-2a9aae86afb8 Library:CUDA}]" runner.size="10.9 GiB" runner.vram="7.2 GiB" runner.parallel=1 runner.pid=552323 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-bfb40fc6bb9c3b2ed529b480e04f824c005ea8f86733d4ebbf0c204de484891e runner.num_ctx=8192 refCount=0 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=TRACE source=runner.go:474 msg="forwardBatch waiting for compute to start" pendingBatch.id=42 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.183-05:00 level=TRACE source=runner.go:650 msg="computeBatch: waiting for inputs to be ready" batchID=42 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:733 msg="computeBatch: logits ready" batchID=41 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:738 msg="computeBatch: decoding" batchID=41 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:759 msg="computeBatch: vocab details" batchID=41 seqIdx=0 len(logits)=131072 len(activeBatch.batch.Outputs)=1 vocabSize=131072 iBatches=[0] Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=bytepairencoding.go:280 msg=decoded string=]} from=[16474] Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=41 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:652 msg="computeBatch: inputs are ready" batchID=42 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:725 msg="computeBatch: signaling computeStartedCh" batchID=42 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:476 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=42 id=43 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.258-05:00 level=TRACE source=runner.go:598 msg="forwardBatch iBatch" batchID=43 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.259-05:00 level=TRACE source=runner.go:474 msg="forwardBatch waiting for compute to start" pendingBatch.id=43 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.259-05:00 level=TRACE source=runner.go:650 msg="computeBatch: waiting for inputs to be ready" batchID=43 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:733 msg="computeBatch: logits ready" batchID=42 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:738 msg="computeBatch: decoding" batchID=42 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:759 msg="computeBatch: vocab details" batchID=42 seqIdx=0 len(logits)=131072 len(activeBatch.batch.Outputs)=1 vocabSize=131072 iBatches=[0] Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:773 msg="computeBatch: EOS" batchID=42 seqIdx=0 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=42 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:652 msg="computeBatch: inputs are ready" batchID=43 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:725 msg="computeBatch: signaling computeStartedCh" batchID=43 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.331-05:00 level=TRACE source=runner.go:476 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=43 id=44 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.405-05:00 level=TRACE source=runner.go:733 msg="computeBatch: logits ready" batchID=43 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.405-05:00 level=TRACE source=runner.go:738 msg="computeBatch: decoding" batchID=43 Jan 13 14:03:46 beast ollama[551642]: time=2026-01-13T14:03:46.405-05:00 level=TRACE source=runner.go:657 msg="computeBatch: outputs are ready" batchID=43 ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.13.4
GiteaMirror added the bug label 2026-04-29 09:18:18 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#55501