[GH-ISSUE #14492] ollama-qwen3.5:35b suspicious compatibility problem #55911

New Issue

GiteaMirror · 2026-04-29T09:56:08-05:00

GiteaMirror commented

2026-04-29 09:56:08 -05:00

Originally created by @Jackallink on GitHub (Feb 27, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/14492

What is the issue?

ERROR: raise ResponseError(e.response.text, e.response.status_code) from None ollama._types.ResponseError: failed to parse JSON: unexpected end of JSON input (status code: 500)
OS: Mac osx : RAM 64G
Ollama client: pypi ollama 0.6.1
0llama version: 0.17.4
model: qwen3.5:35b
Whenever I config num_ctx as 8k,16k,64k,128k or 256k, this error will reproduced. Not sure it's a ollama-qwen3.5:35b compatibility problem. When I used qwen3:30b, the problem would not reproduced.

Full Content here 👇:

Bug Report: qwen3.5 tool call parsing fails with "failed to parse JSON: unexpected end of JSON input"

Issue Description

When using the qwen3.5 model (qwen35moe) with tool calling enabled via Ollama Python library, the API returns HTTP 500 errors. The server logs show:

qwen3 tool call parsing failed error="failed to parse JSON: unexpected end of JSON input"

This error occurs intermittently but repeatedly during chat sessions that involve tool calls.

Environment

Ollama Version: 0.17.4
macOS Version: Darwin/24.6.0 (macOS Sequoia)
Hardware: Apple M1 Max (Metal GPU)
GPU Memory: 48.0 GiB available
Python Client: ollama Python library

Server Log Context

The following is the relevant excerpt from ~/.ollama/logs/server.log:

# Server startup and model loading
time=2026-02-27T12:46:48.855+08:00 level=INFO source=routes.go:1665 msg="Ollama cloud disabled: false"
time=2026-02-27T12:46:48.862+08:00 level=INFO source=routes.go:1718 msg="Listening on [::]:11434 (version 0.17.4)"
time=2026-02-27T12:46:49.005+08:00 level=INFO source=types.go:42 msg="inference compute" id=0 filter_id=0 library=Metal compute=0.0 name=Metal description="Apple M1 Max" libdirs="" driver=0.0 pci_id="" type=discrete total="48.0 GiB" available="48.0 GiB"

# Model loaded successfully
time=2026-02-27T12:50:20.741+08:00 level=INFO source=ggml.go:136 msg="" architecture=qwen35moe file_type=Q4_K_M name="" description="" num_tensors=1959 num_key_values=57

# Metal GPU initialization
ggml_metal_device_init: GPU name:   Apple M1 Max
ggml_metal_device_init: GPU family: MTLGPUFamilyApple7  (1007)
ggml_metal_device_init: GPU family: MTLGPUFamilyCommon3 (3003)
ggml_metal_device_init: GPU family: MTLGPUFamilyMetal3  (5001)
ggml_metal_device_init: tensor API disabled for pre-M5 and pre-A19 devices
ggml_metal_device_init: has tensor            = false

# Successful chat requests
[GIN] 2026/02/27 - 12:56:09 | 200 |         3m59s |             ::1 | POST     "/api/chat"
[GIN] 2026/02/27 - 12:56:28 | 200 | 18.148873417s |             ::1 | POST     "/api/chat"
[GIN] 2026/02/27 - 12:57:38 | 200 |          1m8s |             ::1 | POST     "/api/chat"
[GIN] 2026/02/27 - 12:57:57 | 200 | 18.438211334s |             ::1 | POST     "/api/chat"

# Tool call parsing failure
time=2026-02-27T12:59:31.677+08:00 level=WARN source=qwen3.go:108 msg="qwen3 tool call parsing failed" error="failed to parse JSON: unexpected end of JSON input"

# HTTP 500 error response
[GIN] 2026/02/27 - 12:59:31 | 500 |         1m34s |             ::1 | POST     "/api/chat"

Error Pattern

The error follows this consistent pattern:

Multiple successful POST /api/chat requests (HTTP 200)
Model generates a tool call
qwen3 tool call parsing failed warning appears in logs
Final request returns HTTP 500

Full Error from Python Client

ERROR: raise ResponseError(e.response.text, e.response.status_code) from None
ollama._types.ResponseError: failed to parse JSON: unexpected end of JSON input (status code: 500)

Additional Observations

Error Source: qwen3.go:108 - This is internal Ollama code for handling Qwen3 model's tool calling
Occurrence Frequency: This error has been observed 10+ times in the server log within a few hours of usage
Model: qwen3.5 (qwen35moe, Q4_K_M quantization)
File Type: GGUF V3 (latest)

Expected Behavior

The model should either:

Successfully generate valid JSON for tool calls, OR
Return a graceful error message instead of causing a 500 error

Possible Root Cause

The Qwen3.5 model appears to generate incomplete JSON output when attempting tool calls. Ollama's internal JSON parser in qwen3.go fails to parse this incomplete JSON, causing the entire request to fail with HTTP 500.

Workarounds Tried

Using different model: qwen3:30b-a3b-thinking work without this issue

Request

This appears to be an issue with how Ollama handles malformed tool call output from the Qwen3.5 model. Possible solutions:

Add retry logic or JSON recovery in the qwen3.go parser
Better error handling to return a more informative message to the client
Document this known limitation for Qwen3.5 tool calling

Logs Location: ~/.ollama/logs/server.log
App Version: 0.17.4
Date: 2026-02-27

Originally created by @Jackallink on GitHub (Feb 27, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/14492 ### What is the issue? ERROR: raise ResponseError(e.response.text, e.response.status_code) from None ollama._types.ResponseError: failed to parse JSON: unexpected end of JSON input (status code: 500) OS: Mac osx : RAM 64G Ollama client: pypi ollama 0.6.1 0llama version: 0.17.4 model: qwen3.5:35b Whenever I config num_ctx as 8k,16k,64k,128k or 256k, this error will reproduced. Not sure it's a ollama-qwen3.5:35b compatibility problem. When I used qwen3:30b, the problem would not reproduced. ---- Full Content here 👇: ## Bug Report: qwen3.5 tool call parsing fails with "failed to parse JSON: unexpected end of JSON input" ### Issue Description When using the `qwen3.5` model (qwen35moe) with tool calling enabled via Ollama Python library, the API returns HTTP 500 errors. The server logs show: ``` qwen3 tool call parsing failed error="failed to parse JSON: unexpected end of JSON input" ``` This error occurs intermittently but repeatedly during chat sessions that involve tool calls. ### Environment - **Ollama Version**: 0.17.4 - **macOS Version**: Darwin/24.6.0 (macOS Sequoia) - **Hardware**: Apple M1 Max (Metal GPU) - **GPU Memory**: 48.0 GiB available - **Python Client**: ollama Python library ### Server Log Context The following is the relevant excerpt from `~/.ollama/logs/server.log`: ``` # Server startup and model loading time=2026-02-27T12:46:48.855+08:00 level=INFO source=routes.go:1665 msg="Ollama cloud disabled: false" time=2026-02-27T12:46:48.862+08:00 level=INFO source=routes.go:1718 msg="Listening on [::]:11434 (version 0.17.4)" time=2026-02-27T12:46:49.005+08:00 level=INFO source=types.go:42 msg="inference compute" id=0 filter_id=0 library=Metal compute=0.0 name=Metal description="Apple M1 Max" libdirs="" driver=0.0 pci_id="" type=discrete total="48.0 GiB" available="48.0 GiB" # Model loaded successfully time=2026-02-27T12:50:20.741+08:00 level=INFO source=ggml.go:136 msg="" architecture=qwen35moe file_type=Q4_K_M name="" description="" num_tensors=1959 num_key_values=57 # Metal GPU initialization ggml_metal_device_init: GPU name: Apple M1 Max ggml_metal_device_init: GPU family: MTLGPUFamilyApple7 (1007) ggml_metal_device_init: GPU family: MTLGPUFamilyCommon3 (3003) ggml_metal_device_init: GPU family: MTLGPUFamilyMetal3 (5001) ggml_metal_device_init: tensor API disabled for pre-M5 and pre-A19 devices ggml_metal_device_init: has tensor = false # Successful chat requests [GIN] 2026/02/27 - 12:56:09 | 200 | 3m59s | ::1 | POST "/api/chat" [GIN] 2026/02/27 - 12:56:28 | 200 | 18.148873417s | ::1 | POST "/api/chat" [GIN] 2026/02/27 - 12:57:38 | 200 | 1m8s | ::1 | POST "/api/chat" [GIN] 2026/02/27 - 12:57:57 | 200 | 18.438211334s | ::1 | POST "/api/chat" # Tool call parsing failure time=2026-02-27T12:59:31.677+08:00 level=WARN source=qwen3.go:108 msg="qwen3 tool call parsing failed" error="failed to parse JSON: unexpected end of JSON input" # HTTP 500 error response [GIN] 2026/02/27 - 12:59:31 | 500 | 1m34s | ::1 | POST "/api/chat" ``` ### Error Pattern The error follows this consistent pattern: 1. Multiple successful `POST /api/chat` requests (HTTP 200) 2. Model generates a tool call 3. `qwen3 tool call parsing failed` warning appears in logs 4. Final request returns HTTP 500 ### Full Error from Python Client ``` ERROR: raise ResponseError(e.response.text, e.response.status_code) from None ollama._types.ResponseError: failed to parse JSON: unexpected end of JSON input (status code: 500) ``` ### Additional Observations - **Error Source**: `qwen3.go:108` - This is internal Ollama code for handling Qwen3 model's tool calling - **Occurrence Frequency**: This error has been observed 10+ times in the server log within a few hours of usage - **Model**: qwen3.5 (qwen35moe, Q4_K_M quantization) - **File Type**: GGUF V3 (latest) ### Expected Behavior The model should either: 1. Successfully generate valid JSON for tool calls, OR 2. Return a graceful error message instead of causing a 500 error ### Possible Root Cause The Qwen3.5 model appears to generate incomplete JSON output when attempting tool calls. Ollama's internal JSON parser in `qwen3.go` fails to parse this incomplete JSON, causing the entire request to fail with HTTP 500. ### Workarounds Tried 1. **Using different model**: qwen3:30b-a3b-thinking work without this issue ### Request This appears to be an issue with how Ollama handles malformed tool call output from the Qwen3.5 model. Possible solutions: 1. Add retry logic or JSON recovery in the qwen3.go parser 2. Better error handling to return a more informative message to the client 3. Document this known limitation for Qwen3.5 tool calling --- **Logs Location**: `~/.ollama/logs/server.log` **App Version**: 0.17.4 **Date**: 2026-02-27

GiteaMirror added the bug label 2026-04-29 09:56:08 -05:00

GiteaMirror commented

2026-04-29 09:56:11 -05:00

@rick-github commented on GitHub (Feb 27, 2026):

Server logs will aid in debugging.

@rick-github commented on GitHub (Feb 27, 2026): [Server logs](https://docs.ollama.com/troubleshooting) will aid in debugging.

GiteaMirror commented

2026-04-29 09:56:12 -05:00

@FieldMouse-AI commented on GitHub (Feb 27, 2026):

Server logs will aid in debugging.

Hello, @rick-github ,

I observed a similar issue where I lay out the details of this same issue AND I provided a log file there of just this problem. Please have a look, I hope that this is helpful! 🤗

https://github.com/ollama/ollama/issues/14413#issuecomment-3960863214

If you or anybody have any questions, please feel free to ask.

@FieldMouse-AI commented on GitHub (Feb 27, 2026): > [Server logs](https://docs.ollama.com/troubleshooting) will aid in debugging. Hello, @rick-github , I observed a similar issue where I lay out the details of this same issue **AND** I provided a log file there of just this problem. Please have a look, I hope that this is helpful! 🤗 - https://github.com/ollama/ollama/issues/14413#issuecomment-3960863214 If you or anybody have any questions, please feel free to ask.

GiteaMirror commented

2026-04-29 09:56:12 -05:00

@rick-github commented on GitHub (Feb 27, 2026):

@meidaid Wrong place to post that, see #14419. In your case, ollama does not yet support qwen35/qwen35moe models downloaded from HF.

@rick-github commented on GitHub (Feb 27, 2026): @meidaid Wrong place to post that, see #14419. In your case, ollama does not yet support qwen35/qwen35moe models downloaded from HF.

GiteaMirror commented

2026-04-29 09:56:13 -05:00

@Jackallink commented on GitHub (Feb 28, 2026):

Server logs will aid in debugging.

I have added the log context and preliminary analysis diagnostics. 👉 issue #14492

@Jackallink commented on GitHub (Feb 28, 2026): > [Server logs](https://docs.ollama.com/troubleshooting) will aid in debugging. I have added the log context and preliminary analysis diagnostics. 👉 [issue #14492 ](https://github.com/ollama/ollama/issues/14492#issue-4000151762)

GiteaMirror commented

2026-04-29 09:56:13 -05:00

@rick-github commented on GitHub (Feb 28, 2026):

Full log. Example code that reproduces the problem would also be helpful.

@rick-github commented on GitHub (Feb 28, 2026): Full log. Example code that reproduces the problem would also be helpful.

GiteaMirror commented

2026-04-29 09:56:13 -05:00

@rick-github commented on GitHub (Mar 12, 2026):

Possibly fixed in 0.17.6 via #14605. Please upgrade and test.

@rick-github commented on GitHub (Mar 12, 2026): Possibly fixed in [0.17.6](https://github.com/ollama/ollama/releases/tag/v0.17.6) via #14605. Please upgrade and test.

GiteaMirror commented

2026-04-29 09:56:14 -05:00

@hashelq commented on GitHub (Mar 22, 2026):

Possibly fixed in 0.17.6 via #14605. Please upgrade and test.

~ /bin/ollama --version ollama version is 0.18.2
Qwen3.5:9B
RENDERER qwen3.5
PARSER qwen3.5

I still observe broken tool calls within the thinking block.

@hashelq commented on GitHub (Mar 22, 2026): > Possibly fixed in [0.17.6](https://github.com/ollama/ollama/releases/tag/v0.17.6) via [#14605](https://github.com/ollama/ollama/pull/14605). Please upgrade and test. - `~ /bin/ollama --version ollama version is 0.18.2 ` - `Qwen3.5:9B` - RENDERER qwen3.5 - PARSER qwen3.5 I still observe broken tool calls within the thinking block.

GiteaMirror commented

2026-04-29 09:56:14 -05:00

@rick-github commented on GitHub (Mar 22, 2026):

Logs and example code that reproduces the problem would be helpful.

@rick-github commented on GitHub (Mar 22, 2026): Logs and example code that reproduces the problem would be helpful.

GiteaMirror commented

2026-04-29 09:56:15 -05:00

@hashelq commented on GitHub (Mar 22, 2026):

Steps to reproduce (my case)

Open a project in opencode
Select model to ollama qwen3.5
Prompt "analyze this project"
See first tools OK
Next tools show broken XML inside the thinking and the bot stops answering.

Setup:

OLLAMA_KV_CACHE_TYPE=q4_0 OLLAMA_KEEP_ALIVE=-1 OLLAMA_MAX_LOADED_MODELS=1 OLLAMA_NUM_PARALLEL=1 OLLAMA_MAX_QUEUE=1 OLLAMA_FLASH_ATTENTION=1 OLLAMA_DEBUG=3 /usr/local/bin/ollama serve 2> log.txt

FROM ./Qwen3.5-9B-Q8_0.gguf
TEMPLATE {{ .Prompt }}
RENDERER qwen3.5
PARSER qwen3.5
PARAMETER top_p 0.95
PARAMETER presence_penalty 1.5
PARAMETER temperature 1
PARAMETER top_k 20
PARAMETER min_p 0
PARAMETER num_gpu 64
PARAMETER num_ctx 262144

Log:

time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3459 id=3460
time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3460 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3460
time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3460
time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3459
time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3459
time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3459 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.727Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=oom from=[4053]
time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3459
time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3460
time=2026-03-22T20:23:57.727Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=oom
time=2026-03-22T20:23:57.727Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:oom}] state=0 buffer=""
time=2026-03-22T20:23:57.727Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=oom toolCalls=[] done=false
time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3460
time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3460 id=3461
time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3461 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.728Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3461
time=2026-03-22T20:23:57.728Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3461
time=2026-03-22T20:23:57.751Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3460
time=2026-03-22T20:23:57.751Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3460
time=2026-03-22T20:23:57.751Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3460 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.752Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=- from=[12]
time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3460
time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3461
time=2026-03-22T20:23:57.752Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-
time=2026-03-22T20:23:57.752Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-}] state=0 buffer=""
time=2026-03-22T20:23:57.752Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=- toolCalls=[] done=false
time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3461
time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3461 id=3462
time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3462 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3462
time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3462
time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3461
time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3461
time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3461 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.776Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=are from=[532]
time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3461
time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3462
time=2026-03-22T20:23:57.776Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=are
time=2026-03-22T20:23:57.776Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:are}] state=0 buffer=""
time=2026-03-22T20:23:57.776Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=are toolCalls=[] done=false
time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3462
time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3462 id=3463
time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3463 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.777Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3463
time=2026-03-22T20:23:57.777Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3463
time=2026-03-22T20:23:57.800Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3462
time=2026-03-22T20:23:57.800Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3462
time=2026-03-22T20:23:57.800Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3462 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.801Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=-we from=[59269]
time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3462
time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3463
time=2026-03-22T20:23:57.801Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-we
time=2026-03-22T20:23:57.801Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-we}] state=0 buffer=""
time=2026-03-22T20:23:57.801Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=-we toolCalls=[] done=false
time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3463
time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3463 id=3464
time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3464 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3464
time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3464
time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3463
time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3463
time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3463 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.825Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=.ai from=[39046]
time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3463
time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3464
time=2026-03-22T20:23:57.825Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=.ai
time=2026-03-22T20:23:57.825Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:.ai}] state=0 buffer=""
time=2026-03-22T20:23:57.825Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=.ai toolCalls=[] done=false
time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3464
time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3464 id=3465
time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3465 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.826Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3465
time=2026-03-22T20:23:57.826Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3465
time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3464
time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3464
time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3464 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.849Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/index from=[8750]
time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3464
time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3465
time=2026-03-22T20:23:57.849Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/index
time=2026-03-22T20:23:57.849Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/index}] state=0 buffer=""
time=2026-03-22T20:23:57.849Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/index toolCalls=[] done=false
time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3465
time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3465 id=3466
time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3466 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.850Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3466
time=2026-03-22T20:23:57.850Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3466
time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3465
time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3465
time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3465 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.874Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=.html from=[2480]
time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3465
time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3466
time=2026-03-22T20:23:57.874Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=.html
time=2026-03-22T20:23:57.874Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:.html}] state=0 buffer=""
time=2026-03-22T20:23:57.874Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=.html toolCalls=[] done=false
time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3466
time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3466 id=3467
time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3467 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3467
time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3467
time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3466
time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3466
time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3466 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.898Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3466
time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3467
time=2026-03-22T20:23:57.898Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:57.898Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3467
time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3467 id=3468
time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3468 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.899Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3468
time=2026-03-22T20:23:57.899Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3468
time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3467
time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3467
time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3467 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.922Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510]
time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3467
time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3468
time=2026-03-22T20:23:57.923Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</
time=2026-03-22T20:23:57.923Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3468
time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3468 id=3469
time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3469 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3469
time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3469
time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3468
time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3468
time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3468 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.947Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704]
time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3468
time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3469
time=2026-03-22T20:23:57.947Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter
time=2026-03-22T20:23:57.947Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</parameter}]" state=0 buffer=""
time=2026-03-22T20:23:57.947Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</parameter" toolCalls=[] done=false
time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3469
time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3469 id=3470
time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3470 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.948Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3470
time=2026-03-22T20:23:57.948Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3470
time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3469
time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3469
time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3469 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.971Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3469
time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3470
time=2026-03-22T20:23:57.971Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
time=2026-03-22T20:23:57.971Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
time=2026-03-22T20:23:57.971Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3470
time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3470 id=3471
time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3471 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.972Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3471
time=2026-03-22T20:23:57.972Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3471
time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3470
time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3470
time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3470 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:57.996Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3470
time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3471
time=2026-03-22T20:23:57.996Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:57.996Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3471
time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3471 id=3472
time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3472 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:57.997Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3472
time=2026-03-22T20:23:57.997Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3472
time=2026-03-22T20:23:58.020Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3471
time=2026-03-22T20:23:58.020Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3471
time=2026-03-22T20:23:58.020Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3471 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.021Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510]
time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3471
time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3472
time=2026-03-22T20:23:58.021Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</
time=2026-03-22T20:23:58.021Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3472
time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3472 id=3473
time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3473 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3473
time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3473
time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3472
time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3472
time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3472 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.045Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=function from=[1628]
time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3472
time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3473
time=2026-03-22T20:23:58.045Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=function
time=2026-03-22T20:23:58.045Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</function}]" state=0 buffer=""
time=2026-03-22T20:23:58.045Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</function" toolCalls=[] done=false
time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3473
time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3473 id=3474
time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3474 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.046Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3474
time=2026-03-22T20:23:58.046Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3474
time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3473
time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3473
time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3473 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.069Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3473
time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3474
time=2026-03-22T20:23:58.069Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
time=2026-03-22T20:23:58.069Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
time=2026-03-22T20:23:58.069Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3474
time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3474 id=3475
time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3475 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.070Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3475
time=2026-03-22T20:23:58.070Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3475
time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3474
time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3474
time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3474 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.094Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3474
time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3475
time=2026-03-22T20:23:58.094Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:58.094Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3475
time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3475 id=3476
time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3476 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.095Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3476
time=2026-03-22T20:23:58.095Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3476
time=2026-03-22T20:23:58.118Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3475
time=2026-03-22T20:23:58.118Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3475
time=2026-03-22T20:23:58.118Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3475 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.119Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</tool_call> from=[248059]
time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3475
time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3476
time=2026-03-22T20:23:58.119Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</tool_call>
time=2026-03-22T20:23:58.119Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</tool_call>}]" state=0 buffer=""
time=2026-03-22T20:23:58.119Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</tool_call>" toolCalls=[] done=false
time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3476
time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3476 id=3477
time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3477 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3477
time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3477
time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3476
time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3476
time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3476 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.143Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3476
time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3477
time=2026-03-22T20:23:58.143Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:58.143Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3477
time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3477 id=3478
time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3478 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.144Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3478
time=2026-03-22T20:23:58.144Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3478
time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3477
time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3477
time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3477 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.168Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=<tool_call> from=[248058]
time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3477
time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3478
time=2026-03-22T20:23:58.168Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=<tool_call>
time=2026-03-22T20:23:58.168Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<tool_call>}]" state=0 buffer=""
time=2026-03-22T20:23:58.168Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<tool_call>" toolCalls=[] done=false
time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3478
time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3478 id=3479
time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3479 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3479
time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3479
time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3478
time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3478
time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3478 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.192Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3478
time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3479
time=2026-03-22T20:23:58.192Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:58.192Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3479
time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3479 id=3480
time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3480 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.193Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3480
time=2026-03-22T20:23:58.193Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3480
time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3479
time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3479
time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3479 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.217Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=< from=[27]
time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3479
time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3480
time=2026-03-22T20:23:58.217Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=<
time=2026-03-22T20:23:58.217Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3480
time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3480 id=3481
time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3481 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3481
time=2026-03-22T20:23:58.218Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3481
time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3480
time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3480
time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3480 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.241Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=function from=[1628]
time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3480
time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3481
time=2026-03-22T20:23:58.241Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=function
time=2026-03-22T20:23:58.241Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<function}]" state=0 buffer=""
time=2026-03-22T20:23:58.241Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<function" toolCalls=[] done=false
time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3481
time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3481 id=3482
time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3482 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.242Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3482
time=2026-03-22T20:23:58.242Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3482
time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3481
time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3481
time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3481 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.266Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="=b" from=[21402]
time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3481
time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3482
time=2026-03-22T20:23:58.266Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="=b"
time=2026-03-22T20:23:58.266Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:=b}]" state=0 buffer=""
time=2026-03-22T20:23:58.266Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="=b" toolCalls=[] done=false
time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3482
time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3482 id=3483
time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3483 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3483
time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3483
time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3482
time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3482
time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3482 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.290Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=ash from=[956]
time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3482
time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3483
time=2026-03-22T20:23:58.291Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=ash
time=2026-03-22T20:23:58.291Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:ash}] state=0 buffer=""
time=2026-03-22T20:23:58.291Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=ash toolCalls=[] done=false
time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3483
time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3483 id=3484
time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3484 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3484
time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3484
time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3483
time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3483
time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3483 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.315Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3483
time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3484
time=2026-03-22T20:23:58.315Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
time=2026-03-22T20:23:58.315Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
time=2026-03-22T20:23:58.315Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3484
time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3484 id=3485
time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3485 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.316Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3485
time=2026-03-22T20:23:58.316Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3485
time=2026-03-22T20:23:58.339Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3484
time=2026-03-22T20:23:58.339Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3484
time=2026-03-22T20:23:58.339Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3484 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.340Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3484
time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3485
time=2026-03-22T20:23:58.340Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:58.340Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3485
time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3485 id=3486
time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3486 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3486
time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3486
time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3485
time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3485
time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3485 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.364Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=< from=[27]
time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3485
time=2026-03-22T20:23:58.364Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=<
time=2026-03-22T20:23:58.364Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3486
time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3486
time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3486 id=3487
time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3487 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.365Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3487
time=2026-03-22T20:23:58.365Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3487
time=2026-03-22T20:23:58.388Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3486
time=2026-03-22T20:23:58.388Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3486
time=2026-03-22T20:23:58.388Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3486 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.389Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704]
time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3486
time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3487
time=2026-03-22T20:23:58.389Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter
time=2026-03-22T20:23:58.389Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<parameter}]" state=0 buffer=""
time=2026-03-22T20:23:58.389Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<parameter" toolCalls=[] done=false
time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3487
time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3487 id=3488
time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3488 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3488
time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3488
time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3487
time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3487
time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3487 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.413Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="=" from=[28]
time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3487
time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3488
time=2026-03-22T20:23:58.413Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="="
time=2026-03-22T20:23:58.413Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:=}]" state=0 buffer=""
time=2026-03-22T20:23:58.413Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="=" toolCalls=[] done=false
time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3488
time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3488 id=3489
time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3489 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.414Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3489
time=2026-03-22T20:23:58.414Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3489
time=2026-03-22T20:23:58.437Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3488
time=2026-03-22T20:23:58.437Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3488
time=2026-03-22T20:23:58.437Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3488 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.438Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=command from=[5454]
time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3488
time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3489
time=2026-03-22T20:23:58.438Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=command
time=2026-03-22T20:23:58.438Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:command}] state=0 buffer=""
time=2026-03-22T20:23:58.438Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=command toolCalls=[] done=false
time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3489
time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3489 id=3490
time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3490 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3490
time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3490
time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3489
time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3489
time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3489 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.462Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3489
time=2026-03-22T20:23:58.462Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
time=2026-03-22T20:23:58.462Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
time=2026-03-22T20:23:58.462Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3490
time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3490
time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3490 id=3491
time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3491 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.463Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3491
time=2026-03-22T20:23:58.464Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3491
time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3490
time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3490
time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3490 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.487Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3490
time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3491
time=2026-03-22T20:23:58.487Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:58.487Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3491
time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3491 id=3492
time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3492 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.488Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3492
time=2026-03-22T20:23:58.488Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3492
time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3491
time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3491
time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3491 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.512Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=ls from=[4577]
time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3491
time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3492
time=2026-03-22T20:23:58.512Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=ls
time=2026-03-22T20:23:58.512Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\nls}]" state=0 buffer=""
time=2026-03-22T20:23:58.512Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\nls" toolCalls=[] done=false
time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3492
time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3492 id=3493
time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3493 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3493
time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3493
time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3492
time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3492
time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3492 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.536Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" -" from=[471]
time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3492
time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3493
time=2026-03-22T20:23:58.536Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" -"
time=2026-03-22T20:23:58.536Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: -}]" state=0 buffer=""
time=2026-03-22T20:23:58.536Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" -" toolCalls=[] done=false
time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3493
time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3493 id=3494
time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3494 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.537Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3494
time=2026-03-22T20:23:58.537Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3494
time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3493
time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3493
time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3493 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.561Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=la from=[4120]
time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3493
time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3494
time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3494
time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3494 id=3495
time=2026-03-22T20:23:58.561Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=la
time=2026-03-22T20:23:58.561Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:la}] state=0 buffer=""
time=2026-03-22T20:23:58.561Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=la toolCalls=[] done=false
time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3495 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3495
time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3495
time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3494
time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3494
time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3494 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.585Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" /" from=[593]
time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3494
time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3495
time=2026-03-22T20:23:58.585Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" /"
time=2026-03-22T20:23:58.585Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: /}]" state=0 buffer=""
time=2026-03-22T20:23:58.585Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" /" toolCalls=[] done=false
time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3495
time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3495 id=3496
time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3496 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.586Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3496
time=2026-03-22T20:23:58.586Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3496
time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3495
time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3495
time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3495 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.610Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=home from=[4955]
time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3495
time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3496
time=2026-03-22T20:23:58.610Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=home
time=2026-03-22T20:23:58.610Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:home}] state=0 buffer=""
time=2026-03-22T20:23:58.610Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=home toolCalls=[] done=false
time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3496
time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3496 id=3497
time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3497 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3497
time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3497
time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3496
time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3496
time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3496 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.634Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/ne from=[86236]
time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3496
time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3497
time=2026-03-22T20:23:58.634Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/ne
time=2026-03-22T20:23:58.634Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/ne}] state=0 buffer=""
time=2026-03-22T20:23:58.634Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/ne toolCalls=[] done=false
time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3497
time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3497 id=3498
time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3498 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.635Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3498
time=2026-03-22T20:23:58.635Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3498
time=2026-03-22T20:23:58.658Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3497
time=2026-03-22T20:23:58.658Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3497
time=2026-03-22T20:23:58.658Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3497 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.659Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=ko from=[9048]
time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3497
time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3498
time=2026-03-22T20:23:58.659Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=ko
time=2026-03-22T20:23:58.659Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:ko}] state=0 buffer=""
time=2026-03-22T20:23:58.659Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=ko toolCalls=[] done=false
time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3498
time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3498 id=3499
time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3499 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3499
time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3499
time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3498
time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3498
time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3498 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.683Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/how from=[48637]
time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3498
time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3499
time=2026-03-22T20:23:58.683Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/how
time=2026-03-22T20:23:58.683Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/how}] state=0 buffer=""
time=2026-03-22T20:23:58.683Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/how toolCalls=[] done=false
time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3499
time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3499 id=3500
time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3500 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.684Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3500
time=2026-03-22T20:23:58.684Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3500
time=2026-03-22T20:23:58.707Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3499
time=2026-03-22T20:23:58.707Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3499
time=2026-03-22T20:23:58.707Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3499 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.708Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=-d from=[1676]
time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3499
time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3500
time=2026-03-22T20:23:58.708Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-d
time=2026-03-22T20:23:58.708Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-d}] state=0 buffer=""
time=2026-03-22T20:23:58.708Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=-d toolCalls=[] done=false
time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3500
time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3500 id=3501
time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3501 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3501
time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3501
time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3500
time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3500
time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3500 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.732Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=oom from=[4053]
time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3500
time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3501
time=2026-03-22T20:23:58.732Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=oom
time=2026-03-22T20:23:58.732Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:oom}] state=0 buffer=""
time=2026-03-22T20:23:58.732Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=oom toolCalls=[] done=false
time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3501
time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3501 id=3502
time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3502 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.733Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3502
time=2026-03-22T20:23:58.733Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3502
time=2026-03-22T20:23:58.756Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3501
time=2026-03-22T20:23:58.756Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3501
time=2026-03-22T20:23:58.756Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3501 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.757Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=- from=[12]
time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3501
time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3502
time=2026-03-22T20:23:58.757Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-
time=2026-03-22T20:23:58.757Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-}] state=0 buffer=""
time=2026-03-22T20:23:58.757Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=- toolCalls=[] done=false
time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3502
time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3502 id=3503
time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3503 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3503
time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3503
time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3502
time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3502
time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3502 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.781Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=are from=[532]
time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3502
time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3503
time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3503
time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3503 id=3504
time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3504 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.781Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=are
time=2026-03-22T20:23:58.781Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:are}] state=0 buffer=""
time=2026-03-22T20:23:58.781Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=are toolCalls=[] done=false
time=2026-03-22T20:23:58.782Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3504
time=2026-03-22T20:23:58.782Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3504
time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3503
time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3503
time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3503 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.805Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=-we from=[59269]
time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3503
time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3504
time=2026-03-22T20:23:58.806Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-we
time=2026-03-22T20:23:58.806Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-we}] state=0 buffer=""
time=2026-03-22T20:23:58.806Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=-we toolCalls=[] done=false
time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3504
time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3504 id=3505
time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3505 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3505
time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3505
time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3504
time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3504
time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3504 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.830Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=.ai from=[39046]
time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3504
time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3505
time=2026-03-22T20:23:58.830Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=.ai
time=2026-03-22T20:23:58.830Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:.ai}] state=0 buffer=""
time=2026-03-22T20:23:58.830Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=.ai toolCalls=[] done=false
time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3505
time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3505 id=3506
time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3506 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3506
time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3506
time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3505
time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3505
time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3505 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.854Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/src from=[13050]
time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3505
time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3506
time=2026-03-22T20:23:58.854Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/src
time=2026-03-22T20:23:58.854Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/src}] state=0 buffer=""
time=2026-03-22T20:23:58.854Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/src toolCalls=[] done=false
time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3506
time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3506 id=3507
time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3507 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.855Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3507
time=2026-03-22T20:23:58.855Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3507
time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3506
time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3506
time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3506 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.878Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3506
time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3507
time=2026-03-22T20:23:58.878Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:58.879Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3507
time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3507 id=3508
time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3508 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.879Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3508
time=2026-03-22T20:23:58.879Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3508
time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3507
time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3507
time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3507 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.903Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510]
time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3507
time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3508
time=2026-03-22T20:23:58.903Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</
time=2026-03-22T20:23:58.903Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3508
time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3508 id=3509
time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3509 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3509
time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3509
time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3508
time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3508
time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3508 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.927Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704]
time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3508
time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3509
time=2026-03-22T20:23:58.928Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter
time=2026-03-22T20:23:58.928Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</parameter}]" state=0 buffer=""
time=2026-03-22T20:23:58.928Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</parameter" toolCalls=[] done=false
time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3509
time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3509 id=3510
time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3510 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3510
time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3510
time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3509
time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3509
time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3509 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.952Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3509
time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3510
time=2026-03-22T20:23:58.952Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
time=2026-03-22T20:23:58.952Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
time=2026-03-22T20:23:58.952Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3510
time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3510 id=3511
time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3511 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.953Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3511
time=2026-03-22T20:23:58.953Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3511
time=2026-03-22T20:23:58.976Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3510
time=2026-03-22T20:23:58.976Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3510
time=2026-03-22T20:23:58.976Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3510 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:58.977Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3510
time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3511
time=2026-03-22T20:23:58.977Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:58.977Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3511
time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3511 id=3512
time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3512 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3512
time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3512
time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3511
time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3511
time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3511 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.001Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=< from=[27]
time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3511
time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3512
time=2026-03-22T20:23:59.001Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=<
time=2026-03-22T20:23:59.001Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3512
time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3512 id=3513
time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3513 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.002Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3513
time=2026-03-22T20:23:59.002Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3513
time=2026-03-22T20:23:59.025Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3512
time=2026-03-22T20:23:59.025Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3512
time=2026-03-22T20:23:59.025Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3512 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.026Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704]
time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3512
time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3513
time=2026-03-22T20:23:59.026Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter
time=2026-03-22T20:23:59.026Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<parameter}]" state=0 buffer=""
time=2026-03-22T20:23:59.026Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<parameter" toolCalls=[] done=false
time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3513
time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3513 id=3514
time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3514 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3514
time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3514
time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3513
time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3513
time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3513 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.050Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="=" from=[28]
time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3513
time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3514
time=2026-03-22T20:23:59.050Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="="
time=2026-03-22T20:23:59.050Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:=}]" state=0 buffer=""
time=2026-03-22T20:23:59.050Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="=" toolCalls=[] done=false
time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3514
time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3514 id=3515
time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3515 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.051Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3515
time=2026-03-22T20:23:59.051Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3515
time=2026-03-22T20:23:59.074Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3514
time=2026-03-22T20:23:59.074Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3514
time=2026-03-22T20:23:59.074Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3514 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.075Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=description from=[4532]
time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3514
time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3515
time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3515
time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3515 id=3516
time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3516 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.075Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=description
time=2026-03-22T20:23:59.075Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:description}] state=0 buffer=""
time=2026-03-22T20:23:59.075Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=description toolCalls=[] done=false
time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3516
time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3516
time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3515
time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3515
time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3515 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.099Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3515
time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3516
time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3516
time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3516 id=3517
time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3517 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.099Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
time=2026-03-22T20:23:59.099Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
time=2026-03-22T20:23:59.099Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
time=2026-03-22T20:23:59.100Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3517
time=2026-03-22T20:23:59.100Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3517
time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3516
time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3516
time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3516 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.124Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3516
time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3517
time=2026-03-22T20:23:59.124Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:59.124Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3517
time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3517 id=3518
time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3518 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.125Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3518
time=2026-03-22T20:23:59.125Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3518
time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3517
time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3517
time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3517 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.148Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=List from=[826]
time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3517
time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3518
time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3518
time=2026-03-22T20:23:59.148Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=List
time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3518 id=3519
time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3519 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.148Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\nList}]" state=0 buffer=""
time=2026-03-22T20:23:59.148Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\nList" toolCalls=[] done=false
time=2026-03-22T20:23:59.149Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3519
time=2026-03-22T20:23:59.149Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3519
time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3518
time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3518
time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3518 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.173Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" src" from=[2212]
time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3518
time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3519
time=2026-03-22T20:23:59.173Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" src"
time=2026-03-22T20:23:59.173Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: src}]" state=0 buffer=""
time=2026-03-22T20:23:59.173Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" src" toolCalls=[] done=false
time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3519
time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3519 id=3520
time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3520 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3520
time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3520
time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3519
time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3519
time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3519 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.197Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" directory" from=[6025]
time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3519
time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3520
time=2026-03-22T20:23:59.197Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" directory"
time=2026-03-22T20:23:59.198Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: directory}]" state=0 buffer=""
time=2026-03-22T20:23:59.198Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" directory" toolCalls=[] done=false
time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3520
time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3520 id=3521
time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3521 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.198Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3521
time=2026-03-22T20:23:59.198Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3521
time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3520
time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3520
time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3520 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.222Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3520
time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3521
time=2026-03-22T20:23:59.222Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:59.222Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3521
time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3521 id=3522
time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3522 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3522
time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3522
time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3521
time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3521
time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3521 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.246Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510]
time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3521
time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3522
time=2026-03-22T20:23:59.246Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</
time=2026-03-22T20:23:59.246Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3522
time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3522 id=3523
time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3523 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.247Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3523
time=2026-03-22T20:23:59.247Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3523
time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3522
time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3522
time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3522 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.271Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704]
time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3522
time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3523
time=2026-03-22T20:23:59.271Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter
time=2026-03-22T20:23:59.271Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</parameter}]" state=0 buffer=""
time=2026-03-22T20:23:59.271Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</parameter" toolCalls=[] done=false
time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3523
time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3523 id=3524
time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3524 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.272Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3524
time=2026-03-22T20:23:59.272Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3524
time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3523
time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3523
time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3523 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.295Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3523
time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3524
time=2026-03-22T20:23:59.296Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
time=2026-03-22T20:23:59.296Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
time=2026-03-22T20:23:59.296Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3524
time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3524 id=3525
time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3525 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3525
time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3525
time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3524
time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3524
time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3524 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.320Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3524
time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3525
time=2026-03-22T20:23:59.320Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:59.320Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3525
time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3525 id=3526
time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3526 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.321Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3526
time=2026-03-22T20:23:59.321Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3526
time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3525
time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3525
time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3525 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.345Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510]
time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3525
time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3526
time=2026-03-22T20:23:59.345Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</
time=2026-03-22T20:23:59.345Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3526
time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3526 id=3527
time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3527 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3527
time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3527
time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3526
time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3526
time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3526 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.369Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=function from=[1628]
time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3526
time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3527
time=2026-03-22T20:23:59.369Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=function
time=2026-03-22T20:23:59.369Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</function}]" state=0 buffer=""
time=2026-03-22T20:23:59.369Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</function" toolCalls=[] done=false
time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3527
time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3527 id=3528
time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3528 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.370Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3528
time=2026-03-22T20:23:59.370Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3528
time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3527
time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3527
time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3527 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.394Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3527
time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3528
time=2026-03-22T20:23:59.394Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
time=2026-03-22T20:23:59.394Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
time=2026-03-22T20:23:59.394Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3528
time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3528 id=3529
time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3529 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.395Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3529
time=2026-03-22T20:23:59.395Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3529
time=2026-03-22T20:23:59.418Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3528
time=2026-03-22T20:23:59.418Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3528
time=2026-03-22T20:23:59.418Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3528 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.419Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3528
time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3529
time=2026-03-22T20:23:59.419Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
time=2026-03-22T20:23:59.419Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3529
time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3529 id=3530
time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3530 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3530
time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3530
time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3529
time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3529
time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3529 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.443Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</tool_call> from=[248059]
time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3529
time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3530
time=2026-03-22T20:23:59.443Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</tool_call>
time=2026-03-22T20:23:59.443Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</tool_call>}]" state=0 buffer=""
time=2026-03-22T20:23:59.443Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</tool_call>" toolCalls=[] done=false
time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3530
time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3530 id=3531
time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3531 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
time=2026-03-22T20:23:59.444Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3531
time=2026-03-22T20:23:59.444Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3531
time=2026-03-22T20:23:59.467Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3530
time=2026-03-22T20:23:59.467Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3530
time=2026-03-22T20:23:59.467Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3530 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:772 msg="computeBatch: EOS" batchID=3530 seqIdx=0
time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3530
time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3531
time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3531
time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3531 id=3532
time=2026-03-22T20:23:59.468Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=""
time=2026-03-22T20:23:59.468Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="" toolCalls=[] done=true
time=2026-03-22T20:23:59.468Z level=DEBUG source=sched.go:404 msg="context for request finished" runner.name=registry.ollama.ai/library/Qwen3.5-9B-Q8_0:latest runner.inference="[{ID:GPU-7864033d27e41cb9 Library:ROCm}]" runner.size="14.2 GiB" runner.vram="14.2 GiB" runner.parallel=1 runner.pid=1139644 runner.model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4 runner.num_ctx=262144
time=2026-03-22T20:23:59.468Z level=DEBUG source=sched.go:309 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/Qwen3.5-9B-Q8_0:latest runner.inference="[{ID:GPU-7864033d27e41cb9 Library:ROCm}]" runner.size="14.2 GiB" runner.vram="14.2 GiB" runner.parallel=1 runner.pid=1139644 runner.model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4 runner.num_ctx=262144 duration=2562047h47m16.854775807s
time=2026-03-22T20:23:59.468Z level=DEBUG source=sched.go:327 msg="after processing request finished event" runner.name=registry.ollama.ai/library/Qwen3.5-9B-Q8_0:latest runner.inference="[{ID:GPU-7864033d27e41cb9 Library:ROCm}]" runner.size="14.2 GiB" runner.vram="14.2 GiB" runner.parallel=1 runner.pid=1139644 runner.model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4 runner.num_ctx=262144 refCount=0
time=2026-03-22T20:23:59.492Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3531
time=2026-03-22T20:23:59.492Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3531
time=2026-03-22T20:23:59.492Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3531
time=2026-03-22T20:24:00.255Z level=DEBUG source=sched.go:908 msg="shutting down runner" model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4
time=2026-03-22T20:24:00.255Z level=DEBUG source=server.go:1830 msg="stopping llama server" pid=1139644
time=2026-03-22T20:24:00.255Z level=DEBUG source=server.go:1836 msg="waiting for llama server to exit" pid=1139644
time=2026-03-22T20:24:00.255Z level=DEBUG source=sched.go:287 msg="shutting down scheduler completed loop"
time=2026-03-22T20:24:00.255Z level=DEBUG source=sched.go:161 msg="shutting down scheduler pending loop"
time=2026-03-22T20:24:00.374Z level=ERROR source=server.go:303 msg="llama runner terminated" error="signal: interrupt"
time=2026-03-22T20:24:00.374Z level=DEBUG source=server.go:1840 msg="llama server stopped" pid=1139644

HW:

Linux AMD ROCm

@hashelq commented on GitHub (Mar 22, 2026): Steps to reproduce (my case) - Open a project in opencode - Select model to ollama qwen3.5 - Prompt "analyze this project" - See first tools OK - Next tools show broken XML inside the thinking and the bot stops answering. Setup: `OLLAMA_KV_CACHE_TYPE=q4_0 OLLAMA_KEEP_ALIVE=-1 OLLAMA_MAX_LOADED_MODELS=1 OLLAMA_NUM_PARALLEL=1 OLLAMA_MAX_QUEUE=1 OLLAMA_FLASH_ATTENTION=1 OLLAMA_DEBUG=3 /usr/local/bin/ollama serve 2> log.txt` ``` FROM ./Qwen3.5-9B-Q8_0.gguf TEMPLATE {{ .Prompt }} RENDERER qwen3.5 PARSER qwen3.5 PARAMETER top_p 0.95 PARAMETER presence_penalty 1.5 PARAMETER temperature 1 PARAMETER top_k 20 PARAMETER min_p 0 PARAMETER num_gpu 64 PARAMETER num_ctx 262144 ``` Log: <details> ``` time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3459 id=3460 time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3460 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3460 time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3460 time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3459 time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3459 time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3459 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.727Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=oom from=[4053] time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3459 time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3460 time=2026-03-22T20:23:57.727Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=oom time=2026-03-22T20:23:57.727Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:oom}] state=0 buffer="" time=2026-03-22T20:23:57.727Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=oom toolCalls=[] done=false time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3460 time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3460 id=3461 time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3461 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.728Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3461 time=2026-03-22T20:23:57.728Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3461 time=2026-03-22T20:23:57.751Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3460 time=2026-03-22T20:23:57.751Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3460 time=2026-03-22T20:23:57.751Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3460 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.752Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=- from=[12] time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3460 time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3461 time=2026-03-22T20:23:57.752Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=- time=2026-03-22T20:23:57.752Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-}] state=0 buffer="" time=2026-03-22T20:23:57.752Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=- toolCalls=[] done=false time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3461 time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3461 id=3462 time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3462 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3462 time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3462 time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3461 time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3461 time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3461 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.776Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=are from=[532] time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3461 time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3462 time=2026-03-22T20:23:57.776Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=are time=2026-03-22T20:23:57.776Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:are}] state=0 buffer="" time=2026-03-22T20:23:57.776Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=are toolCalls=[] done=false time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3462 time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3462 id=3463 time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3463 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.777Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3463 time=2026-03-22T20:23:57.777Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3463 time=2026-03-22T20:23:57.800Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3462 time=2026-03-22T20:23:57.800Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3462 time=2026-03-22T20:23:57.800Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3462 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.801Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=-we from=[59269] time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3462 time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3463 time=2026-03-22T20:23:57.801Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-we time=2026-03-22T20:23:57.801Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-we}] state=0 buffer="" time=2026-03-22T20:23:57.801Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=-we toolCalls=[] done=false time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3463 time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3463 id=3464 time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3464 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3464 time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3464 time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3463 time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3463 time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3463 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.825Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=.ai from=[39046] time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3463 time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3464 time=2026-03-22T20:23:57.825Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=.ai time=2026-03-22T20:23:57.825Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:.ai}] state=0 buffer="" time=2026-03-22T20:23:57.825Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=.ai toolCalls=[] done=false time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3464 time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3464 id=3465 time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3465 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.826Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3465 time=2026-03-22T20:23:57.826Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3465 time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3464 time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3464 time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3464 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.849Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/index from=[8750] time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3464 time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3465 time=2026-03-22T20:23:57.849Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/index time=2026-03-22T20:23:57.849Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/index}] state=0 buffer="" time=2026-03-22T20:23:57.849Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/index toolCalls=[] done=false time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3465 time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3465 id=3466 time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3466 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.850Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3466 time=2026-03-22T20:23:57.850Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3466 time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3465 time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3465 time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3465 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.874Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=.html from=[2480] time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3465 time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3466 time=2026-03-22T20:23:57.874Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=.html time=2026-03-22T20:23:57.874Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:.html}] state=0 buffer="" time=2026-03-22T20:23:57.874Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=.html toolCalls=[] done=false time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3466 time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3466 id=3467 time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3467 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3467 time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3467 time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3466 time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3466 time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3466 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.898Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3466 time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3467 time=2026-03-22T20:23:57.898Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:57.898Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3467 time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3467 id=3468 time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3468 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.899Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3468 time=2026-03-22T20:23:57.899Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3468 time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3467 time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3467 time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3467 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.922Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510] time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3467 time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3468 time=2026-03-22T20:23:57.923Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</ time=2026-03-22T20:23:57.923Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3468 time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3468 id=3469 time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3469 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3469 time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3469 time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3468 time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3468 time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3468 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.947Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704] time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3468 time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3469 time=2026-03-22T20:23:57.947Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter time=2026-03-22T20:23:57.947Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</parameter}]" state=0 buffer="" time=2026-03-22T20:23:57.947Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</parameter" toolCalls=[] done=false time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3469 time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3469 id=3470 time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3470 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.948Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3470 time=2026-03-22T20:23:57.948Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3470 time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3469 time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3469 time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3469 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.971Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29] time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3469 time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3470 time=2026-03-22T20:23:57.971Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=> time=2026-03-22T20:23:57.971Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer="" time=2026-03-22T20:23:57.971Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3470 time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3470 id=3471 time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3471 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.972Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3471 time=2026-03-22T20:23:57.972Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3471 time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3470 time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3470 time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3470 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:57.996Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3470 time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3471 time=2026-03-22T20:23:57.996Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:57.996Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3471 time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3471 id=3472 time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3472 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:57.997Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3472 time=2026-03-22T20:23:57.997Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3472 time=2026-03-22T20:23:58.020Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3471 time=2026-03-22T20:23:58.020Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3471 time=2026-03-22T20:23:58.020Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3471 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.021Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510] time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3471 time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3472 time=2026-03-22T20:23:58.021Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</ time=2026-03-22T20:23:58.021Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3472 time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3472 id=3473 time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3473 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3473 time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3473 time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3472 time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3472 time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3472 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.045Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=function from=[1628] time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3472 time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3473 time=2026-03-22T20:23:58.045Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=function time=2026-03-22T20:23:58.045Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</function}]" state=0 buffer="" time=2026-03-22T20:23:58.045Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</function" toolCalls=[] done=false time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3473 time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3473 id=3474 time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3474 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.046Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3474 time=2026-03-22T20:23:58.046Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3474 time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3473 time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3473 time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3473 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.069Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29] time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3473 time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3474 time=2026-03-22T20:23:58.069Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=> time=2026-03-22T20:23:58.069Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer="" time=2026-03-22T20:23:58.069Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3474 time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3474 id=3475 time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3475 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.070Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3475 time=2026-03-22T20:23:58.070Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3475 time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3474 time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3474 time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3474 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.094Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3474 time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3475 time=2026-03-22T20:23:58.094Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:58.094Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3475 time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3475 id=3476 time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3476 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.095Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3476 time=2026-03-22T20:23:58.095Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3476 time=2026-03-22T20:23:58.118Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3475 time=2026-03-22T20:23:58.118Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3475 time=2026-03-22T20:23:58.118Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3475 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.119Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</tool_call> from=[248059] time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3475 time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3476 time=2026-03-22T20:23:58.119Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</tool_call> time=2026-03-22T20:23:58.119Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</tool_call>}]" state=0 buffer="" time=2026-03-22T20:23:58.119Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</tool_call>" toolCalls=[] done=false time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3476 time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3476 id=3477 time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3477 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3477 time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3477 time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3476 time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3476 time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3476 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.143Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3476 time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3477 time=2026-03-22T20:23:58.143Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:58.143Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3477 time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3477 id=3478 time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3478 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.144Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3478 time=2026-03-22T20:23:58.144Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3478 time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3477 time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3477 time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3477 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.168Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=<tool_call> from=[248058] time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3477 time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3478 time=2026-03-22T20:23:58.168Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=<tool_call> time=2026-03-22T20:23:58.168Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<tool_call>}]" state=0 buffer="" time=2026-03-22T20:23:58.168Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<tool_call>" toolCalls=[] done=false time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3478 time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3478 id=3479 time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3479 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3479 time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3479 time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3478 time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3478 time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3478 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.192Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3478 time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3479 time=2026-03-22T20:23:58.192Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:58.192Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3479 time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3479 id=3480 time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3480 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.193Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3480 time=2026-03-22T20:23:58.193Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3480 time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3479 time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3479 time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3479 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.217Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=< from=[27] time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3479 time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3480 time=2026-03-22T20:23:58.217Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=< time=2026-03-22T20:23:58.217Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3480 time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3480 id=3481 time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3481 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3481 time=2026-03-22T20:23:58.218Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3481 time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3480 time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3480 time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3480 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.241Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=function from=[1628] time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3480 time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3481 time=2026-03-22T20:23:58.241Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=function time=2026-03-22T20:23:58.241Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<function}]" state=0 buffer="" time=2026-03-22T20:23:58.241Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<function" toolCalls=[] done=false time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3481 time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3481 id=3482 time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3482 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.242Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3482 time=2026-03-22T20:23:58.242Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3482 time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3481 time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3481 time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3481 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.266Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="=b" from=[21402] time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3481 time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3482 time=2026-03-22T20:23:58.266Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="=b" time=2026-03-22T20:23:58.266Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:=b}]" state=0 buffer="" time=2026-03-22T20:23:58.266Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="=b" toolCalls=[] done=false time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3482 time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3482 id=3483 time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3483 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3483 time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3483 time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3482 time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3482 time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3482 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.290Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=ash from=[956] time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3482 time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3483 time=2026-03-22T20:23:58.291Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=ash time=2026-03-22T20:23:58.291Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:ash}] state=0 buffer="" time=2026-03-22T20:23:58.291Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=ash toolCalls=[] done=false time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3483 time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3483 id=3484 time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3484 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3484 time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3484 time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3483 time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3483 time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3483 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.315Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29] time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3483 time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3484 time=2026-03-22T20:23:58.315Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=> time=2026-03-22T20:23:58.315Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer="" time=2026-03-22T20:23:58.315Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3484 time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3484 id=3485 time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3485 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.316Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3485 time=2026-03-22T20:23:58.316Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3485 time=2026-03-22T20:23:58.339Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3484 time=2026-03-22T20:23:58.339Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3484 time=2026-03-22T20:23:58.339Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3484 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.340Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3484 time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3485 time=2026-03-22T20:23:58.340Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:58.340Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3485 time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3485 id=3486 time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3486 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3486 time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3486 time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3485 time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3485 time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3485 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.364Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=< from=[27] time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3485 time=2026-03-22T20:23:58.364Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=< time=2026-03-22T20:23:58.364Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3486 time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3486 time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3486 id=3487 time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3487 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.365Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3487 time=2026-03-22T20:23:58.365Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3487 time=2026-03-22T20:23:58.388Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3486 time=2026-03-22T20:23:58.388Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3486 time=2026-03-22T20:23:58.388Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3486 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.389Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704] time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3486 time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3487 time=2026-03-22T20:23:58.389Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter time=2026-03-22T20:23:58.389Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<parameter}]" state=0 buffer="" time=2026-03-22T20:23:58.389Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<parameter" toolCalls=[] done=false time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3487 time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3487 id=3488 time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3488 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3488 time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3488 time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3487 time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3487 time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3487 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.413Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="=" from=[28] time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3487 time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3488 time=2026-03-22T20:23:58.413Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="=" time=2026-03-22T20:23:58.413Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:=}]" state=0 buffer="" time=2026-03-22T20:23:58.413Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="=" toolCalls=[] done=false time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3488 time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3488 id=3489 time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3489 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.414Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3489 time=2026-03-22T20:23:58.414Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3489 time=2026-03-22T20:23:58.437Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3488 time=2026-03-22T20:23:58.437Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3488 time=2026-03-22T20:23:58.437Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3488 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.438Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=command from=[5454] time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3488 time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3489 time=2026-03-22T20:23:58.438Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=command time=2026-03-22T20:23:58.438Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:command}] state=0 buffer="" time=2026-03-22T20:23:58.438Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=command toolCalls=[] done=false time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3489 time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3489 id=3490 time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3490 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3490 time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3490 time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3489 time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3489 time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3489 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.462Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29] time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3489 time=2026-03-22T20:23:58.462Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=> time=2026-03-22T20:23:58.462Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer="" time=2026-03-22T20:23:58.462Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3490 time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3490 time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3490 id=3491 time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3491 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.463Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3491 time=2026-03-22T20:23:58.464Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3491 time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3490 time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3490 time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3490 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.487Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3490 time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3491 time=2026-03-22T20:23:58.487Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:58.487Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3491 time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3491 id=3492 time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3492 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.488Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3492 time=2026-03-22T20:23:58.488Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3492 time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3491 time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3491 time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3491 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.512Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=ls from=[4577] time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3491 time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3492 time=2026-03-22T20:23:58.512Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=ls time=2026-03-22T20:23:58.512Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\nls}]" state=0 buffer="" time=2026-03-22T20:23:58.512Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\nls" toolCalls=[] done=false time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3492 time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3492 id=3493 time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3493 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3493 time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3493 time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3492 time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3492 time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3492 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.536Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" -" from=[471] time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3492 time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3493 time=2026-03-22T20:23:58.536Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" -" time=2026-03-22T20:23:58.536Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: -}]" state=0 buffer="" time=2026-03-22T20:23:58.536Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" -" toolCalls=[] done=false time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3493 time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3493 id=3494 time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3494 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.537Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3494 time=2026-03-22T20:23:58.537Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3494 time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3493 time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3493 time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3493 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.561Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=la from=[4120] time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3493 time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3494 time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3494 time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3494 id=3495 time=2026-03-22T20:23:58.561Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=la time=2026-03-22T20:23:58.561Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:la}] state=0 buffer="" time=2026-03-22T20:23:58.561Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=la toolCalls=[] done=false time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3495 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3495 time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3495 time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3494 time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3494 time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3494 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.585Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" /" from=[593] time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3494 time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3495 time=2026-03-22T20:23:58.585Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" /" time=2026-03-22T20:23:58.585Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: /}]" state=0 buffer="" time=2026-03-22T20:23:58.585Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" /" toolCalls=[] done=false time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3495 time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3495 id=3496 time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3496 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.586Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3496 time=2026-03-22T20:23:58.586Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3496 time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3495 time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3495 time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3495 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.610Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=home from=[4955] time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3495 time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3496 time=2026-03-22T20:23:58.610Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=home time=2026-03-22T20:23:58.610Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:home}] state=0 buffer="" time=2026-03-22T20:23:58.610Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=home toolCalls=[] done=false time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3496 time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3496 id=3497 time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3497 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3497 time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3497 time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3496 time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3496 time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3496 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.634Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/ne from=[86236] time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3496 time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3497 time=2026-03-22T20:23:58.634Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/ne time=2026-03-22T20:23:58.634Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/ne}] state=0 buffer="" time=2026-03-22T20:23:58.634Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/ne toolCalls=[] done=false time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3497 time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3497 id=3498 time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3498 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.635Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3498 time=2026-03-22T20:23:58.635Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3498 time=2026-03-22T20:23:58.658Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3497 time=2026-03-22T20:23:58.658Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3497 time=2026-03-22T20:23:58.658Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3497 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.659Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=ko from=[9048] time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3497 time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3498 time=2026-03-22T20:23:58.659Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=ko time=2026-03-22T20:23:58.659Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:ko}] state=0 buffer="" time=2026-03-22T20:23:58.659Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=ko toolCalls=[] done=false time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3498 time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3498 id=3499 time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3499 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3499 time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3499 time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3498 time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3498 time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3498 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.683Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/how from=[48637] time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3498 time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3499 time=2026-03-22T20:23:58.683Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/how time=2026-03-22T20:23:58.683Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/how}] state=0 buffer="" time=2026-03-22T20:23:58.683Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/how toolCalls=[] done=false time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3499 time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3499 id=3500 time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3500 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.684Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3500 time=2026-03-22T20:23:58.684Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3500 time=2026-03-22T20:23:58.707Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3499 time=2026-03-22T20:23:58.707Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3499 time=2026-03-22T20:23:58.707Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3499 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.708Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=-d from=[1676] time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3499 time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3500 time=2026-03-22T20:23:58.708Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-d time=2026-03-22T20:23:58.708Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-d}] state=0 buffer="" time=2026-03-22T20:23:58.708Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=-d toolCalls=[] done=false time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3500 time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3500 id=3501 time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3501 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3501 time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3501 time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3500 time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3500 time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3500 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.732Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=oom from=[4053] time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3500 time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3501 time=2026-03-22T20:23:58.732Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=oom time=2026-03-22T20:23:58.732Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:oom}] state=0 buffer="" time=2026-03-22T20:23:58.732Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=oom toolCalls=[] done=false time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3501 time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3501 id=3502 time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3502 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.733Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3502 time=2026-03-22T20:23:58.733Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3502 time=2026-03-22T20:23:58.756Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3501 time=2026-03-22T20:23:58.756Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3501 time=2026-03-22T20:23:58.756Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3501 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.757Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=- from=[12] time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3501 time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3502 time=2026-03-22T20:23:58.757Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=- time=2026-03-22T20:23:58.757Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-}] state=0 buffer="" time=2026-03-22T20:23:58.757Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=- toolCalls=[] done=false time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3502 time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3502 id=3503 time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3503 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3503 time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3503 time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3502 time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3502 time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3502 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.781Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=are from=[532] time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3502 time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3503 time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3503 time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3503 id=3504 time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3504 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.781Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=are time=2026-03-22T20:23:58.781Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:are}] state=0 buffer="" time=2026-03-22T20:23:58.781Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=are toolCalls=[] done=false time=2026-03-22T20:23:58.782Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3504 time=2026-03-22T20:23:58.782Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3504 time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3503 time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3503 time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3503 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.805Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=-we from=[59269] time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3503 time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3504 time=2026-03-22T20:23:58.806Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-we time=2026-03-22T20:23:58.806Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-we}] state=0 buffer="" time=2026-03-22T20:23:58.806Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=-we toolCalls=[] done=false time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3504 time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3504 id=3505 time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3505 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3505 time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3505 time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3504 time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3504 time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3504 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.830Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=.ai from=[39046] time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3504 time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3505 time=2026-03-22T20:23:58.830Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=.ai time=2026-03-22T20:23:58.830Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:.ai}] state=0 buffer="" time=2026-03-22T20:23:58.830Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=.ai toolCalls=[] done=false time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3505 time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3505 id=3506 time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3506 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3506 time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3506 time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3505 time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3505 time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3505 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.854Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/src from=[13050] time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3505 time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3506 time=2026-03-22T20:23:58.854Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/src time=2026-03-22T20:23:58.854Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/src}] state=0 buffer="" time=2026-03-22T20:23:58.854Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/src toolCalls=[] done=false time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3506 time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3506 id=3507 time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3507 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.855Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3507 time=2026-03-22T20:23:58.855Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3507 time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3506 time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3506 time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3506 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.878Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3506 time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3507 time=2026-03-22T20:23:58.878Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:58.879Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3507 time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3507 id=3508 time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3508 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.879Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3508 time=2026-03-22T20:23:58.879Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3508 time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3507 time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3507 time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3507 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.903Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510] time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3507 time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3508 time=2026-03-22T20:23:58.903Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</ time=2026-03-22T20:23:58.903Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3508 time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3508 id=3509 time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3509 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3509 time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3509 time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3508 time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3508 time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3508 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.927Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704] time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3508 time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3509 time=2026-03-22T20:23:58.928Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter time=2026-03-22T20:23:58.928Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</parameter}]" state=0 buffer="" time=2026-03-22T20:23:58.928Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</parameter" toolCalls=[] done=false time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3509 time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3509 id=3510 time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3510 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3510 time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3510 time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3509 time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3509 time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3509 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.952Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29] time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3509 time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3510 time=2026-03-22T20:23:58.952Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=> time=2026-03-22T20:23:58.952Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer="" time=2026-03-22T20:23:58.952Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3510 time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3510 id=3511 time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3511 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.953Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3511 time=2026-03-22T20:23:58.953Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3511 time=2026-03-22T20:23:58.976Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3510 time=2026-03-22T20:23:58.976Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3510 time=2026-03-22T20:23:58.976Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3510 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:58.977Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3510 time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3511 time=2026-03-22T20:23:58.977Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:58.977Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3511 time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3511 id=3512 time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3512 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3512 time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3512 time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3511 time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3511 time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3511 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.001Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=< from=[27] time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3511 time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3512 time=2026-03-22T20:23:59.001Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=< time=2026-03-22T20:23:59.001Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3512 time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3512 id=3513 time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3513 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.002Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3513 time=2026-03-22T20:23:59.002Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3513 time=2026-03-22T20:23:59.025Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3512 time=2026-03-22T20:23:59.025Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3512 time=2026-03-22T20:23:59.025Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3512 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.026Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704] time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3512 time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3513 time=2026-03-22T20:23:59.026Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter time=2026-03-22T20:23:59.026Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<parameter}]" state=0 buffer="" time=2026-03-22T20:23:59.026Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<parameter" toolCalls=[] done=false time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3513 time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3513 id=3514 time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3514 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3514 time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3514 time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3513 time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3513 time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3513 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.050Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="=" from=[28] time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3513 time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3514 time=2026-03-22T20:23:59.050Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="=" time=2026-03-22T20:23:59.050Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:=}]" state=0 buffer="" time=2026-03-22T20:23:59.050Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="=" toolCalls=[] done=false time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3514 time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3514 id=3515 time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3515 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.051Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3515 time=2026-03-22T20:23:59.051Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3515 time=2026-03-22T20:23:59.074Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3514 time=2026-03-22T20:23:59.074Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3514 time=2026-03-22T20:23:59.074Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3514 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.075Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=description from=[4532] time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3514 time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3515 time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3515 time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3515 id=3516 time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3516 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.075Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=description time=2026-03-22T20:23:59.075Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:description}] state=0 buffer="" time=2026-03-22T20:23:59.075Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=description toolCalls=[] done=false time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3516 time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3516 time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3515 time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3515 time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3515 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.099Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29] time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3515 time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3516 time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3516 time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3516 id=3517 time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3517 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.099Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=> time=2026-03-22T20:23:59.099Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer="" time=2026-03-22T20:23:59.099Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false time=2026-03-22T20:23:59.100Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3517 time=2026-03-22T20:23:59.100Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3517 time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3516 time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3516 time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3516 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.124Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3516 time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3517 time=2026-03-22T20:23:59.124Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:59.124Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3517 time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3517 id=3518 time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3518 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.125Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3518 time=2026-03-22T20:23:59.125Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3518 time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3517 time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3517 time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3517 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.148Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=List from=[826] time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3517 time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3518 time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3518 time=2026-03-22T20:23:59.148Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=List time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3518 id=3519 time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3519 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.148Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\nList}]" state=0 buffer="" time=2026-03-22T20:23:59.148Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\nList" toolCalls=[] done=false time=2026-03-22T20:23:59.149Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3519 time=2026-03-22T20:23:59.149Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3519 time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3518 time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3518 time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3518 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.173Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" src" from=[2212] time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3518 time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3519 time=2026-03-22T20:23:59.173Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" src" time=2026-03-22T20:23:59.173Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: src}]" state=0 buffer="" time=2026-03-22T20:23:59.173Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" src" toolCalls=[] done=false time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3519 time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3519 id=3520 time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3520 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3520 time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3520 time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3519 time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3519 time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3519 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.197Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" directory" from=[6025] time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3519 time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3520 time=2026-03-22T20:23:59.197Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" directory" time=2026-03-22T20:23:59.198Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: directory}]" state=0 buffer="" time=2026-03-22T20:23:59.198Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" directory" toolCalls=[] done=false time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3520 time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3520 id=3521 time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3521 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.198Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3521 time=2026-03-22T20:23:59.198Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3521 time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3520 time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3520 time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3520 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.222Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3520 time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3521 time=2026-03-22T20:23:59.222Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:59.222Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3521 time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3521 id=3522 time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3522 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3522 time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3522 time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3521 time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3521 time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3521 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.246Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510] time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3521 time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3522 time=2026-03-22T20:23:59.246Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</ time=2026-03-22T20:23:59.246Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3522 time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3522 id=3523 time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3523 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.247Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3523 time=2026-03-22T20:23:59.247Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3523 time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3522 time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3522 time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3522 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.271Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704] time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3522 time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3523 time=2026-03-22T20:23:59.271Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter time=2026-03-22T20:23:59.271Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</parameter}]" state=0 buffer="" time=2026-03-22T20:23:59.271Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</parameter" toolCalls=[] done=false time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3523 time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3523 id=3524 time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3524 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.272Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3524 time=2026-03-22T20:23:59.272Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3524 time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3523 time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3523 time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3523 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.295Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29] time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3523 time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3524 time=2026-03-22T20:23:59.296Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=> time=2026-03-22T20:23:59.296Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer="" time=2026-03-22T20:23:59.296Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3524 time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3524 id=3525 time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3525 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3525 time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3525 time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3524 time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3524 time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3524 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.320Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3524 time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3525 time=2026-03-22T20:23:59.320Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:59.320Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3525 time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3525 id=3526 time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3526 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.321Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3526 time=2026-03-22T20:23:59.321Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3526 time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3525 time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3525 time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3525 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.345Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510] time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3525 time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3526 time=2026-03-22T20:23:59.345Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</ time=2026-03-22T20:23:59.345Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3526 time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3526 id=3527 time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3527 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3527 time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3527 time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3526 time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3526 time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3526 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.369Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=function from=[1628] time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3526 time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3527 time=2026-03-22T20:23:59.369Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=function time=2026-03-22T20:23:59.369Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</function}]" state=0 buffer="" time=2026-03-22T20:23:59.369Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</function" toolCalls=[] done=false time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3527 time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3527 id=3528 time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3528 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.370Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3528 time=2026-03-22T20:23:59.370Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3528 time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3527 time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3527 time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3527 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.394Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29] time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3527 time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3528 time=2026-03-22T20:23:59.394Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=> time=2026-03-22T20:23:59.394Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer="" time=2026-03-22T20:23:59.394Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3528 time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3528 id=3529 time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3529 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.395Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3529 time=2026-03-22T20:23:59.395Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3529 time=2026-03-22T20:23:59.418Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3528 time=2026-03-22T20:23:59.418Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3528 time=2026-03-22T20:23:59.418Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3528 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.419Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198] time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3528 time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3529 time=2026-03-22T20:23:59.419Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n" time=2026-03-22T20:23:59.419Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5 time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3529 time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3529 id=3530 time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3530 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3530 time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3530 time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3529 time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3529 time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3529 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.443Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</tool_call> from=[248059] time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3529 time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3530 time=2026-03-22T20:23:59.443Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</tool_call> time=2026-03-22T20:23:59.443Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</tool_call>}]" state=0 buffer="" time=2026-03-22T20:23:59.443Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</tool_call>" toolCalls=[] done=false time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3530 time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3530 id=3531 time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3531 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1 time=2026-03-22T20:23:59.444Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3531 time=2026-03-22T20:23:59.444Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3531 time=2026-03-22T20:23:59.467Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3530 time=2026-03-22T20:23:59.467Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3530 time=2026-03-22T20:23:59.467Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3530 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0] time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:772 msg="computeBatch: EOS" batchID=3530 seqIdx=0 time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3530 time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3531 time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3531 time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3531 id=3532 time=2026-03-22T20:23:59.468Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="" time=2026-03-22T20:23:59.468Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="" toolCalls=[] done=true time=2026-03-22T20:23:59.468Z level=DEBUG source=sched.go:404 msg="context for request finished" runner.name=registry.ollama.ai/library/Qwen3.5-9B-Q8_0:latest runner.inference="[{ID:GPU-7864033d27e41cb9 Library:ROCm}]" runner.size="14.2 GiB" runner.vram="14.2 GiB" runner.parallel=1 runner.pid=1139644 runner.model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4 runner.num_ctx=262144 time=2026-03-22T20:23:59.468Z level=DEBUG source=sched.go:309 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/Qwen3.5-9B-Q8_0:latest runner.inference="[{ID:GPU-7864033d27e41cb9 Library:ROCm}]" runner.size="14.2 GiB" runner.vram="14.2 GiB" runner.parallel=1 runner.pid=1139644 runner.model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4 runner.num_ctx=262144 duration=2562047h47m16.854775807s time=2026-03-22T20:23:59.468Z level=DEBUG source=sched.go:327 msg="after processing request finished event" runner.name=registry.ollama.ai/library/Qwen3.5-9B-Q8_0:latest runner.inference="[{ID:GPU-7864033d27e41cb9 Library:ROCm}]" runner.size="14.2 GiB" runner.vram="14.2 GiB" runner.parallel=1 runner.pid=1139644 runner.model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4 runner.num_ctx=262144 refCount=0 time=2026-03-22T20:23:59.492Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3531 time=2026-03-22T20:23:59.492Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3531 time=2026-03-22T20:23:59.492Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3531 time=2026-03-22T20:24:00.255Z level=DEBUG source=sched.go:908 msg="shutting down runner" model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4 time=2026-03-22T20:24:00.255Z level=DEBUG source=server.go:1830 msg="stopping llama server" pid=1139644 time=2026-03-22T20:24:00.255Z level=DEBUG source=server.go:1836 msg="waiting for llama server to exit" pid=1139644 time=2026-03-22T20:24:00.255Z level=DEBUG source=sched.go:287 msg="shutting down scheduler completed loop" time=2026-03-22T20:24:00.255Z level=DEBUG source=sched.go:161 msg="shutting down scheduler pending loop" time=2026-03-22T20:24:00.374Z level=ERROR source=server.go:303 msg="llama runner terminated" error="signal: interrupt" time=2026-03-22T20:24:00.374Z level=DEBUG source=server.go:1840 msg="llama server stopped" pid=1139644 ``` </details> HW: - Linux AMD ROCm

GiteaMirror commented

2026-04-29 09:56:15 -05:00

@rick-github commented on GitHub (Mar 22, 2026):

Full log, from the start.

@rick-github commented on GitHub (Mar 22, 2026): Full log, from the start.

GiteaMirror commented

2026-04-29 09:56:16 -05:00

@hashelq commented on GitHub (Mar 22, 2026):

https://raw.githubusercontent.com/hashelq/ollama-log-temp1/refs/heads/master/log.txt

@hashelq commented on GitHub (Mar 22, 2026): https://raw.githubusercontent.com/hashelq/ollama-log-temp1/refs/heads/master/log.txt <img width="1157" height="1168" alt="Image" src="https://github.com/user-attachments/assets/e73ee261-a137-4b5c-8851-91d67d5e6651" />

GiteaMirror commented

2026-04-29 09:56:16 -05:00

@rick-github commented on GitHub (Mar 22, 2026):

Where was the GGUF sourced from?

@rick-github commented on GitHub (Mar 22, 2026): Where was the GGUF sourced from?

GiteaMirror commented

2026-04-29 09:56:17 -05:00

@hashelq commented on GitHub (Mar 22, 2026):

Where was the GGUF sourced from?

https://huggingface.co/unsloth/Qwen3.5-9B-GGUF

upd1:

Also I have same exact problems with
https://huggingface.co/Jackrong 's qwen3.5 cladue-4.6opus-dist v1 models
and
https://huggingface.co/Tesslate/OmniCoder-9B-GGUF

It seems all qwen3.5 and their forks are affected in my case

upd2:

just pulled qwen3.5:2b with ollama pull
with cfg:

FROM qwen3.5:2b

PARAMETER num_gpu 64
PARAMETER num_ctx 64000

Same issue

@hashelq commented on GitHub (Mar 22, 2026): > Where was the GGUF sourced from? https://huggingface.co/unsloth/Qwen3.5-9B-GGUF upd1: Also I have same exact problems with https://huggingface.co/Jackrong 's qwen3.5 cladue-4.6opus-dist v1 models and https://huggingface.co/Tesslate/OmniCoder-9B-GGUF It seems all qwen3.5 and their forks are affected in my case upd2: just pulled `qwen3.5:2b` with ollama pull with cfg: ``` FROM qwen3.5:2b PARAMETER num_gpu 64 PARAMETER num_ctx 64000 ``` Same issue

GiteaMirror commented

2026-04-29 09:56:17 -05:00

@rick-github commented on GitHub (Mar 22, 2026):

Do you have the issue if you use the model from the ollama library?

@rick-github commented on GitHub (Mar 22, 2026): Do you have the issue if you use the model from the ollama library?

GiteaMirror commented

2026-04-29 09:56:19 -05:00

@hashelq commented on GitHub (Mar 23, 2026):

Do you have the issue if you use the model from the ollama library?

Yes, I demonstrate it above with qwen3.5:2b

@hashelq commented on GitHub (Mar 23, 2026): > Do you have the issue if you use the model from the ollama library? Yes, I demonstrate it above with qwen3.5:2b

GiteaMirror commented

2026-04-29 09:56:21 -05:00

@hashelq commented on GitHub (Mar 23, 2026):

Interestingly, seems like switching to

RENDERER qwen3-coder
PARSER qwen3-coder

for qwen3.5:9b fixes the basic tool calling (read/list/grep/whatever) problems for a trade off of broken think tag parsing.

But with this setup I seen the qwen could not correctly call the opencode's questions tool..

@hashelq commented on GitHub (Mar 23, 2026): Interestingly, seems like switching to ``` RENDERER qwen3-coder PARSER qwen3-coder ``` for qwen3.5:9b fixes the basic tool calling (read/list/grep/whatever) problems for a trade off of broken think tag parsing. But with this setup I seen the qwen could not correctly call the opencode's questions tool.. <img width="644" height="1036" alt="Image" src="https://github.com/user-attachments/assets/06feb5fa-442e-4a9b-bfc6-81181e1e404e" />

GiteaMirror commented

2026-04-29 09:56:21 -05:00

@hashelq commented on GitHub (Mar 24, 2026):

I found that sometimes qwen3.5 models fail to produce "</think>" at the end of thinking.

Here is the omnicoder 9b (qwen3.5:9b fork) raw:

<function=bash>
<parameter=command>
cat /home/neko/how-doom-are-we.ai/package.json
</parameter>
<parameter=description>
Read package.json
</parameter>
</function>
</tool_call>[GIN] 2026/03/24 - 18:09:02 | 200 | 14.620707514s |       127.0.0.1 | POST     "/v1/chat/completions"
I need to explore the directory structure more and look at key files to understand the project[GIN] 2026/03/24 - 18:09:05 |
200 |      83.359µs |       127.0.0.1 | POST     "/api/blobs/sha256:3bb360f0d5bf788503dcd751e704760173298a35b26602dfb939474d87745732"
 better.



<tool_call>

<[GIN] 2026/03/24 - 18:09:05 | 200 |  188.708997ms |       127.0.0.1 | POST     "/api/create"

<function=bash>

<
<parameter=command>

It clearly misses the </think> after word "better".

And the debugging code is model/parsers/qwen35.go

func (p *Qwen35Parser) eat() ([]qwen35Event, bool) {
	var events []qwen35Event

	fmt.Print(p.buffer.String())
	switch p.state {
	case qwen35ParserStateCollectingThinking:
		acc := p.buffer.String()

... I was not using flash attention or KV_CACHE_TYPE for recent tests
Other observations:

Was testing it with vulkan instead of ROCm, the problem is the same.
qwen3.5 9B models seems to break much faster than 2B model

@hashelq commented on GitHub (Mar 24, 2026): I found that sometimes qwen3.5 models fail to produce "\</think\>" at the end of thinking. Here is the omnicoder 9b (qwen3.5:9b fork) raw: ``` <function=bash> <parameter=command> cat /home/neko/how-doom-are-we.ai/package.json </parameter> <parameter=description> Read package.json </parameter> </function> </tool_call>[GIN] 2026/03/24 - 18:09:02 | 200 | 14.620707514s | 127.0.0.1 | POST "/v1/chat/completions" I need to explore the directory structure more and look at key files to understand the project[GIN] 2026/03/24 - 18:09:05 | 200 | 83.359µs | 127.0.0.1 | POST "/api/blobs/sha256:3bb360f0d5bf788503dcd751e704760173298a35b26602dfb939474d87745732" better. <tool_call> <[GIN] 2026/03/24 - 18:09:05 | 200 | 188.708997ms | 127.0.0.1 | POST "/api/create" <function=bash> < <parameter=command> ``` It clearly misses the \</think\> after word "better". And the debugging code is model/parsers/qwen35.go ```go func (p *Qwen35Parser) eat() ([]qwen35Event, bool) { var events []qwen35Event fmt.Print(p.buffer.String()) switch p.state { case qwen35ParserStateCollectingThinking: acc := p.buffer.String() ``` ... I was not using flash attention or KV_CACHE_TYPE for recent tests Other observations: - Was testing it with vulkan instead of ROCm, the problem is the same. - qwen3.5 9B models seems to break much faster than 2B model

GiteaMirror commented

2026-04-29 09:56:21 -05:00

@rick-github commented on GitHub (Mar 24, 2026):

https://github.com/ollama/ollama/pull/15022

@rick-github commented on GitHub (Mar 24, 2026): https://github.com/ollama/ollama/pull/15022

Sign in to join this conversation.

Branches Tags

main

dhiltgen/ci

parth-launch-plan-gating

hoyyeva/anthropic-reference-images-path

parth-anthropic-reference-images-path

brucemacd/download-before-remove

hoyyeva/editor-config-repair

parth-mlx-decode-checkpoints

parth-launch-codex-app

hoyyeva/fix-codex-model-metadata-warning

hoyyeva/qwen

parth/hide-claude-desktop-till-release

hoyyeva/opencode-image-modality

parth-add-claude-code-autoinstall

release_v0.22.0

pdevine/manifest-list

codex/fix-codex-model-metadata-warning

pdevine/addressable-manifest

brucemacd/launch-fetch-reccomended

jmorganca/llama-compat

launch-copilot-cli

hoyyeva/opencode-thinking

release_v0.20.7

parth-auto-save-backup

parth-test

jmorganca/gemma4-audio-replacements

fix-manifest-digest-on-pull

hoyyeva/vscode-improve

brucemacd/install-server-wait

parth/update-claude-docs

brucemac/start-ap-install

pdevine/mlx-update

pdevine/qwen35_vision

drifkin/api-show-fallback

mintlify/image-generation-1773352582

hoyyeva/server-context-length-local-config

jmorganca/faster-reptition-penalties

jmorganca/convert-nemotron

parth-pi-thinking

pdevine/sampling-penalties

jmorganca/fix-create-quantization-memory

dongchen/resumable_transfer_fix

pdevine/sampling-cache-error

jessegross/mlx-usage

hoyyeva/openclaw-config

hoyyeva/app-html

pdevine/qwen3next

brucemacd/sign-sh-install

brucemacd/tui-update

brucemacd/usage-api

jmorganca/launch-empty

fix-app-dist-embed

mxyng/mlx-compile

mxyng/mlx-quant

mxyng/mlx-glm4.7

mxyng/mlx

brucemacd/simplify-model-picker

jmorganca/qwen3-concurrent

fix-glm-4.7-flash-mla-config

drifkin/qwen3-coder-opening-tag

brucemacd/usage-cli

fix-cuda12-fattn-shmem

ollama-imagegen-docs

parth/fix-multiline-inputs

brucemacd/config-docs

mxyng/model-files

mxyng/simple-execute

fix-imagegen-ollama-models

mxyng/async-upload

jmorganca/lazy-no-dtype-changes

imagegen-auto-detect-create

parth/decrease-concurrent-download-hf

fix-mlx-quantize-init

jmorganca/x-cleanup

usage

imagegen-readme

jmorganca/glm-image

mlx-gpu-cd

jmorganca/imagegen-modelfile

parth/agent-skills

parth/agent-allowlist

parth/signed-in-offline

parth/agents

parth/fix-context-chopping

improve-cloud-flow

parth/add-models-websearch

parth/prompt-renderer-mcp

jmorganca/native-settings

jmorganca/download-stream-hash

jmorganca/client2-rebased

brucemacd/oai-chat-req-multipart

jessegross/multi_chunk_reserve

grace/additional-omit-empty

grace/mistral-3-large

mxyng/tokenizer2

mxyng/tokenizer

jessegross/flash

hoyyeva/windows-nacked-app

mxyng/cleanup-attention

grace/deepseek-parser

hoyyeva/remember-unsent-prompt

parth/add-lfs-pointer-error-conversion

parth/olmo2-test2

hoyyeva/ollama-launchagent-plist

nicole/olmo-model

parth/olmo-test

mxyng/remove-embedded

parth/render-template

jmorganca/intellect-3

parth/remove-prealloc-linter

jmorganca/cmd-eval

nicole/nomic-embed-text-fix

mxyng/lint-2

hoyyeva/add-gemini-3-pro-preview

hoyyeva/load-model-list

mxyng/expand-path

mxyng/environ-2

hoyyeva/deeplink-json-encoding

parth/improve-tool-calling-tests

hoyyeva/conversation

hoyyeva/assistant-edit-response

hoyyeva/thinking

origin/brucemacd/invalid-char-i-err

parth/improve-tool-calling

jmorganca/required-omitempty

grace/qwen3-vl-tests

mxyng/iter-client

parth/docs-readme

nicole/embed-test

pdevine/integration-benchstat

parth/remove-generate-cmd

parth/add-toolcall-id

mxyng/server-tests

jmorganca/glm-4.6

jmorganca/gin-h-compat

drifkin/stable-tool-args

pdevine/qwen3-more-thinking

parth/add-websearch-client

nicole/websearch_local

jmorganca/qwen3-coder-updates

grace/deepseek-v3-migration-tests

mxyng/fix-create

jmorganca/cloud-errors

pdevine/parser-tidy

revert-12233-parth/simplify-entrypoints-runner

parth/enable-so-gpt-oss

brucemacd/qwen3vl

jmorganca/readme-simplify

parth/gpt-oss-structured-outputs

revert-12039-jmorganca/tools-braces

mxyng/embeddings

mxyng/gguf

mxyng/benchmark

mxyng/types-null

parth/move-parsing

mxyng/gemma2

jmorganca/docs

mxyng/16-bit

mxyng/create-stdin

pdevine/authorizedkeys

mxyng/quant

parth/opt-in-error-context-window

brucemacd/cache-models

brucemacd/runner-completion

jmorganca/llama-update-6

brucemacd/benchmark-list

brucemacd/partial-read-caps

parth/deepseek-r1-tools

mxyng/omit-array

parth/tool-prefix-temp

brucemacd/runner-test

jmorganca/qwen25vl

brucemacd/model-forward-test-ext

parth/python-function-parsing

jmorganca/cuda-compression-none

drifkin/num-parallel

drifkin/chat-truncation-fix

jmorganca/sync

parth/python-tools-calling

drifkin/array-head-count

brucemacd/create-no-loop

parth/server-enable-content-stream-with-tools

qwen25omni

mxyng/v3

brucemacd/ropeconfig

jmorganca/silence-tokenizer

parth/sample-so-test

parth/sampling-structured-outputs

brucemacd/doc-go-engine

parth/constrained-sampling-json

jmorganca/mistral-wip

brucemacd/mistral-small-convert

parth/sample-unmarshal-json-for-params

brucemacd/jomorganca/mistral

pdevine/bfloat16

jmorganca/mistral

brucemacd/mistral

pdevine/logging

parth/sample-correctness-fix

parth/sample-fix-sorting

jmorgan/sample-fix-sorting-extras

jmorganca/temp-0-images

brucemacd/parallel-embed-models

brucemacd/shim-grammar

jmorganca/fix-gguf-error

bmizerany/nameswork

jmorganca/faster-releases

bmizerany/validatenames

brucemacd/err-no-vocab

brucemacd/rope-config

brucemacd/err-hint

brucemacd/qwen2_5

brucemacd/logprobs

brucemacd/new_runner_graph_bench

progress-flicker

brucemacd/forward-test

brucemacd/go_qwen2

pdevine/gemma2

jmorganca/add-missing-symlink-eval

mxyng/next-debug

parth/set-context-size-openai

brucemacd/next-bpe-bench

brucemacd/next-bpe-test

brucemacd/new_runner_e2e

brucemacd/new_runner_qwen2

pdevine/convert-cohere2

brucemacd/convert-cli

parth/log-probs

mxyng/next-mlx

mxyng/cmd-history

parth/templating

parth/tokenize-detokenize

brucemacd/check-key-register

bmizerany/grammar

jmorganca/vendor-081b29bd

mxyng/func-checks

jmorganca/fix-null-format

parth/fix-default-to-warn-json

jmorganca/qwen2vl

jmorganca/no-concat

parth/cmd-cleanup-SO

brucemacd/check-key-register-structured-err

parth/openai-stream-usage

parth/fix-referencing-so

stream-tools-stop

jmorganca/degin-1

brucemacd/install-path-clean

brucemacd/push-name-validation

brucemacd/browser-key-register

jmorganca/openai-fix-first-message

jmorganca/fix-proxy

jessegross/sample

parth/disallow-streaming-tools

dhiltgen/remove_submodule

jmorganca/ga

jmorganca/mllama

pdevine/newlines

pdevine/geems-2b

jmorganca/llama-bump

mxyng/modelname-7

mxyng/gin-slog

mxyng/modelname-6

jyan/convert-prog

jyan/quant5

paligemma-support

pdevine/import-docs

jmorganca/openai-context

jyan/paligemma

jyan/p2

jyan/palitest

bmizerany/embedspeedup

jmorganca/llama-vit

brucemacd/allow-ollama

royh/ep-methods

royh/whisper

mxyng/api-models

mxyng/fix-memory

jyan/q4_4/8

jyan/ollama-v

royh/stream-tools

roy-embed-parallel

bmizerany/hrm

revert-5963-revert-5924-mxyng/llama3.1-rope

royh/embed-viz

jyan/local2

jyan/auth

jyan/local

jyan/parse-temp

jmorganca/template-mistral

jyan/reord-g

royh-openai-suffixdocs

royh-imgembed

royh-embed-parallel

jyan/quant4

royh-precision

jyan/progress

pdevine/fix-template

jyan/quant3

pdevine/ggla

mxyng/update-registry-domain

jmorganca/ggml-static

mxyng/create-context

jyan/v0.146

mxyng/layers-from-files

build_dist

bmizerany/noseek

royh-ls

royh-name

timeout

mxyng/server-timestamp

bmizerany/nosillyggufslurps

royh-params

jmorganca/llama-cpp-7c26775

royh-openai-delete

royh-show-rigid

jmorganca/enable-fa

jmorganca/no-error-template

jyan/format

royh-testdelete

bmizerany/fastverify

language_support

pdevine/ps-glitches

brucemacd/tokenize

bruce/iq-quants

bmizerany/filepathwithcoloninhost

mxyng/split-bin

bmizerany/client-registry

jmorganca/if-none-match

native

jmorganca/native

jmorganca/batch-embeddings

jmorganca/initcmake

jmorganca/mm

pdevine/showggmlinfo

modenameenforcealphanum

bmizerany/modenameenforcealphanum

jmorganca/done-reason

jmorganca/llama-cpp-8960fe8

ollama.com

bmizerany/filepathnobuild

bmizerany/types/model/defaultfix

rmdisplaylong

nogogen

bmizerany/x

modelfile-readme

bmizerany/replacecolon

jmorganca/limit

jmorganca/execstack

jmorganca/replace-assets

mxyng/tune-concurrency

jmorganca/testing

whitespace-detection

jmorganca/options

upgrade-all

scratch

cuda-search

mattw/airenamer

mattw/allmodelsonhuggingface

mattw/quantcontext

mattw/whatneedstorun

brucemacd/llama-mem-calc

mattw/faq-context

mattw/communitylinks

mattw/noprune

mattw/python-functioncalling

rename

mxyng/install

pulse

remove-first

editor

mattw/selfqueryingretrieval

cgo

mattw/howtoquant

api

matt/streamingapi

format-config

mxyng/extra-args

shell

update-nous-hermes

cp-model

upload-progress

fix-unknown-model

fix-model-names

delete-fix

insecure-registry

ls

deletemodels

progressbar

readme-updates

license-layers

skip-list

list-models

modelpath

matt/examplemodelfiles

distribution

go-opts

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/ollama#55911