[GH-ISSUE #10400] Ollama server can't process long POST request correctly #68890

New Issue

GiteaMirror · 2026-05-04T15:35:11-05:00

GiteaMirror commented

2026-05-04 15:35:11 -05:00

Originally created by @Ritanlisa on GitHub (Apr 25, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10400

What is the issue?

I've sent a long POST request (24015Bytes) for format limitation, but ollama didn't responce my arguments correctly
can any arguments to be settled to break that limit?

argument "format" value is auto-generated by pydantic ：

format.json

Relevant log output

2025/04/25 13:21:08 routes.go:1232: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:2048 OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\Ritanlisa\\.ollama\\models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES:]"
time=2025-04-25T13:21:08.833+08:00 level=INFO source=images.go:458 msg="total blobs: 16"
time=2025-04-25T13:21:08.834+08:00 level=INFO source=images.go:465 msg="total unused blobs removed: 0"
time=2025-04-25T13:21:08.835+08:00 level=INFO source=routes.go:1299 msg="Listening on 127.0.0.1:11434 (version 0.6.6)"
time=2025-04-25T13:21:08.835+08:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
time=2025-04-25T13:21:08.835+08:00 level=INFO source=gpu_windows.go:167 msg=packages count=1
time=2025-04-25T13:21:08.835+08:00 level=INFO source=gpu_windows.go:214 msg="" package=0 cores=8 efficiency=0 threads=16
time=2025-04-25T13:21:08.950+08:00 level=INFO source=gpu.go:319 msg="detected OS VRAM overhead" id=GPU-c0217016-16e3-acb8-c227-70157abf3f5a library=cuda compute=8.6 driver=12.7 name="NVIDIA GeForce RTX 3050 Laptop GPU" overhead="479.5 MiB"
time=2025-04-25T13:21:08.952+08:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-c0217016-16e3-acb8-c227-70157abf3f5a library=cuda variant=v12 compute=8.6 driver=12.7 name="NVIDIA GeForce RTX 3050 Laptop GPU" total="4.0 GiB" available="3.2 GiB"
time=2025-04-25T13:21:30.271+08:00 level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-25T13:21:30.299+08:00 level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-25T13:21:30.313+08:00 level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-25T13:21:30.314+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.vision.block_count default=0
time=2025-04-25T13:21:30.330+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.331+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.331+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.331+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.332+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.vision.block_count default=0
time=2025-04-25T13:21:30.346+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.346+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.347+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.347+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.348+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.vision.block_count default=0
time=2025-04-25T13:21:30.360+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.362+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.362+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.362+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.362+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.vision.block_count default=0
time=2025-04-25T13:21:30.376+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.376+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.376+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.376+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.392+08:00 level=INFO source=server.go:105 msg="system memory" total="15.8 GiB" free="4.2 GiB" free_swap="30.0 GiB"
time=2025-04-25T13:21:30.392+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.vision.block_count default=0
time=2025-04-25T13:21:30.407+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.407+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.407+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.407+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.408+08:00 level=INFO source=server.go:138 msg=offload library=cuda layers.requested=-1 layers.model=33 layers.offload=15 layers.split="" memory.available="[3.2 GiB]" memory.gpu_overhead="0 B" memory.required.full="5.9 GiB" memory.required.partial="3.2 GiB" memory.required.kv="256.0 MiB" memory.required.allocations="[3.2 GiB]" memory.weights.total="4.3 GiB" memory.weights.repeating="3.9 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="258.5 MiB" memory.graph.partial="677.5 MiB"
time=2025-04-25T13:21:30.408+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128
time=2025-04-25T13:21:30.408+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128
time=2025-04-25T13:21:30.408+08:00 level=INFO source=server.go:185 msg="enabling flash attention"
time=2025-04-25T13:21:30.408+08:00 level=WARN source=server.go:193 msg="kv cache type not supported by model" type=""
llama_model_loader: loaded meta data with 28 key-value pairs and 292 tensors from C:\Users\Ritanlisa\.ollama\models\blobs\sha256-6340dc3229b0d08ea9cc49b75d4098702983e17b4c096d57afbbf2ffc813f2be (version GGUF V3 (latest))
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv   0:                       general.architecture str              = llama
llama_model_loader: - kv   1:                               general.type str              = model
llama_model_loader: - kv   2:                               general.name str              = DeepSeek R1 Distill Llama 8B
llama_model_loader: - kv   3:                           general.basename str              = DeepSeek-R1-Distill-Llama
llama_model_loader: - kv   4:                         general.size_label str              = 8B
llama_model_loader: - kv   5:                          llama.block_count u32              = 32
llama_model_loader: - kv   6:                       llama.context_length u32              = 131072
llama_model_loader: - kv   7:                     llama.embedding_length u32              = 4096
llama_model_loader: - kv   8:                  llama.feed_forward_length u32              = 14336
llama_model_loader: - kv   9:                 llama.attention.head_count u32              = 32
llama_model_loader: - kv  10:              llama.attention.head_count_kv u32              = 8
llama_model_loader: - kv  11:                       llama.rope.freq_base f32              = 500000.000000
llama_model_loader: - kv  12:     llama.attention.layer_norm_rms_epsilon f32              = 0.000010
llama_model_loader: - kv  13:                          general.file_type u32              = 15
llama_model_loader: - kv  14:                           llama.vocab_size u32              = 128256
llama_model_loader: - kv  15:                 llama.rope.dimension_count u32              = 128
llama_model_loader: - kv  16:                       tokenizer.ggml.model str              = gpt2
llama_model_loader: - kv  17:                         tokenizer.ggml.pre str              = llama-bpe
llama_model_loader: - kv  18:                      tokenizer.ggml.tokens arr[str,128256]  = ["!", "\"", "#", "$", "%", "&", "'", ...
llama_model_loader: - kv  19:                  tokenizer.ggml.token_type arr[i32,128256]  = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ...
llama_model_loader: - kv  20:                      tokenizer.ggml.merges arr[str,280147]  = ["Ġ Ġ", "Ġ ĠĠĠ", "ĠĠ ĠĠ", "...
llama_model_loader: - kv  21:                tokenizer.ggml.bos_token_id u32              = 128000
llama_model_loader: - kv  22:                tokenizer.ggml.eos_token_id u32              = 128001
llama_model_loader: - kv  23:            tokenizer.ggml.padding_token_id u32              = 128001
llama_model_loader: - kv  24:               tokenizer.ggml.add_bos_token bool             = true
llama_model_loader: - kv  25:               tokenizer.ggml.add_eos_token bool             = false
llama_model_loader: - kv  26:                    tokenizer.chat_template str              = {% if not add_generation_prompt is de...
llama_model_loader: - kv  27:               general.quantization_version u32              = 2
llama_model_loader: - type  f32:   66 tensors
llama_model_loader: - type q4_K:  193 tensors
llama_model_loader: - type q6_K:   33 tensors
print_info: file format = GGUF V3 (latest)
print_info: file type   = Q4_K - Medium
print_info: file size   = 4.58 GiB (4.89 BPW)
load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
load: special tokens cache size = 256
load: token to piece cache size = 0.7999 MB
print_info: arch             = llama
print_info: vocab_only       = 1
print_info: model type       = ?B
print_info: model params     = 8.03 B
print_info: general.name     = DeepSeek R1 Distill Llama 8B
print_info: vocab type       = BPE
print_info: n_vocab          = 128256
print_info: n_merges         = 280147
print_info: BOS token        = 128000 '<｜begin▁of▁sentence｜>'
print_info: EOS token        = 128001 '<｜end▁of▁sentence｜>'
print_info: EOT token        = 128001 '<｜end▁of▁sentence｜>'
print_info: EOM token        = 128008 '<|eom_id|>'
print_info: PAD token        = 128001 '<｜end▁of▁sentence｜>'
print_info: LF token         = 198 'Ċ'
print_info: EOG token        = 128001 '<｜end▁of▁sentence｜>'
print_info: EOG token        = 128008 '<|eom_id|>'
print_info: EOG token        = 128009 '<|eot_id|>'
print_info: max token length = 256
llama_model_load: vocab only - skipping tensors
time=2025-04-25T13:21:30.653+08:00 level=INFO source=server.go:405 msg="starting llama server" cmd="C:\\Users\\Ritanlisa\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --model C:\\Users\\Ritanlisa\\.ollama\\models\\blobs\\sha256-6340dc3229b0d08ea9cc49b75d4098702983e17b4c096d57afbbf2ffc813f2be --ctx-size 2048 --batch-size 512 --n-gpu-layers 15 --threads 8 --flash-attn --no-mmap --parallel 1 --port 58592"
time=2025-04-25T13:21:30.659+08:00 level=INFO source=sched.go:451 msg="loaded runners" count=1
time=2025-04-25T13:21:30.659+08:00 level=INFO source=server.go:580 msg="waiting for llama runner to start responding"
time=2025-04-25T13:21:30.659+08:00 level=INFO source=server.go:614 msg="waiting for server to become available" status="llm server error"
time=2025-04-25T13:21:30.696+08:00 level=INFO source=runner.go:853 msg="starting go runner"
ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 3050 Laptop GPU, compute capability 8.6, VMM: yes
load_backend: loaded CUDA backend from C:\Users\Ritanlisa\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12\ggml-cuda.dll
load_backend: loaded CPU backend from C:\Users\Ritanlisa\AppData\Local\Programs\Ollama\lib\ollama\ggml-cpu-icelake.dll
time=2025-04-25T13:21:30.812+08:00 level=INFO source=ggml.go:109 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.AVX512=1 CPU.0.AVX512_VBMI=1 CPU.0.AVX512_VNNI=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(clang)
time=2025-04-25T13:21:30.813+08:00 level=INFO source=runner.go:913 msg="Server listening on 127.0.0.1:58592"
llama_model_load_from_file_impl: using device CUDA0 (NVIDIA GeForce RTX 3050 Laptop GPU) - 3303 MiB free
llama_model_loader: loaded meta data with 28 key-value pairs and 292 tensors from C:\Users\Ritanlisa\.ollama\models\blobs\sha256-6340dc3229b0d08ea9cc49b75d4098702983e17b4c096d57afbbf2ffc813f2be (version GGUF V3 (latest))
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv   0:                       general.architecture str              = llama
llama_model_loader: - kv   1:                               general.type str              = model
llama_model_loader: - kv   2:                               general.name str              = DeepSeek R1 Distill Llama 8B
llama_model_loader: - kv   3:                           general.basename str              = DeepSeek-R1-Distill-Llama
llama_model_loader: - kv   4:                         general.size_label str              = 8B
llama_model_loader: - kv   5:                          llama.block_count u32              = 32
llama_model_loader: - kv   6:                       llama.context_length u32              = 131072
llama_model_loader: - kv   7:                     llama.embedding_length u32              = 4096
llama_model_loader: - kv   8:                  llama.feed_forward_length u32              = 14336
llama_model_loader: - kv   9:                 llama.attention.head_count u32              = 32
llama_model_loader: - kv  10:              llama.attention.head_count_kv u32              = 8
llama_model_loader: - kv  11:                       llama.rope.freq_base f32              = 500000.000000
llama_model_loader: - kv  12:     llama.attention.layer_norm_rms_epsilon f32              = 0.000010
llama_model_loader: - kv  13:                          general.file_type u32              = 15
llama_model_loader: - kv  14:                           llama.vocab_size u32              = 128256
llama_model_loader: - kv  15:                 llama.rope.dimension_count u32              = 128
llama_model_loader: - kv  16:                       tokenizer.ggml.model str              = gpt2
llama_model_loader: - kv  17:                         tokenizer.ggml.pre str              = llama-bpe
llama_model_loader: - kv  18:                      tokenizer.ggml.tokens arr[str,128256]  = ["!", "\"", "#", "$", "%", "&", "'", ...
time=2025-04-25T13:21:30.911+08:00 level=INFO source=server.go:614 msg="waiting for server to become available" status="llm server loading model"
llama_model_loader: - kv  19:                  tokenizer.ggml.token_type arr[i32,128256]  = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ...
llama_model_loader: - kv  20:                      tokenizer.ggml.merges arr[str,280147]  = ["Ġ Ġ", "Ġ ĠĠĠ", "ĠĠ ĠĠ", "...
llama_model_loader: - kv  21:                tokenizer.ggml.bos_token_id u32              = 128000
llama_model_loader: - kv  22:                tokenizer.ggml.eos_token_id u32              = 128001
llama_model_loader: - kv  23:            tokenizer.ggml.padding_token_id u32              = 128001
llama_model_loader: - kv  24:               tokenizer.ggml.add_bos_token bool             = true
llama_model_loader: - kv  25:               tokenizer.ggml.add_eos_token bool             = false
llama_model_loader: - kv  26:                    tokenizer.chat_template str              = {% if not add_generation_prompt is de...
llama_model_loader: - kv  27:               general.quantization_version u32              = 2
llama_model_loader: - type  f32:   66 tensors
llama_model_loader: - type q4_K:  193 tensors
llama_model_loader: - type q6_K:   33 tensors
print_info: file format = GGUF V3 (latest)
print_info: file type   = Q4_K - Medium
print_info: file size   = 4.58 GiB (4.89 BPW)
load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
load: special tokens cache size = 256
load: token to piece cache size = 0.7999 MB
print_info: arch             = llama
print_info: vocab_only       = 0
print_info: n_ctx_train      = 131072
print_info: n_embd           = 4096
print_info: n_layer          = 32
print_info: n_head           = 32
print_info: n_head_kv        = 8
print_info: n_rot            = 128
print_info: n_swa            = 0
print_info: n_swa_pattern    = 1
print_info: n_embd_head_k    = 128
print_info: n_embd_head_v    = 128
print_info: n_gqa            = 4
print_info: n_embd_k_gqa     = 1024
print_info: n_embd_v_gqa     = 1024
print_info: f_norm_eps       = 0.0e+00
print_info: f_norm_rms_eps   = 1.0e-05
print_info: f_clamp_kqv      = 0.0e+00
print_info: f_max_alibi_bias = 0.0e+00
print_info: f_logit_scale    = 0.0e+00
print_info: f_attn_scale     = 0.0e+00
print_info: n_ff             = 14336
print_info: n_expert         = 0
print_info: n_expert_used    = 0
print_info: causal attn      = 1
print_info: pooling type     = 0
print_info: rope type        = 0
print_info: rope scaling     = linear
print_info: freq_base_train  = 500000.0
print_info: freq_scale_train = 1
print_info: n_ctx_orig_yarn  = 131072
print_info: rope_finetuned   = unknown
print_info: ssm_d_conv       = 0
print_info: ssm_d_inner      = 0
print_info: ssm_d_state      = 0
print_info: ssm_dt_rank      = 0
print_info: ssm_dt_b_c_rms   = 0
print_info: model type       = 8B
print_info: model params     = 8.03 B
print_info: general.name     = DeepSeek R1 Distill Llama 8B
print_info: vocab type       = BPE
print_info: n_vocab          = 128256
print_info: n_merges         = 280147
print_info: BOS token        = 128000 '<｜begin▁of▁sentence｜>'
print_info: EOS token        = 128001 '<｜end▁of▁sentence｜>'
print_info: EOT token        = 128001 '<｜end▁of▁sentence｜>'
print_info: EOM token        = 128008 '<|eom_id|>'
print_info: PAD token        = 128001 '<｜end▁of▁sentence｜>'
print_info: LF token         = 198 'Ċ'
print_info: EOG token        = 128001 '<｜end▁of▁sentence｜>'
print_info: EOG token        = 128008 '<|eom_id|>'
print_info: EOG token        = 128009 '<|eot_id|>'
print_info: max token length = 256
load_tensors: loading model tensors, this can take a while... (mmap = false)
load_tensors: offloading 15 repeating layers to GPU
load_tensors: offloaded 15/33 layers to GPU
load_tensors:          CPU model buffer size =   281.81 MiB
load_tensors:    CUDA_Host model buffer size =  2524.27 MiB
load_tensors:        CUDA0 model buffer size =  1879.22 MiB
llama_context: constructing llama_context
llama_context: n_seq_max     = 1
llama_context: n_ctx         = 2048
llama_context: n_ctx_per_seq = 2048
llama_context: n_batch       = 512
llama_context: n_ubatch      = 512
llama_context: causal_attn   = 1
llama_context: flash_attn    = 1
llama_context: freq_base     = 500000.0
llama_context: freq_scale    = 1
llama_context: n_ctx_per_seq (2048) < n_ctx_train (131072) -- the full capacity of the model will not be utilized
llama_context:        CPU  output buffer size =     0.50 MiB
init: kv_size = 2048, offload = 1, type_k = 'f16', type_v = 'f16', n_layer = 32, can_shift = 1
init:        CPU KV buffer size =   136.00 MiB
init:      CUDA0 KV buffer size =   120.00 MiB
llama_context: KV self size  =  256.00 MiB, K (f16):  128.00 MiB, V (f16):  128.00 MiB
llama_context:      CUDA0 compute buffer size =   669.48 MiB
llama_context:  CUDA_Host compute buffer size =    12.01 MiB
llama_context: graph nodes  = 967
llama_context: graph splits = 192 (with bs=512), 3 (with bs=1)
time=2025-04-25T13:21:36.676+08:00 level=INFO source=server.go:619 msg="llama runner started in 6.02 seconds"
parse: error parsing grammar: expecting '}' at -1})? "]" space
find-file-limitation-dir-path-kv ::= "\"dir_path\"" space ":" space string
search-file-args-kv ::= "\"args\"" space ":" space search-file-args
find-file-command-name-kv ::= "\"command_name\"" space ":" space find-file-command-name
command-list-item-14 ::= edit-file-by-replace
scroll-down-command-name ::= "\"Editor.scroll_down\"" space
edit-file-by-replace-args-kv ::= "\"args\"" space ":" space edit-file-by-replace-args
command-list-item-18 ::= open-file
edit-file-by-replace-args ::= edit-file-by-replace-limitation
edit-file-by-replace-limitation ::= "{" space edit-file-by-replace-limitation-file-name-kv "," space edit-file-by-replace-limitation-first-replaced-line-number-kv "," space edit-file-by-replace-limitation-first-replaced-line-content-kv "," space edit-file-by-replace-limitation-last-replaced-line-number-kv "," space edit-file-by-replace-limitation-last-replaced-line-content-kv "," space edit-file-by-replace-limitation-new-content-kv "}" space
edit-file-by-replace-limitation-new-content-kv ::= "\"new_content\"" space ":" space string
edit-file-by-replace-limitation-last-replaced-line-number-kv ::= "\"last_replaced_line_number\"" space ":" space integer
replace-task-limitation ::= "{" space replace-task-limitation-task-id-kv "," space replace-task-limitation-new-dependent-task-ids-kv "," space replace-task-limitation-new-instruction-kv "," space replace-task-limitation-new-assignee-kv "}" space
read-limitation-path-kv ::= "\"path\"" space ":" space string
edit-file-by-replace-limitation-first-replaced-line-content-kv ::= "\"first_replaced_line_content\"" space ":" space string
null ::= "null" space
command-list-item-17 ::= insert-content-at-line
edit-file-by-replace-limitation-first-replaced-line-number-kv ::= "\"first_replaced_line_number\"" space ":" space integer
find-file-limitation ::= "{" space find-file-limitation-file-name-kv "," space find-file-limitation-dir-path-kv "}" space
edit-file-by-replace-limitation-file-name-kv ::= "\"file_name\"" space ":" space string
goto ::= "{" space goto-command-name-kv "," space goto-args-kv "}" space
edit-file-by-replace-command-name-kv ::= "\"command_name\"" space ":" space edit-file-by-replace-command-name
search-dir-limitation-search-term-kv ::= "\"search_term\"" space ":" space string
create-file ::= "{" space create-file-command-name-kv "," space create-file-args-kv "}" space
create-file-args ::= create-file-limitation
find-file-limitation-file-name-kv ::= "\"file_name\"" space ":" space string
create-file-limitation ::= "{" space create-file-limitation-filename-kv "}" space
press ::= "{" space press-command-name-kv "," space press-args-kv "}" space
tab-focus-args-kv ::= "\"args\"" space ":" space tab-focus-args
find-file ::= "{" space find-file-command-name-kv "," space find-file-args-kv "}" space
create-file-limitation-filename-kv ::= "\"filename\"" space ":" space string
read-args ::= read-limitation
create-file-command-name-kv ::= "\"command_name\"" space ":" space create-file-command-name
append-file-limitation ::= "{" space append-file-limitation-filename-kv "," space append-file-limitation-content-kv "}" space
char ::= [^"\\\x7F\x00-\x1F] | [\\] (["\\bfnrt] | "u" [0-9a-fA-F]{4})
append-file-limitation-content-kv ::= "\"content\"" space ":" space string
command-list-item-7 ::= hover
command-list-item-11 ::= type
type-args ::= type-limitation
write-command-name ::= "\"Editor.write\"" space
boolean ::= ("true" | "false") space
command-list-item-22 ::= search-dir
type-limitation-press-enter-after-kv ::= "\"press_enter_after\"" space ":" space boolean
go-back-args ::= go-back-limitation
type-limitation-content-kv ::= "\"content\"" space ":" space string
read-args-kv ::= "\"args\"" space ":" space read-args
command-list-item-10 ::= tab-focus
replace-task-command-name ::= "\"Plan.replace_task\"" space
tab-focus-args ::= tab-focus-limitation
tab-focus-limitation ::= "{" space tab-focus-limitation-page-number-kv "}" space
scroll ::= "{" space scroll-command-name-kv "," space scroll-args-kv "}" space
scroll-limitation-direction-kv ::= "\"direction\"" space ":" space scroll-limitation-direction
scroll-command-name ::= "\"Browser.scroll\"" space
write-args ::= write-limitation
append-file-command-name ::= "\"Editor.append_file\"" space
press-args-kv ::= "\"args\"" space ":" space press-args
append-file-command-name-kv ::= "\"command_name\"" space ":" space append-file-command-name
press-args ::= press-limitation
replace-task-args-kv ::= "\"args\"" space ":" space replace-task-args
press-limitation-key-comb-kv ::= "\"key_comb\"" space ":" space string
press-command-name ::= "\"Browser.press\"" space
edit-file-by-replace-command-name ::= "\"Editor.edit_file_by_replace\"" space
tab-focus-command-name ::= "\"Browser.tab_focus\"" space
hover ::= "{" space hover-command-name-kv "," space hover-args-kv "}" space
append-task-limitation-task-type-kv ::= "\"task_type\"" space ":" space string
scroll-down-args-kv ::= "\"args\"" space ":" space scroll-down-args
scroll-down-args ::= scroll-down-limitation
hover-args-kv ::= "\"args\"" space ":" space hover-args
read-limitation ::= "{" space read-limitation-path-kv "}" space
hover-args ::= hover-limitation
reset-task-limitation ::= "{" space reset-task-limitation-content-kv "," space reset-task-limitation-send-to-kv "}" space
hover-limitation ::= "{" space hover-limitation-element-id-kv "}" space
tab-focus ::= "{" space tab-focus-command-name-kv "," space tab-focus-args-kv "}" space
command-list-item-12 ::= append-file
goto-line-limitation-line-number-kv ::= "\"line_number\"" space ":" space integer
goto-command-name ::= "\"Browser.goto\"" space
goto-command-name-kv ::= "\"command_name\"" space ":" space goto-command-name
hover-command-name ::= "\"Browser.hover\"" space
command-list-item-13 ::= create-file
type ::= "{" space type-command-name-kv "," space type-args-kv "}" space
find-file-command-name ::= "\"Editor.find_file\"" space
goto-args-kv ::= "\"args\"" space ":" space goto-args
goto-args ::= goto-limitation
reset-task-limitation-send-to-1-item-5 ::= "\"Alex\"" space
scroll-down-limitation ::= "{" space  "}" space
press-limitation ::= "{" space press-limitation-key-comb-kv "}" space
command-list-item-1 ::= replace-task
tab-focus-limitation-page-number-kv ::= "\"page_number\"" space ":" space integer
decimal-part ::= [0-9]{1,16}
goto-line-limitation ::= "{" space goto-line-limitation-line-number-kv "}" space
hover-command-name-kv ::= "\"command_name\"" space ":" space hover-command-name
goto-limitation-timeout-kv ::= "\"timeout\"" space ":" space number
number ::= ("-"? integral-part) ("." decimal-part)? ([eE] [-+]? integral-part)? space
insert-content-at-line ::= "{" space insert-content-at-line-command-name-kv "," space insert-content-at-line-args-kv "}" space
goto-limitation-url-kv ::= "\"url\"" space ":" space string
type-limitation ::= "{" space type-limitation-element-id-kv "," space type-limitation-content-kv ( "," space ( type-limitation-press-enter-after-kv ) )? "}" space
append-file-limitation-filename-kv ::= "\"filename\"" space ":" space string
scroll-limitation-direction ::= ("\"down\"" | "\"up\"") space
scroll-limitation ::= "{" space scroll-limitation-direction-kv "}" space
command-list-item-5 ::= go-forward
open-file-limitation-line-number-kv ::= "\"line_number\"" space ":" space open-file-limitation-line-number
scroll-args ::= scroll-limitation
similarity-search-limitation-path-kv ::= "\"path\"" space ":" space similarity-search-limitation-path
command-list-item-6 ::= goto
go-forward-args-kv ::= "\"args\"" space ":" space go-forward-args
replace-task-limitation-new-assignee-kv ::= "\"new_assignee\"" space ":" space string
tab-focus-command-name-kv ::= "\"command_name\"" space ":" space tab-focus-command-name
go-forward-command-name ::= "\"Browser.go_forward\"" space
go-forward-args ::= go-forward-limitation
append-file-args ::= append-file-limitation
reset-task-limitation-send-to-1-item ::= reset-task-limitation-send-to-1-item-0 | reset-task-limitation-send-to-1-item-1 | reset-task-limitation-send-to-1-item-2 | reset-task-limitation-send-to-1-item-3 | reset-task-limitation-send-to-1-item-4 | reset-task-limitation-send-to-1-item-5 | reset-task-limitation-send-to-1-item-6 | reset-task-limitation-send-to-1-item-7
close-tab ::= "{" space close-tab-command-name-kv "," space close-tab-args-kv "}" space
command-list-item-4 ::= go-back
scroll-up-args-kv ::= "\"args\"" space ":" space scroll-up-args
append-task-limitation-task-id-kv ::= "\"task_id\"" space ":" space string
command-list-item-19 ::= read
append-file ::= "{" space append-file-command-name-kv "," space append-file-args-kv "}" space
append-task-args-kv ::= "\"args\"" space ":" space append-task-args
press-command-name-kv ::= "\"command_name\"" space ":" space press-command-name
insert-content-at-line-command-name-kv ::= "\"command_name\"" space ":" space insert-content-at-line-command-name
command-list-item-9 ::= scroll
goto-line ::= "{" space goto-line-command-name-kv "," space goto-line-args-kv "}" space
search-file-limitation-file-path-kv ::= "\"file_path\"" space ":" space search-file-limitation-file-path
command-list-item-3 ::= close-tab
hover-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer
go-forward-limitation ::= "{" space  "}" space
click-args ::= click-limitation
edit-file-by-replace ::= "{" space edit-file-by-replace-command-name-kv "," space edit-file-by-replace-args-kv "}" space
command-list-item-2 ::= click
command-list-item-0 ::= append-task
close-tab-args-kv ::= "\"args\"" space ":" space close-tab-args
replace-task-limitation-task-id-kv ::= "\"task_id\"" space ":" space string
close-tab-limitation ::= "{" space  "}" space
scroll-args-kv ::= "\"args\"" space ":" space scroll-args
create-file-command-name ::= "\"Editor.create_file\"" space
read ::= "{" space read-command-name-kv "," space read-args-kv "}" space
open-file-command-name-kv ::= "\"command_name\"" space ":" space open-file-command-name
append-file-args-kv ::= "\"args\"" space ":" space append-file-args
click-limitation ::= "{" space click-limitation-element-id-kv "}" space
click-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer
space ::= | " " | "\n"{1,2} [ \t]{0,20}
command-list-item-23 ::= search-file
append-task-limitation-dependent-task-ids-kv ::= "\"dependent_task_ids\"" space ":" space append-task-limitation-dependent-task-ids
click ::= "{" space click-command-name-kv "," space click-args-kv "}" space
read-command-name ::= "\"Editor.read\"" space
integer ::= ("-"? integral-part) space
scroll-command-name-kv ::= "\"command_name\"" space ":" space scroll-command-name
integral-part ::= [0] | [1-9] [0-9]{0,15}
replace-task ::= "{" space replace-task-command-name-kv "," space replace-task-args-kv "}" space
type-command-name ::= "\"Browser.type\"" space
replace-task-limitation-new-instruction-kv ::= "\"new_instruction\"" space ":" space string
command-list-item-8 ::= press
append-task-command-name ::= "\"Plan.append_task\"" space
click-command-name ::= "\"Browser.click\"" space
open-file-limitation-path-kv ::= "\"path\"" space ":" space open-file-limitation-path
replace-task-command-name-kv ::= "\"command_name\"" space ":" space replace-task-command-name
close-tab-command-name ::= "\"Browser.close_tab\"" space
replace-task-limitation-new-dependent-task-ids-kv ::= "\"new_dependent_task_ids\"" space ":" space replace-task-limitation-new-dependent-task-ids
scroll-down-command-name-kv ::= "\"command_name\"" space ":" space scroll-down-command-name
append-task ::= "{" space append-task-command-name-kv "," space append-task-args-kv "}" space
goto-limitation ::= "{" space goto-limitation-url-kv ( "," space ( goto-limitation-timeout-kv ) )? "}" space
replace-task-args ::= replace-task-limitation
publish-message-args ::= reset-task-limitation
create-file-args-kv ::= "\"args\"" space ":" space create-file-args
go-back-command-name ::= "\"Browser.go_back\"" space
go-forward-command-name-kv ::= "\"command_name\"" space ":" space go-forward-command-name
append-task-args ::= append-task-limitation
append-task-command-name-kv ::= "\"command_name\"" space ":" space append-task-command-name
append-task-limitation-dependent-task-ids ::= "[" space (string ("," space string){0,-1})? "]" space
go-back ::= "{" space go-back-command-name-kv "," space go-back-args-kv "}" space
click-command-name-kv ::= "\"command_name\"" space ":" space click-command-name
open-file-args-kv ::= "\"args\"" space ":" space open-file-args
append-task-limitation-instruction-kv ::= "\"instruction\"" space ":" space string
type-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer
click-args-kv ::= "\"args\"" space ":" space click-args
edit-file-by-replace-limitation-last-replaced-line-content-kv ::= "\"last_replaced_line_content\"" space ":" space string
type-args-kv ::= "\"args\"" space ":" space type-args
close-tab-command-name-kv ::= "\"command_name\"" space ":" space close-tab-command-name
write-limitation-path-kv ::= "\"path\"" space ":" space string
string ::= "\"" char* "\"" space
go-forward ::= "{" space go-forward-command-name-kv "," space go-forward-args-kv "}" space
open-file-limitation-context-lines ::= integer | null
go-back-args-kv ::= "\"args\"" space ":" space go-back-args
mental-activity-kv ::= "\"mental_activity\"" space ":" space string


root ::= "{" space mental-activity-kv "," space command-list-kv "}" space
command-list-kv ::= "\"command_list\"" space ":" space command-list
command-list-item ::= command-list-item-0 | command-list-item-1 | command-list-item-2 | command-list-item-3 | command-list-item-4 | command-list-item-5 | command-list-item-6 | command-list-item-7 | command-list-item-8 | command-list-item-9 | command-list-item-10 | command-list-item-11 | command-list-item-12 | command-list-item-13 | command-list-item-14 | command-list-item-15 | command-list-item-16 | command-list-item-17 | command-list-item-18 | command-list-item-19 | command-list-item-20 | command-list-item-21 | command-list-item-22 | command-list-item-23 | command-list-item-24 | command-list-item-25 | command-list-item-26 | command-list-item-27
command-list-item-27 ::= publish-message
publish-message-command-name-kv ::= "\"command_name\"" space ":" space publish-message-command-name
publish-message-command-name ::= "\"TeamLeader.publish_message\"" space
command-list-item-26 ::= publish-team-message
publish-team-message ::= "{" space publish-team-message-command-name-kv "," space publish-team-message-args-kv "}" space
publish-team-message-args-kv ::= "\"args\"" space ":" space publish-team-message-args
publish-team-message-args ::= reset-task-limitation
reset-task-limitation-send-to-kv ::= "\"send_to\"" space ":" space reset-task-limitation-send-to
reset-task-limitation-send-to ::= reset-task-limitation-send-to-0 | reset-task-limitation-send-to-1
reset-task-limitation-send-to-1 ::= "[" space (reset-task-limitation-send-to-1-item ("," space reset-task-limitation-send-to-1-item)*)? "]" space
reset-task-limitation-send-to-1-item-7 ::= "\"metagpt.roles.di.data_analyst.DataAnalyst\"" space
reset-task-limitation-send-to-1-item-6 ::= "\"David\"" space
reset-task-limitation-send-to-1-item-4 ::= "\"metagpt.roles.di.engineer2.Engineer2\"" space
reset-task-limitation-send-to-1-item-3 ::= "\"metagpt.roles.architect.Architect\"" space
reset-task-limitation-send-to-1-item-2 ::= "\"Bob\"" space
reset-task-limitation-send-to-1-item-0 ::= "\"metagpt.roles.product_manager.ProductManager\"" space
reset-task-limitation-send-to-0 ::= "\"<all>\"" space
publish-message-args-kv ::= "\"args\"" space ":" space publish-message-args
reset-task-limitation-content-kv ::= "\"content\"" space ":" space string
publish-team-message-command-name-kv ::= "\"command_name\"" space ":" space publish-team-message-command-name
publish-team-message-command-name ::= "\"TeamLeader.publish_team_message\"" space
write ::= "{" space write-command-name-kv "," space write-args-kv "}" space
write-args-kv ::= "\"args\"" space ":" space write-args
write-limitation ::= "{" space write-limitation-path-kv "," space write-limitation-content-kv "}" space
write-limitation-content-kv ::= "\"content\"" space ":" space string
write-command-name-kv ::= "\"command_name\"" space ":" space write-command-name
command-list-item-24 ::= similarity-search
similarity-search-limitation ::= "{" space similarity-search-limitation-query-kv "," space similarity-search-limitation-path-kv "}" space
similarity-search-limitation-path ::= string | string
similarity-search-limitation-query-kv ::= "\"query\"" space ":" space string
command-list ::= "[" space (command-list-item ("," space command-list-item)*)? "]" space
similarity-search-command-name-kv ::= "\"command_name\"" space ":" space similarity-search-command-name
similarity-search-command-name ::= "\"Editor.similarity_search\"" space
search-file ::= "{" space search-file-command-name-kv "," space search-file-args-kv "}" space
search-file-args ::= search-file-limitation
search-file-limitation ::= "{" space search-file-limitation-search-term-kv "," space search-file-limitation-file-path-kv "}" space
search-file-limitation-file-path ::= string | null
search-file-limitation-search-term-kv ::= "\"search_term\"" space ":" space string
search-file-command-name-kv ::= "\"command_name\"" space ":" space search-file-command-name
search-file-command-name ::= "\"Editor.search_file\"" space
search-dir-args-kv ::= "\"args\"" space ":" space search-dir-args
search-dir-args ::= search-dir-limitation
command-list-item-25 ::= write
search-dir-limitation ::= "{" space search-dir-limitation-search-term-kv "," space search-dir-limitation-dir-path-kv "}" space
search-dir-limitation-dir-path-kv ::= "\"dir_path\"" space ":" space string
search-dir-command-name-kv ::= "\"command_name\"" space ":" space search-dir-command-name
search-dir-command-name ::= "\"Editor.search_dir\"" space
command-list-item-21 ::= scroll-up
publish-message ::= "{" space publish-message-command-name-kv "," space publish-message-args-kv "}" space
scroll-up ::= "{" space scroll-up-command-name-kv "," space scroll-up-args-kv "}" space
scroll-up-args ::= scroll-up-limitation
scroll-up-limitation ::= "{" space  "}" space
scroll-up-command-name-kv ::= "\"command_name\"" space ":" space scroll-up-command-name
scroll-up-command-name ::= "\"Editor.scroll_up\"" space
command-list-item-20 ::= scroll-down
scroll-down ::= "{" space scroll-down-command-name-kv "," space scroll-down-args-kv "}" space
read-command-name-kv ::= "\"command_name\"" space ":" space read-command-name
open-file ::= "{" space open-file-command-name-kv "," space open-file-args-kv "}" space
open-file-limitation ::= "{" space open-file-limitation-path-kv ( "," space ( open-file-limitation-line-number-kv open-file-limitation-line-number-rest | open-file-limitation-context-lines-kv ) )? "}" space
open-file-limitation-line-number-rest ::= ( "," space open-file-limitation-context-lines-kv )?
open-file-limitation-context-lines-kv ::= "\"context_lines\"" space ":" space open-file-limitation-context-lines
append-task-limitation-assignee-kv ::= "\"assignee\"" space ":" space string
open-file-limitation-line-number ::= integer | null
go-back-command-name-kv ::= "\"command_name\"" space ":" space go-back-command-name
open-file-limitation-path ::= string | string
reset-task-limitation-send-to-1-item-1 ::= "\"Alice\"" space
type-command-name-kv ::= "\"command_name\"" space ":" space type-command-name
open-file-command-name ::= "\"Editor.open_file\"" space
similarity-search-args-kv ::= "\"args\"" space ":" space similarity-search-args
insert-content-at-line-args ::= insert-content-at-line-limitation
insert-content-at-line-limitation ::= "{" space insert-content-at-line-limitation-file-name-kv "," space insert-content-at-line-limitation-line-number-kv "," space insert-content-at-line-limitation-insert-content-kv "}" space
go-back-limitation ::= "{" space  "}" space
insert-content-at-line-limitation-insert-content-kv ::= "\"insert_content\"" space ":" space string
insert-content-at-line-args-kv ::= "\"args\"" space ":" space insert-content-at-line-args
similarity-search ::= "{" space similarity-search-command-name-kv "," space similarity-search-args-kv "}" space
insert-content-at-line-limitation-line-number-kv ::= "\"line_number\"" space ":" space integer
insert-content-at-line-limitation-file-name-kv ::= "\"file_name\"" space ":" space string
insert-content-at-line-command-name ::= "\"Editor.insert_content_at_line\"" space
command-list-item-16 ::= goto-line
search-dir ::= "{" space search-dir-command-name-kv "," space search-dir-args-kv "}" space
goto-line-args ::= goto-line-limitation
goto-line-command-name-kv ::= "\"command_name\"" space ":" space goto-line-command-name
similarity-search-args ::= similarity-search-limitation
goto-line-args-kv ::= "\"args\"" space ":" space goto-line-args
goto-line-command-name ::= "\"Editor.goto_line\"" space
append-task-limitation ::= "{" space append-task-limitation-task-id-kv "," space append-task-limitation-dependent-task-ids-kv "," space append-task-limitation-instruction-kv "," space append-task-limitation-assignee-kv "," space append-task-limitation-task-type-kv "}" space
open-file-args ::= open-file-limitation
close-tab-args ::= close-tab-limitation
command-list-item-15 ::= find-file
find-file-args-kv ::= "\"args\"" space ":" space find-file-args
find-file-args ::= find-file-limitation
replace-task-limitation-new-dependent-task-ids ::= "[" space (string ("," space string){0,-1})? "]" space
find-file-limitation-dir-path-kv ::= "\"dir_path\"" space ":" space string
search-file-args-kv ::= "\"args\"" space ":" space search-file-args
find-file-command-name-kv ::= "\"command_name\"" space ":" space find-file-command-name
command-list-item-14 ::= edit-file-by-replace
scroll-down-command-name ::= "\"Editor.scroll_down\"" space
edit-file-by-replace-args-kv ::= "\"args\"" space ":" space edit-file-by-replace-args
command-list-item-18 ::= open-file
edit-file-by-replace-args ::= edit-file-by-replace-limitation
edit-file-by-replace-limitation ::= "{" space edit-file-by-replace-limitation-file-name-kv "," space edit-file-by-replace-limitation-first-replaced-line-number-kv "," space edit-file-by-replace-limitation-first-replaced-line-content-kv "," space edit-file-by-replace-limitation-last-replaced-line-number-kv "," space edit-file-by-replace-limitation-last-replaced-line-content-kv "," space edit-file-by-replace-limitation-new-content-kv "}" space
edit-file-by-replace-limitation-new-content-kv ::= "\"new_content\"" space ":" space string
edit-file-by-replace-limitation-last-replaced-line-number-kv ::= "\"last_replaced_line_number\"" space ":" space integer
replace-task-limitation ::= "{" space replace-task-limitation-task-id-kv "," space replace-task-limitation-new-dependent-task-ids-kv "," space replace-task-limitation-new-instruction-kv "," space replace-task-limitation-new-assignee-kv "}" space
read-limitation-path-kv ::= "\"path\"" space ":" space string
edit-file-by-replace-limitation-first-replaced-line-content-kv ::= "\"first_replaced_line_content\"" space ":" space string
null ::= "null" space
command-list-item-17 ::= insert-content-at-line
edit-file-by-replace-limitation-first-replaced-line-number-kv ::= "\"first_replaced_line_number\"" space ":" space integer
find-file-limitation ::= "{" space find-file-limitation-file-name-kv "," space find-file-limitation-dir-path-kv "}" space
edit-file-by-replace-limitation-file-name-kv ::= "\"file_name\"" space ":" space string
goto ::= "{" space goto-command-name-kv "," space goto-args-kv "}" space
edit-file-by-replace-command-name-kv ::= "\"command_name\"" space ":" space edit-file-by-replace-command-name
search-dir-limitation-search-term-kv ::= "\"search_term\"" space ":" space string
create-file ::= "{" space create-file-command-name-kv "," space create-file-args-kv "}" space
create-file-args ::= create-file-limitation
find-file-limitation-file-name-kv ::= "\"file_name\"" space ":" space string
create-file-limitation ::= "{" space create-file-limitation-filename-kv "}" space
press ::= "{" space press-command-name-kv "," space press-args-kv "}" space
tab-focus-args-kv ::= "\"args\"" space ":" space tab-focus-args
find-file ::= "{" space find-file-command-name-kv "," space find-file-args-kv "}" space
create-file-limitation-filename-kv ::= "\"filename\"" space ":" space string
read-args ::= read-limitation
create-file-command-name-kv ::= "\"command_name\"" space ":" space create-file-command-name
append-file-limitation ::= "{" space append-file-limitation-filename-kv "," space append-file-limitation-content-kv "}" space
char ::= [^"\\\x7F\x00-\x1F] | [\\] (["\\bfnrt] | "u" [0-9a-fA-F]{4})
append-file-limitation-content-kv ::= "\"content\"" space ":" space string
command-list-item-7 ::= hover
command-list-item-11 ::= type
type-args ::= type-limitation
write-command-name ::= "\"Editor.write\"" space
boolean ::= ("true" | "false") space
command-list-item-22 ::= search-dir
type-limitation-press-enter-after-kv ::= "\"press_enter_after\"" space ":" space boolean
go-back-args ::= go-back-limitation
type-limitation-content-kv ::= "\"content\"" space ":" space string
read-args-kv ::= "\"args\"" space ":" space read-args
command-list-item-10 ::= tab-focus
replace-task-command-name ::= "\"Plan.replace_task\"" space
tab-focus-args ::= tab-focus-limitation
tab-focus-limitation ::= "{" space tab-focus-limitation-page-number-kv "}" space
scroll ::= "{" space scroll-command-name-kv "," space scroll-args-kv "}" space
scroll-limitation-direction-kv ::= "\"direction\"" space ":" space scroll-limitation-direction
scroll-command-name ::= "\"Browser.scroll\"" space
write-args ::= write-limitation
append-file-command-name ::= "\"Editor.append_file\"" space
press-args-kv ::= "\"args\"" space ":" space press-args
append-file-command-name-kv ::= "\"command_name\"" space ":" space append-file-command-name
press-args ::= press-limitation
replace-task-args-kv ::= "\"args\"" space ":" space replace-task-args
press-limitation-key-comb-kv ::= "\"key_comb\"" space ":" space string
press-command-name ::= "\"Browser.press\"" space
edit-file-by-replace-command-name ::= "\"Editor.edit_file_by_replace\"" space
tab-focus-command-name ::= "\"Browser.tab_focus\"" space
hover ::= "{" space hover-command-name-kv "," space hover-args-kv "}" space
append-task-limitation-task-type-kv ::= "\"task_type\"" space ":" space string
scroll-down-args-kv ::= "\"args\"" space ":" space scroll-down-args
scroll-down-args ::= scroll-down-limitation
hover-args-kv ::= "\"args\"" space ":" space hover-args
read-limitation ::= "{" space read-limitation-path-kv "}" space
hover-args ::= hover-limitation
reset-task-limitation ::= "{" space reset-task-limitation-content-kv "," space reset-task-limitation-send-to-kv "}" space
hover-limitation ::= "{" space hover-limitation-element-id-kv "}" space
tab-focus ::= "{" space tab-focus-command-name-kv "," space tab-focus-args-kv "}" space
command-list-item-12 ::= append-file
goto-line-limitation-line-number-kv ::= "\"line_number\"" space ":" space integer
goto-command-name ::= "\"Browser.goto\"" space
goto-command-name-kv ::= "\"command_name\"" space ":" space goto-command-name
hover-command-name ::= "\"Browser.hover\"" space
command-list-item-13 ::= create-file
type ::= "{" space type-command-name-kv "," space type-args-kv "}" space
find-file-command-name ::= "\"Editor.find_file\"" space
goto-args-kv ::= "\"args\"" space ":" space goto-args
goto-args ::= goto-limitation
reset-task-limitation-send-to-1-item-5 ::= "\"Alex\"" space
scroll-down-limitation ::= "{" space  "}" space
press-limitation ::= "{" space press-limitation-key-comb-kv "}" space
command-list-item-1 ::= replace-task
tab-focus-limitation-page-number-kv ::= "\"page_number\"" space ":" space integer
decimal-part ::= [0-9]{1,16}
goto-line-limitation ::= "{" space goto-line-limitation-line-number-kv "}" space
hover-command-name-kv ::= "\"command_name\"" space ":" space hover-command-name
goto-limitation-timeout-kv ::= "\"timeout\"" space ":" space number
number ::= ("-"? integral-part) ("." decimal-part)? ([eE] [-+]? integral-part)? space
insert-content-at-line ::= "{" space insert-content-at-line-command-name-kv "," space insert-content-at-line-args-kv "}" space
goto-limitation-url-kv ::= "\"url\"" space ":" space string
type-limitation ::= "{" space type-limitation-element-id-kv "," space type-limitation-content-kv ( "," space ( type-limitation-press-enter-after-kv ) )? "}" space
append-file-limitation-filename-kv ::= "\"filename\"" space ":" space string
scroll-limitation-direction ::= ("\"down\"" | "\"up\"") space
scroll-limitation ::= "{" space scroll-limitation-direction-kv "}" space
command-list-item-5 ::= go-forward
open-file-limitation-line-number-kv ::= "\"line_number\"" space ":" space open-file-limitation-line-number
scroll-args ::= scroll-limitation
similarity-search-limitation-path-kv ::= "\"path\"" space ":" space similarity-search-limitation-path
command-list-item-6 ::= goto
go-forward-args-kv ::= "\"args\"" space ":" space go-forward-args
replace-task-limitation-new-assignee-kv ::= "\"new_assignee\"" space ":" space string
tab-focus-command-name-kv ::= "\"command_name\"" space ":" space tab-focus-command-name
go-forward-command-name ::= "\"Browser.go_forward\"" space
go-forward-args ::= go-forward-limitation
append-file-args ::= append-file-limitation
reset-task-limitation-send-to-1-item ::= reset-task-limitation-send-to-1-item-0 | reset-task-limitation-send-to-1-item-1 | reset-task-limitation-send-to-1-item-2 | reset-task-limitation-send-to-1-item-3 | reset-task-limitation-send-to-1-item-4 | reset-task-limitation-send-to-1-item-5 | reset-task-limitation-send-to-1-item-6 | reset-task-limitation-send-to-1-item-7
close-tab ::= "{" space close-tab-command-name-kv "," space close-tab-args-kv "}" space
command-list-item-4 ::= go-back
scroll-up-args-kv ::= "\"args\"" space ":" space scroll-up-args
append-task-limitation-task-id-kv ::= "\"task_id\"" space ":" space string
command-list-item-19 ::= read
append-file ::= "{" space append-file-command-name-kv "," space append-file-args-kv "}" space
append-task-args-kv ::= "\"args\"" space ":" space append-task-args
press-command-name-kv ::= "\"command_name\"" space ":" space press-command-name
insert-content-at-line-command-name-kv ::= "\"command_name\"" space ":" space insert-content-at-line-command-name
command-list-item-9 ::= scroll
goto-line ::= "{" space goto-line-command-name-kv "," space goto-line-args-kv "}" space
search-file-limitation-file-path-kv ::= "\"file_path\"" space ":" space search-file-limitation-file-path
command-list-item-3 ::= close-tab
hover-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer
go-forward-limitation ::= "{" space  "}" space
click-args ::= click-limitation
edit-file-by-replace ::= "{" space edit-file-by-replace-command-name-kv "," space edit-file-by-replace-args-kv "}" space
command-list-item-2 ::= click
command-list-item-0 ::= append-task
close-tab-args-kv ::= "\"args\"" space ":" space close-tab-args
replace-task-limitation-task-id-kv ::= "\"task_id\"" space ":" space string
close-tab-limitation ::= "{" space  "}" space
scroll-args-kv ::= "\"args\"" space ":" space scroll-args
create-file-command-name ::= "\"Editor.create_file\"" space
read ::= "{" space read-command-name-kv "," space read-args-kv "}" space
open-file-command-name-kv ::= "\"command_name\"" space ":" space open-file-command-name
append-file-args-kv ::= "\"args\"" space ":" space append-file-args
click-limitation ::= "{" space click-limitation-element-id-kv "}" space
click-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer
space ::= | " " | "\n"{1,2} [ \t]{0,20}
command-list-item-23 ::= search-file
append-task-limitation-dependent-task-ids-kv ::= "\"dependent_task_ids\"" space ":" space append-task-limitation-dependent-task-ids
click ::= "{" space click-command-name-kv "," space click-args-kv "}" space
read-command-name ::= "\"Editor.read\"" space
integer ::= ("-"? integral-part) space
scroll-command-name-kv ::= "\"command_name\"" space ":" space scroll-command-name
integral-part ::= [0] | [1-9] [0-9]{0,15}
replace-task ::= "{" space replace-task-command-name-kv "," space replace-task-args-kv "}" space
type-command-name ::= "\"Browser.type\"" space
replace-task-limitation-new-instruction-kv ::= "\"new_instruction\"" space ":" space string
command-list-item-8 ::= press
append-task-command-name ::= "\"Plan.append_task\"" space
click-command-name ::= "\"Browser.click\"" space
open-file-limitation-path-kv ::= "\"path\"" space ":" space open-file-limitation-path
replace-task-command-name-kv ::= "\"command_name\"" space ":" space replace-task-command-name
close-tab-command-name ::= "\"Browser.close_tab\"" space
replace-task-limitation-new-dependent-task-ids-kv ::= "\"new_dependent_task_ids\"" space ":" space replace-task-limitation-new-dependent-task-ids
scroll-down-command-name-kv ::= "\"command_name\"" space ":" space scroll-down-command-name
append-task ::= "{" space append-task-command-name-kv "," space append-task-args-kv "}" space
goto-limitation ::= "{" space goto-limitation-url-kv ( "," space ( goto-limitation-timeout-kv ) )? "}" space
replace-task-args ::= replace-task-limitation
publish-message-args ::= reset-task-limitation
create-file-args-kv ::= "\"args\"" space ":" space create-file-args
go-back-command-name ::= "\"Browser.go_back\"" space
go-forward-command-name-kv ::= "\"command_name\"" space ":" space go-forward-command-name
append-task-args ::= append-task-limitation
append-task-command-name-kv ::= "\"command_name\"" space ":" space append-task-command-name
append-task-limitation-dependent-task-ids ::= "[" space (string ("," space string){0,-1})? "]" space
go-back ::= "{" space go-back-command-name-kv "," space go-back-args-kv "}" space
click-command-name-kv ::= "\"command_name\"" space ":" space click-command-name
open-file-args-kv ::= "\"args\"" space ":" space open-file-args
append-task-limitation-instruction-kv ::= "\"instruction\"" space ":" space string
type-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer
click-args-kv ::= "\"args\"" space ":" space click-args
edit-file-by-replace-limitation-last-replaced-line-content-kv ::= "\"last_replaced_line_content\"" space ":" space string
type-args-kv ::= "\"args\"" space ":" space type-args
close-tab-command-name-kv ::= "\"command_name\"" space ":" space close-tab-command-name
write-limitation-path-kv ::= "\"path\"" space ":" space string
string ::= "\"" char* "\"" space
go-forward ::= "{" space go-forward-command-name-kv "," space go-forward-args-kv "}" space
open-file-limitation-context-lines ::= integer | null
go-back-args-kv ::= "\"args\"" space ":" space go-back-args
mental-activity-kv ::= "\"mental_activity\"" space ":" space string

llama_grammar_init_impl: failed to parse grammar
time=2025-04-25T13:21:36.702+08:00 level=INFO source=server.go:789 msg="llm predict error: Failed to create new sequence: unable to create sampling context"
[GIN] 2025/04/25 - 13:21:36 | 200 |    6.4494062s |       127.0.0.1 | POST     "/api/chat"

OS

Windows

GPU

Nvidia

CPU

Intel

Ollama version

0.6.6

Originally created by @Ritanlisa on GitHub (Apr 25, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10400 ### What is the issue? I've sent a long POST request (24015Bytes) for format limitation, but ollama didn't responce my arguments correctly can any arguments to be settled to break that limit? argument "format" value is auto-generated by pydantic ： [format.json](https://github.com/user-attachments/files/19903350/format.json) ### Relevant log output ```shell 2025/04/25 13:21:08 routes.go:1232: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:2048 OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\Ritanlisa\\.ollama\\models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES:]" time=2025-04-25T13:21:08.833+08:00 level=INFO source=images.go:458 msg="total blobs: 16" time=2025-04-25T13:21:08.834+08:00 level=INFO source=images.go:465 msg="total unused blobs removed: 0" time=2025-04-25T13:21:08.835+08:00 level=INFO source=routes.go:1299 msg="Listening on 127.0.0.1:11434 (version 0.6.6)" time=2025-04-25T13:21:08.835+08:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs" time=2025-04-25T13:21:08.835+08:00 level=INFO source=gpu_windows.go:167 msg=packages count=1 time=2025-04-25T13:21:08.835+08:00 level=INFO source=gpu_windows.go:214 msg="" package=0 cores=8 efficiency=0 threads=16 time=2025-04-25T13:21:08.950+08:00 level=INFO source=gpu.go:319 msg="detected OS VRAM overhead" id=GPU-c0217016-16e3-acb8-c227-70157abf3f5a library=cuda compute=8.6 driver=12.7 name="NVIDIA GeForce RTX 3050 Laptop GPU" overhead="479.5 MiB" time=2025-04-25T13:21:08.952+08:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-c0217016-16e3-acb8-c227-70157abf3f5a library=cuda variant=v12 compute=8.6 driver=12.7 name="NVIDIA GeForce RTX 3050 Laptop GPU" total="4.0 GiB" available="3.2 GiB" time=2025-04-25T13:21:30.271+08:00 level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-25T13:21:30.299+08:00 level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-25T13:21:30.313+08:00 level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-25T13:21:30.314+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.vision.block_count default=0 time=2025-04-25T13:21:30.330+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.331+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.331+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.331+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.332+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.vision.block_count default=0 time=2025-04-25T13:21:30.346+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.346+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.347+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.347+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.348+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.vision.block_count default=0 time=2025-04-25T13:21:30.360+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.362+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.362+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.362+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.362+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.vision.block_count default=0 time=2025-04-25T13:21:30.376+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.376+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.376+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.376+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.392+08:00 level=INFO source=server.go:105 msg="system memory" total="15.8 GiB" free="4.2 GiB" free_swap="30.0 GiB" time=2025-04-25T13:21:30.392+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.vision.block_count default=0 time=2025-04-25T13:21:30.407+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.407+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.407+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.407+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.408+08:00 level=INFO source=server.go:138 msg=offload library=cuda layers.requested=-1 layers.model=33 layers.offload=15 layers.split="" memory.available="[3.2 GiB]" memory.gpu_overhead="0 B" memory.required.full="5.9 GiB" memory.required.partial="3.2 GiB" memory.required.kv="256.0 MiB" memory.required.allocations="[3.2 GiB]" memory.weights.total="4.3 GiB" memory.weights.repeating="3.9 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="258.5 MiB" memory.graph.partial="677.5 MiB" time=2025-04-25T13:21:30.408+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.key_length default=128 time=2025-04-25T13:21:30.408+08:00 level=WARN source=ggml.go:152 msg="key not found" key=llama.attention.value_length default=128 time=2025-04-25T13:21:30.408+08:00 level=INFO source=server.go:185 msg="enabling flash attention" time=2025-04-25T13:21:30.408+08:00 level=WARN source=server.go:193 msg="kv cache type not supported by model" type="" llama_model_loader: loaded meta data with 28 key-value pairs and 292 tensors from C:\Users\Ritanlisa\.ollama\models\blobs\sha256-6340dc3229b0d08ea9cc49b75d4098702983e17b4c096d57afbbf2ffc813f2be (version GGUF V3 (latest)) llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. llama_model_loader: - kv 0: general.architecture str = llama llama_model_loader: - kv 1: general.type str = model llama_model_loader: - kv 2: general.name str = DeepSeek R1 Distill Llama 8B llama_model_loader: - kv 3: general.basename str = DeepSeek-R1-Distill-Llama llama_model_loader: - kv 4: general.size_label str = 8B llama_model_loader: - kv 5: llama.block_count u32 = 32 llama_model_loader: - kv 6: llama.context_length u32 = 131072 llama_model_loader: - kv 7: llama.embedding_length u32 = 4096 llama_model_loader: - kv 8: llama.feed_forward_length u32 = 14336 llama_model_loader: - kv 9: llama.attention.head_count u32 = 32 llama_model_loader: - kv 10: llama.attention.head_count_kv u32 = 8 llama_model_loader: - kv 11: llama.rope.freq_base f32 = 500000.000000 llama_model_loader: - kv 12: llama.attention.layer_norm_rms_epsilon f32 = 0.000010 llama_model_loader: - kv 13: general.file_type u32 = 15 llama_model_loader: - kv 14: llama.vocab_size u32 = 128256 llama_model_loader: - kv 15: llama.rope.dimension_count u32 = 128 llama_model_loader: - kv 16: tokenizer.ggml.model str = gpt2 llama_model_loader: - kv 17: tokenizer.ggml.pre str = llama-bpe llama_model_loader: - kv 18: tokenizer.ggml.tokens arr[str,128256] = ["!", "\"", "#", "$", "%", "&", "'", ... llama_model_loader: - kv 19: tokenizer.ggml.token_type arr[i32,128256] = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ... llama_model_loader: - kv 20: tokenizer.ggml.merges arr[str,280147] = ["Ġ Ġ", "Ġ ĠĠĠ", "ĠĠ ĠĠ", "... llama_model_loader: - kv 21: tokenizer.ggml.bos_token_id u32 = 128000 llama_model_loader: - kv 22: tokenizer.ggml.eos_token_id u32 = 128001 llama_model_loader: - kv 23: tokenizer.ggml.padding_token_id u32 = 128001 llama_model_loader: - kv 24: tokenizer.ggml.add_bos_token bool = true llama_model_loader: - kv 25: tokenizer.ggml.add_eos_token bool = false llama_model_loader: - kv 26: tokenizer.chat_template str = {% if not add_generation_prompt is de... llama_model_loader: - kv 27: general.quantization_version u32 = 2 llama_model_loader: - type f32: 66 tensors llama_model_loader: - type q4_K: 193 tensors llama_model_loader: - type q6_K: 33 tensors print_info: file format = GGUF V3 (latest) print_info: file type = Q4_K - Medium print_info: file size = 4.58 GiB (4.89 BPW) load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect load: special tokens cache size = 256 load: token to piece cache size = 0.7999 MB print_info: arch = llama print_info: vocab_only = 1 print_info: model type = ?B print_info: model params = 8.03 B print_info: general.name = DeepSeek R1 Distill Llama 8B print_info: vocab type = BPE print_info: n_vocab = 128256 print_info: n_merges = 280147 print_info: BOS token = 128000 '<｜begin▁of▁sentence｜>' print_info: EOS token = 128001 '<｜end▁of▁sentence｜>' print_info: EOT token = 128001 '<｜end▁of▁sentence｜>' print_info: EOM token = 128008 '<|eom_id|>' print_info: PAD token = 128001 '<｜end▁of▁sentence｜>' print_info: LF token = 198 'Ċ' print_info: EOG token = 128001 '<｜end▁of▁sentence｜>' print_info: EOG token = 128008 '<|eom_id|>' print_info: EOG token = 128009 '<|eot_id|>' print_info: max token length = 256 llama_model_load: vocab only - skipping tensors time=2025-04-25T13:21:30.653+08:00 level=INFO source=server.go:405 msg="starting llama server" cmd="C:\\Users\\Ritanlisa\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --model C:\\Users\\Ritanlisa\\.ollama\\models\\blobs\\sha256-6340dc3229b0d08ea9cc49b75d4098702983e17b4c096d57afbbf2ffc813f2be --ctx-size 2048 --batch-size 512 --n-gpu-layers 15 --threads 8 --flash-attn --no-mmap --parallel 1 --port 58592" time=2025-04-25T13:21:30.659+08:00 level=INFO source=sched.go:451 msg="loaded runners" count=1 time=2025-04-25T13:21:30.659+08:00 level=INFO source=server.go:580 msg="waiting for llama runner to start responding" time=2025-04-25T13:21:30.659+08:00 level=INFO source=server.go:614 msg="waiting for server to become available" status="llm server error" time=2025-04-25T13:21:30.696+08:00 level=INFO source=runner.go:853 msg="starting go runner" ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 3050 Laptop GPU, compute capability 8.6, VMM: yes load_backend: loaded CUDA backend from C:\Users\Ritanlisa\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12\ggml-cuda.dll load_backend: loaded CPU backend from C:\Users\Ritanlisa\AppData\Local\Programs\Ollama\lib\ollama\ggml-cpu-icelake.dll time=2025-04-25T13:21:30.812+08:00 level=INFO source=ggml.go:109 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.AVX512=1 CPU.0.AVX512_VBMI=1 CPU.0.AVX512_VNNI=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(clang) time=2025-04-25T13:21:30.813+08:00 level=INFO source=runner.go:913 msg="Server listening on 127.0.0.1:58592" llama_model_load_from_file_impl: using device CUDA0 (NVIDIA GeForce RTX 3050 Laptop GPU) - 3303 MiB free llama_model_loader: loaded meta data with 28 key-value pairs and 292 tensors from C:\Users\Ritanlisa\.ollama\models\blobs\sha256-6340dc3229b0d08ea9cc49b75d4098702983e17b4c096d57afbbf2ffc813f2be (version GGUF V3 (latest)) llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. llama_model_loader: - kv 0: general.architecture str = llama llama_model_loader: - kv 1: general.type str = model llama_model_loader: - kv 2: general.name str = DeepSeek R1 Distill Llama 8B llama_model_loader: - kv 3: general.basename str = DeepSeek-R1-Distill-Llama llama_model_loader: - kv 4: general.size_label str = 8B llama_model_loader: - kv 5: llama.block_count u32 = 32 llama_model_loader: - kv 6: llama.context_length u32 = 131072 llama_model_loader: - kv 7: llama.embedding_length u32 = 4096 llama_model_loader: - kv 8: llama.feed_forward_length u32 = 14336 llama_model_loader: - kv 9: llama.attention.head_count u32 = 32 llama_model_loader: - kv 10: llama.attention.head_count_kv u32 = 8 llama_model_loader: - kv 11: llama.rope.freq_base f32 = 500000.000000 llama_model_loader: - kv 12: llama.attention.layer_norm_rms_epsilon f32 = 0.000010 llama_model_loader: - kv 13: general.file_type u32 = 15 llama_model_loader: - kv 14: llama.vocab_size u32 = 128256 llama_model_loader: - kv 15: llama.rope.dimension_count u32 = 128 llama_model_loader: - kv 16: tokenizer.ggml.model str = gpt2 llama_model_loader: - kv 17: tokenizer.ggml.pre str = llama-bpe llama_model_loader: - kv 18: tokenizer.ggml.tokens arr[str,128256] = ["!", "\"", "#", "$", "%", "&", "'", ... time=2025-04-25T13:21:30.911+08:00 level=INFO source=server.go:614 msg="waiting for server to become available" status="llm server loading model" llama_model_loader: - kv 19: tokenizer.ggml.token_type arr[i32,128256] = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ... llama_model_loader: - kv 20: tokenizer.ggml.merges arr[str,280147] = ["Ġ Ġ", "Ġ ĠĠĠ", "ĠĠ ĠĠ", "... llama_model_loader: - kv 21: tokenizer.ggml.bos_token_id u32 = 128000 llama_model_loader: - kv 22: tokenizer.ggml.eos_token_id u32 = 128001 llama_model_loader: - kv 23: tokenizer.ggml.padding_token_id u32 = 128001 llama_model_loader: - kv 24: tokenizer.ggml.add_bos_token bool = true llama_model_loader: - kv 25: tokenizer.ggml.add_eos_token bool = false llama_model_loader: - kv 26: tokenizer.chat_template str = {% if not add_generation_prompt is de... llama_model_loader: - kv 27: general.quantization_version u32 = 2 llama_model_loader: - type f32: 66 tensors llama_model_loader: - type q4_K: 193 tensors llama_model_loader: - type q6_K: 33 tensors print_info: file format = GGUF V3 (latest) print_info: file type = Q4_K - Medium print_info: file size = 4.58 GiB (4.89 BPW) load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect load: special tokens cache size = 256 load: token to piece cache size = 0.7999 MB print_info: arch = llama print_info: vocab_only = 0 print_info: n_ctx_train = 131072 print_info: n_embd = 4096 print_info: n_layer = 32 print_info: n_head = 32 print_info: n_head_kv = 8 print_info: n_rot = 128 print_info: n_swa = 0 print_info: n_swa_pattern = 1 print_info: n_embd_head_k = 128 print_info: n_embd_head_v = 128 print_info: n_gqa = 4 print_info: n_embd_k_gqa = 1024 print_info: n_embd_v_gqa = 1024 print_info: f_norm_eps = 0.0e+00 print_info: f_norm_rms_eps = 1.0e-05 print_info: f_clamp_kqv = 0.0e+00 print_info: f_max_alibi_bias = 0.0e+00 print_info: f_logit_scale = 0.0e+00 print_info: f_attn_scale = 0.0e+00 print_info: n_ff = 14336 print_info: n_expert = 0 print_info: n_expert_used = 0 print_info: causal attn = 1 print_info: pooling type = 0 print_info: rope type = 0 print_info: rope scaling = linear print_info: freq_base_train = 500000.0 print_info: freq_scale_train = 1 print_info: n_ctx_orig_yarn = 131072 print_info: rope_finetuned = unknown print_info: ssm_d_conv = 0 print_info: ssm_d_inner = 0 print_info: ssm_d_state = 0 print_info: ssm_dt_rank = 0 print_info: ssm_dt_b_c_rms = 0 print_info: model type = 8B print_info: model params = 8.03 B print_info: general.name = DeepSeek R1 Distill Llama 8B print_info: vocab type = BPE print_info: n_vocab = 128256 print_info: n_merges = 280147 print_info: BOS token = 128000 '<｜begin▁of▁sentence｜>' print_info: EOS token = 128001 '<｜end▁of▁sentence｜>' print_info: EOT token = 128001 '<｜end▁of▁sentence｜>' print_info: EOM token = 128008 '<|eom_id|>' print_info: PAD token = 128001 '<｜end▁of▁sentence｜>' print_info: LF token = 198 'Ċ' print_info: EOG token = 128001 '<｜end▁of▁sentence｜>' print_info: EOG token = 128008 '<|eom_id|>' print_info: EOG token = 128009 '<|eot_id|>' print_info: max token length = 256 load_tensors: loading model tensors, this can take a while... (mmap = false) load_tensors: offloading 15 repeating layers to GPU load_tensors: offloaded 15/33 layers to GPU load_tensors: CPU model buffer size = 281.81 MiB load_tensors: CUDA_Host model buffer size = 2524.27 MiB load_tensors: CUDA0 model buffer size = 1879.22 MiB llama_context: constructing llama_context llama_context: n_seq_max = 1 llama_context: n_ctx = 2048 llama_context: n_ctx_per_seq = 2048 llama_context: n_batch = 512 llama_context: n_ubatch = 512 llama_context: causal_attn = 1 llama_context: flash_attn = 1 llama_context: freq_base = 500000.0 llama_context: freq_scale = 1 llama_context: n_ctx_per_seq (2048) < n_ctx_train (131072) -- the full capacity of the model will not be utilized llama_context: CPU output buffer size = 0.50 MiB init: kv_size = 2048, offload = 1, type_k = 'f16', type_v = 'f16', n_layer = 32, can_shift = 1 init: CPU KV buffer size = 136.00 MiB init: CUDA0 KV buffer size = 120.00 MiB llama_context: KV self size = 256.00 MiB, K (f16): 128.00 MiB, V (f16): 128.00 MiB llama_context: CUDA0 compute buffer size = 669.48 MiB llama_context: CUDA_Host compute buffer size = 12.01 MiB llama_context: graph nodes = 967 llama_context: graph splits = 192 (with bs=512), 3 (with bs=1) time=2025-04-25T13:21:36.676+08:00 level=INFO source=server.go:619 msg="llama runner started in 6.02 seconds" parse: error parsing grammar: expecting '}' at -1})? "]" space find-file-limitation-dir-path-kv ::= "\"dir_path\"" space ":" space string search-file-args-kv ::= "\"args\"" space ":" space search-file-args find-file-command-name-kv ::= "\"command_name\"" space ":" space find-file-command-name command-list-item-14 ::= edit-file-by-replace scroll-down-command-name ::= "\"Editor.scroll_down\"" space edit-file-by-replace-args-kv ::= "\"args\"" space ":" space edit-file-by-replace-args command-list-item-18 ::= open-file edit-file-by-replace-args ::= edit-file-by-replace-limitation edit-file-by-replace-limitation ::= "{" space edit-file-by-replace-limitation-file-name-kv "," space edit-file-by-replace-limitation-first-replaced-line-number-kv "," space edit-file-by-replace-limitation-first-replaced-line-content-kv "," space edit-file-by-replace-limitation-last-replaced-line-number-kv "," space edit-file-by-replace-limitation-last-replaced-line-content-kv "," space edit-file-by-replace-limitation-new-content-kv "}" space edit-file-by-replace-limitation-new-content-kv ::= "\"new_content\"" space ":" space string edit-file-by-replace-limitation-last-replaced-line-number-kv ::= "\"last_replaced_line_number\"" space ":" space integer replace-task-limitation ::= "{" space replace-task-limitation-task-id-kv "," space replace-task-limitation-new-dependent-task-ids-kv "," space replace-task-limitation-new-instruction-kv "," space replace-task-limitation-new-assignee-kv "}" space read-limitation-path-kv ::= "\"path\"" space ":" space string edit-file-by-replace-limitation-first-replaced-line-content-kv ::= "\"first_replaced_line_content\"" space ":" space string null ::= "null" space command-list-item-17 ::= insert-content-at-line edit-file-by-replace-limitation-first-replaced-line-number-kv ::= "\"first_replaced_line_number\"" space ":" space integer find-file-limitation ::= "{" space find-file-limitation-file-name-kv "," space find-file-limitation-dir-path-kv "}" space edit-file-by-replace-limitation-file-name-kv ::= "\"file_name\"" space ":" space string goto ::= "{" space goto-command-name-kv "," space goto-args-kv "}" space edit-file-by-replace-command-name-kv ::= "\"command_name\"" space ":" space edit-file-by-replace-command-name search-dir-limitation-search-term-kv ::= "\"search_term\"" space ":" space string create-file ::= "{" space create-file-command-name-kv "," space create-file-args-kv "}" space create-file-args ::= create-file-limitation find-file-limitation-file-name-kv ::= "\"file_name\"" space ":" space string create-file-limitation ::= "{" space create-file-limitation-filename-kv "}" space press ::= "{" space press-command-name-kv "," space press-args-kv "}" space tab-focus-args-kv ::= "\"args\"" space ":" space tab-focus-args find-file ::= "{" space find-file-command-name-kv "," space find-file-args-kv "}" space create-file-limitation-filename-kv ::= "\"filename\"" space ":" space string read-args ::= read-limitation create-file-command-name-kv ::= "\"command_name\"" space ":" space create-file-command-name append-file-limitation ::= "{" space append-file-limitation-filename-kv "," space append-file-limitation-content-kv "}" space char ::= [^"\\\x7F\x00-\x1F] | [\\] (["\\bfnrt] | "u" [0-9a-fA-F]{4}) append-file-limitation-content-kv ::= "\"content\"" space ":" space string command-list-item-7 ::= hover command-list-item-11 ::= type type-args ::= type-limitation write-command-name ::= "\"Editor.write\"" space boolean ::= ("true" | "false") space command-list-item-22 ::= search-dir type-limitation-press-enter-after-kv ::= "\"press_enter_after\"" space ":" space boolean go-back-args ::= go-back-limitation type-limitation-content-kv ::= "\"content\"" space ":" space string read-args-kv ::= "\"args\"" space ":" space read-args command-list-item-10 ::= tab-focus replace-task-command-name ::= "\"Plan.replace_task\"" space tab-focus-args ::= tab-focus-limitation tab-focus-limitation ::= "{" space tab-focus-limitation-page-number-kv "}" space scroll ::= "{" space scroll-command-name-kv "," space scroll-args-kv "}" space scroll-limitation-direction-kv ::= "\"direction\"" space ":" space scroll-limitation-direction scroll-command-name ::= "\"Browser.scroll\"" space write-args ::= write-limitation append-file-command-name ::= "\"Editor.append_file\"" space press-args-kv ::= "\"args\"" space ":" space press-args append-file-command-name-kv ::= "\"command_name\"" space ":" space append-file-command-name press-args ::= press-limitation replace-task-args-kv ::= "\"args\"" space ":" space replace-task-args press-limitation-key-comb-kv ::= "\"key_comb\"" space ":" space string press-command-name ::= "\"Browser.press\"" space edit-file-by-replace-command-name ::= "\"Editor.edit_file_by_replace\"" space tab-focus-command-name ::= "\"Browser.tab_focus\"" space hover ::= "{" space hover-command-name-kv "," space hover-args-kv "}" space append-task-limitation-task-type-kv ::= "\"task_type\"" space ":" space string scroll-down-args-kv ::= "\"args\"" space ":" space scroll-down-args scroll-down-args ::= scroll-down-limitation hover-args-kv ::= "\"args\"" space ":" space hover-args read-limitation ::= "{" space read-limitation-path-kv "}" space hover-args ::= hover-limitation reset-task-limitation ::= "{" space reset-task-limitation-content-kv "," space reset-task-limitation-send-to-kv "}" space hover-limitation ::= "{" space hover-limitation-element-id-kv "}" space tab-focus ::= "{" space tab-focus-command-name-kv "," space tab-focus-args-kv "}" space command-list-item-12 ::= append-file goto-line-limitation-line-number-kv ::= "\"line_number\"" space ":" space integer goto-command-name ::= "\"Browser.goto\"" space goto-command-name-kv ::= "\"command_name\"" space ":" space goto-command-name hover-command-name ::= "\"Browser.hover\"" space command-list-item-13 ::= create-file type ::= "{" space type-command-name-kv "," space type-args-kv "}" space find-file-command-name ::= "\"Editor.find_file\"" space goto-args-kv ::= "\"args\"" space ":" space goto-args goto-args ::= goto-limitation reset-task-limitation-send-to-1-item-5 ::= "\"Alex\"" space scroll-down-limitation ::= "{" space "}" space press-limitation ::= "{" space press-limitation-key-comb-kv "}" space command-list-item-1 ::= replace-task tab-focus-limitation-page-number-kv ::= "\"page_number\"" space ":" space integer decimal-part ::= [0-9]{1,16} goto-line-limitation ::= "{" space goto-line-limitation-line-number-kv "}" space hover-command-name-kv ::= "\"command_name\"" space ":" space hover-command-name goto-limitation-timeout-kv ::= "\"timeout\"" space ":" space number number ::= ("-"? integral-part) ("." decimal-part)? ([eE] [-+]? integral-part)? space insert-content-at-line ::= "{" space insert-content-at-line-command-name-kv "," space insert-content-at-line-args-kv "}" space goto-limitation-url-kv ::= "\"url\"" space ":" space string type-limitation ::= "{" space type-limitation-element-id-kv "," space type-limitation-content-kv ( "," space ( type-limitation-press-enter-after-kv ) )? "}" space append-file-limitation-filename-kv ::= "\"filename\"" space ":" space string scroll-limitation-direction ::= ("\"down\"" | "\"up\"") space scroll-limitation ::= "{" space scroll-limitation-direction-kv "}" space command-list-item-5 ::= go-forward open-file-limitation-line-number-kv ::= "\"line_number\"" space ":" space open-file-limitation-line-number scroll-args ::= scroll-limitation similarity-search-limitation-path-kv ::= "\"path\"" space ":" space similarity-search-limitation-path command-list-item-6 ::= goto go-forward-args-kv ::= "\"args\"" space ":" space go-forward-args replace-task-limitation-new-assignee-kv ::= "\"new_assignee\"" space ":" space string tab-focus-command-name-kv ::= "\"command_name\"" space ":" space tab-focus-command-name go-forward-command-name ::= "\"Browser.go_forward\"" space go-forward-args ::= go-forward-limitation append-file-args ::= append-file-limitation reset-task-limitation-send-to-1-item ::= reset-task-limitation-send-to-1-item-0 | reset-task-limitation-send-to-1-item-1 | reset-task-limitation-send-to-1-item-2 | reset-task-limitation-send-to-1-item-3 | reset-task-limitation-send-to-1-item-4 | reset-task-limitation-send-to-1-item-5 | reset-task-limitation-send-to-1-item-6 | reset-task-limitation-send-to-1-item-7 close-tab ::= "{" space close-tab-command-name-kv "," space close-tab-args-kv "}" space command-list-item-4 ::= go-back scroll-up-args-kv ::= "\"args\"" space ":" space scroll-up-args append-task-limitation-task-id-kv ::= "\"task_id\"" space ":" space string command-list-item-19 ::= read append-file ::= "{" space append-file-command-name-kv "," space append-file-args-kv "}" space append-task-args-kv ::= "\"args\"" space ":" space append-task-args press-command-name-kv ::= "\"command_name\"" space ":" space press-command-name insert-content-at-line-command-name-kv ::= "\"command_name\"" space ":" space insert-content-at-line-command-name command-list-item-9 ::= scroll goto-line ::= "{" space goto-line-command-name-kv "," space goto-line-args-kv "}" space search-file-limitation-file-path-kv ::= "\"file_path\"" space ":" space search-file-limitation-file-path command-list-item-3 ::= close-tab hover-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer go-forward-limitation ::= "{" space "}" space click-args ::= click-limitation edit-file-by-replace ::= "{" space edit-file-by-replace-command-name-kv "," space edit-file-by-replace-args-kv "}" space command-list-item-2 ::= click command-list-item-0 ::= append-task close-tab-args-kv ::= "\"args\"" space ":" space close-tab-args replace-task-limitation-task-id-kv ::= "\"task_id\"" space ":" space string close-tab-limitation ::= "{" space "}" space scroll-args-kv ::= "\"args\"" space ":" space scroll-args create-file-command-name ::= "\"Editor.create_file\"" space read ::= "{" space read-command-name-kv "," space read-args-kv "}" space open-file-command-name-kv ::= "\"command_name\"" space ":" space open-file-command-name append-file-args-kv ::= "\"args\"" space ":" space append-file-args click-limitation ::= "{" space click-limitation-element-id-kv "}" space click-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer space ::= | " " | "\n"{1,2} [ \t]{0,20} command-list-item-23 ::= search-file append-task-limitation-dependent-task-ids-kv ::= "\"dependent_task_ids\"" space ":" space append-task-limitation-dependent-task-ids click ::= "{" space click-command-name-kv "," space click-args-kv "}" space read-command-name ::= "\"Editor.read\"" space integer ::= ("-"? integral-part) space scroll-command-name-kv ::= "\"command_name\"" space ":" space scroll-command-name integral-part ::= [0] | [1-9] [0-9]{0,15} replace-task ::= "{" space replace-task-command-name-kv "," space replace-task-args-kv "}" space type-command-name ::= "\"Browser.type\"" space replace-task-limitation-new-instruction-kv ::= "\"new_instruction\"" space ":" space string command-list-item-8 ::= press append-task-command-name ::= "\"Plan.append_task\"" space click-command-name ::= "\"Browser.click\"" space open-file-limitation-path-kv ::= "\"path\"" space ":" space open-file-limitation-path replace-task-command-name-kv ::= "\"command_name\"" space ":" space replace-task-command-name close-tab-command-name ::= "\"Browser.close_tab\"" space replace-task-limitation-new-dependent-task-ids-kv ::= "\"new_dependent_task_ids\"" space ":" space replace-task-limitation-new-dependent-task-ids scroll-down-command-name-kv ::= "\"command_name\"" space ":" space scroll-down-command-name append-task ::= "{" space append-task-command-name-kv "," space append-task-args-kv "}" space goto-limitation ::= "{" space goto-limitation-url-kv ( "," space ( goto-limitation-timeout-kv ) )? "}" space replace-task-args ::= replace-task-limitation publish-message-args ::= reset-task-limitation create-file-args-kv ::= "\"args\"" space ":" space create-file-args go-back-command-name ::= "\"Browser.go_back\"" space go-forward-command-name-kv ::= "\"command_name\"" space ":" space go-forward-command-name append-task-args ::= append-task-limitation append-task-command-name-kv ::= "\"command_name\"" space ":" space append-task-command-name append-task-limitation-dependent-task-ids ::= "[" space (string ("," space string){0,-1})? "]" space go-back ::= "{" space go-back-command-name-kv "," space go-back-args-kv "}" space click-command-name-kv ::= "\"command_name\"" space ":" space click-command-name open-file-args-kv ::= "\"args\"" space ":" space open-file-args append-task-limitation-instruction-kv ::= "\"instruction\"" space ":" space string type-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer click-args-kv ::= "\"args\"" space ":" space click-args edit-file-by-replace-limitation-last-replaced-line-content-kv ::= "\"last_replaced_line_content\"" space ":" space string type-args-kv ::= "\"args\"" space ":" space type-args close-tab-command-name-kv ::= "\"command_name\"" space ":" space close-tab-command-name write-limitation-path-kv ::= "\"path\"" space ":" space string string ::= "\"" char* "\"" space go-forward ::= "{" space go-forward-command-name-kv "," space go-forward-args-kv "}" space open-file-limitation-context-lines ::= integer | null go-back-args-kv ::= "\"args\"" space ":" space go-back-args mental-activity-kv ::= "\"mental_activity\"" space ":" space string root ::= "{" space mental-activity-kv "," space command-list-kv "}" space command-list-kv ::= "\"command_list\"" space ":" space command-list command-list-item ::= command-list-item-0 | command-list-item-1 | command-list-item-2 | command-list-item-3 | command-list-item-4 | command-list-item-5 | command-list-item-6 | command-list-item-7 | command-list-item-8 | command-list-item-9 | command-list-item-10 | command-list-item-11 | command-list-item-12 | command-list-item-13 | command-list-item-14 | command-list-item-15 | command-list-item-16 | command-list-item-17 | command-list-item-18 | command-list-item-19 | command-list-item-20 | command-list-item-21 | command-list-item-22 | command-list-item-23 | command-list-item-24 | command-list-item-25 | command-list-item-26 | command-list-item-27 command-list-item-27 ::= publish-message publish-message-command-name-kv ::= "\"command_name\"" space ":" space publish-message-command-name publish-message-command-name ::= "\"TeamLeader.publish_message\"" space command-list-item-26 ::= publish-team-message publish-team-message ::= "{" space publish-team-message-command-name-kv "," space publish-team-message-args-kv "}" space publish-team-message-args-kv ::= "\"args\"" space ":" space publish-team-message-args publish-team-message-args ::= reset-task-limitation reset-task-limitation-send-to-kv ::= "\"send_to\"" space ":" space reset-task-limitation-send-to reset-task-limitation-send-to ::= reset-task-limitation-send-to-0 | reset-task-limitation-send-to-1 reset-task-limitation-send-to-1 ::= "[" space (reset-task-limitation-send-to-1-item ("," space reset-task-limitation-send-to-1-item)*)? "]" space reset-task-limitation-send-to-1-item-7 ::= "\"metagpt.roles.di.data_analyst.DataAnalyst\"" space reset-task-limitation-send-to-1-item-6 ::= "\"David\"" space reset-task-limitation-send-to-1-item-4 ::= "\"metagpt.roles.di.engineer2.Engineer2\"" space reset-task-limitation-send-to-1-item-3 ::= "\"metagpt.roles.architect.Architect\"" space reset-task-limitation-send-to-1-item-2 ::= "\"Bob\"" space reset-task-limitation-send-to-1-item-0 ::= "\"metagpt.roles.product_manager.ProductManager\"" space reset-task-limitation-send-to-0 ::= "\"<all>\"" space publish-message-args-kv ::= "\"args\"" space ":" space publish-message-args reset-task-limitation-content-kv ::= "\"content\"" space ":" space string publish-team-message-command-name-kv ::= "\"command_name\"" space ":" space publish-team-message-command-name publish-team-message-command-name ::= "\"TeamLeader.publish_team_message\"" space write ::= "{" space write-command-name-kv "," space write-args-kv "}" space write-args-kv ::= "\"args\"" space ":" space write-args write-limitation ::= "{" space write-limitation-path-kv "," space write-limitation-content-kv "}" space write-limitation-content-kv ::= "\"content\"" space ":" space string write-command-name-kv ::= "\"command_name\"" space ":" space write-command-name command-list-item-24 ::= similarity-search similarity-search-limitation ::= "{" space similarity-search-limitation-query-kv "," space similarity-search-limitation-path-kv "}" space similarity-search-limitation-path ::= string | string similarity-search-limitation-query-kv ::= "\"query\"" space ":" space string command-list ::= "[" space (command-list-item ("," space command-list-item)*)? "]" space similarity-search-command-name-kv ::= "\"command_name\"" space ":" space similarity-search-command-name similarity-search-command-name ::= "\"Editor.similarity_search\"" space search-file ::= "{" space search-file-command-name-kv "," space search-file-args-kv "}" space search-file-args ::= search-file-limitation search-file-limitation ::= "{" space search-file-limitation-search-term-kv "," space search-file-limitation-file-path-kv "}" space search-file-limitation-file-path ::= string | null search-file-limitation-search-term-kv ::= "\"search_term\"" space ":" space string search-file-command-name-kv ::= "\"command_name\"" space ":" space search-file-command-name search-file-command-name ::= "\"Editor.search_file\"" space search-dir-args-kv ::= "\"args\"" space ":" space search-dir-args search-dir-args ::= search-dir-limitation command-list-item-25 ::= write search-dir-limitation ::= "{" space search-dir-limitation-search-term-kv "," space search-dir-limitation-dir-path-kv "}" space search-dir-limitation-dir-path-kv ::= "\"dir_path\"" space ":" space string search-dir-command-name-kv ::= "\"command_name\"" space ":" space search-dir-command-name search-dir-command-name ::= "\"Editor.search_dir\"" space command-list-item-21 ::= scroll-up publish-message ::= "{" space publish-message-command-name-kv "," space publish-message-args-kv "}" space scroll-up ::= "{" space scroll-up-command-name-kv "," space scroll-up-args-kv "}" space scroll-up-args ::= scroll-up-limitation scroll-up-limitation ::= "{" space "}" space scroll-up-command-name-kv ::= "\"command_name\"" space ":" space scroll-up-command-name scroll-up-command-name ::= "\"Editor.scroll_up\"" space command-list-item-20 ::= scroll-down scroll-down ::= "{" space scroll-down-command-name-kv "," space scroll-down-args-kv "}" space read-command-name-kv ::= "\"command_name\"" space ":" space read-command-name open-file ::= "{" space open-file-command-name-kv "," space open-file-args-kv "}" space open-file-limitation ::= "{" space open-file-limitation-path-kv ( "," space ( open-file-limitation-line-number-kv open-file-limitation-line-number-rest | open-file-limitation-context-lines-kv ) )? "}" space open-file-limitation-line-number-rest ::= ( "," space open-file-limitation-context-lines-kv )? open-file-limitation-context-lines-kv ::= "\"context_lines\"" space ":" space open-file-limitation-context-lines append-task-limitation-assignee-kv ::= "\"assignee\"" space ":" space string open-file-limitation-line-number ::= integer | null go-back-command-name-kv ::= "\"command_name\"" space ":" space go-back-command-name open-file-limitation-path ::= string | string reset-task-limitation-send-to-1-item-1 ::= "\"Alice\"" space type-command-name-kv ::= "\"command_name\"" space ":" space type-command-name open-file-command-name ::= "\"Editor.open_file\"" space similarity-search-args-kv ::= "\"args\"" space ":" space similarity-search-args insert-content-at-line-args ::= insert-content-at-line-limitation insert-content-at-line-limitation ::= "{" space insert-content-at-line-limitation-file-name-kv "," space insert-content-at-line-limitation-line-number-kv "," space insert-content-at-line-limitation-insert-content-kv "}" space go-back-limitation ::= "{" space "}" space insert-content-at-line-limitation-insert-content-kv ::= "\"insert_content\"" space ":" space string insert-content-at-line-args-kv ::= "\"args\"" space ":" space insert-content-at-line-args similarity-search ::= "{" space similarity-search-command-name-kv "," space similarity-search-args-kv "}" space insert-content-at-line-limitation-line-number-kv ::= "\"line_number\"" space ":" space integer insert-content-at-line-limitation-file-name-kv ::= "\"file_name\"" space ":" space string insert-content-at-line-command-name ::= "\"Editor.insert_content_at_line\"" space command-list-item-16 ::= goto-line search-dir ::= "{" space search-dir-command-name-kv "," space search-dir-args-kv "}" space goto-line-args ::= goto-line-limitation goto-line-command-name-kv ::= "\"command_name\"" space ":" space goto-line-command-name similarity-search-args ::= similarity-search-limitation goto-line-args-kv ::= "\"args\"" space ":" space goto-line-args goto-line-command-name ::= "\"Editor.goto_line\"" space append-task-limitation ::= "{" space append-task-limitation-task-id-kv "," space append-task-limitation-dependent-task-ids-kv "," space append-task-limitation-instruction-kv "," space append-task-limitation-assignee-kv "," space append-task-limitation-task-type-kv "}" space open-file-args ::= open-file-limitation close-tab-args ::= close-tab-limitation command-list-item-15 ::= find-file find-file-args-kv ::= "\"args\"" space ":" space find-file-args find-file-args ::= find-file-limitation replace-task-limitation-new-dependent-task-ids ::= "[" space (string ("," space string){0,-1})? "]" space find-file-limitation-dir-path-kv ::= "\"dir_path\"" space ":" space string search-file-args-kv ::= "\"args\"" space ":" space search-file-args find-file-command-name-kv ::= "\"command_name\"" space ":" space find-file-command-name command-list-item-14 ::= edit-file-by-replace scroll-down-command-name ::= "\"Editor.scroll_down\"" space edit-file-by-replace-args-kv ::= "\"args\"" space ":" space edit-file-by-replace-args command-list-item-18 ::= open-file edit-file-by-replace-args ::= edit-file-by-replace-limitation edit-file-by-replace-limitation ::= "{" space edit-file-by-replace-limitation-file-name-kv "," space edit-file-by-replace-limitation-first-replaced-line-number-kv "," space edit-file-by-replace-limitation-first-replaced-line-content-kv "," space edit-file-by-replace-limitation-last-replaced-line-number-kv "," space edit-file-by-replace-limitation-last-replaced-line-content-kv "," space edit-file-by-replace-limitation-new-content-kv "}" space edit-file-by-replace-limitation-new-content-kv ::= "\"new_content\"" space ":" space string edit-file-by-replace-limitation-last-replaced-line-number-kv ::= "\"last_replaced_line_number\"" space ":" space integer replace-task-limitation ::= "{" space replace-task-limitation-task-id-kv "," space replace-task-limitation-new-dependent-task-ids-kv "," space replace-task-limitation-new-instruction-kv "," space replace-task-limitation-new-assignee-kv "}" space read-limitation-path-kv ::= "\"path\"" space ":" space string edit-file-by-replace-limitation-first-replaced-line-content-kv ::= "\"first_replaced_line_content\"" space ":" space string null ::= "null" space command-list-item-17 ::= insert-content-at-line edit-file-by-replace-limitation-first-replaced-line-number-kv ::= "\"first_replaced_line_number\"" space ":" space integer find-file-limitation ::= "{" space find-file-limitation-file-name-kv "," space find-file-limitation-dir-path-kv "}" space edit-file-by-replace-limitation-file-name-kv ::= "\"file_name\"" space ":" space string goto ::= "{" space goto-command-name-kv "," space goto-args-kv "}" space edit-file-by-replace-command-name-kv ::= "\"command_name\"" space ":" space edit-file-by-replace-command-name search-dir-limitation-search-term-kv ::= "\"search_term\"" space ":" space string create-file ::= "{" space create-file-command-name-kv "," space create-file-args-kv "}" space create-file-args ::= create-file-limitation find-file-limitation-file-name-kv ::= "\"file_name\"" space ":" space string create-file-limitation ::= "{" space create-file-limitation-filename-kv "}" space press ::= "{" space press-command-name-kv "," space press-args-kv "}" space tab-focus-args-kv ::= "\"args\"" space ":" space tab-focus-args find-file ::= "{" space find-file-command-name-kv "," space find-file-args-kv "}" space create-file-limitation-filename-kv ::= "\"filename\"" space ":" space string read-args ::= read-limitation create-file-command-name-kv ::= "\"command_name\"" space ":" space create-file-command-name append-file-limitation ::= "{" space append-file-limitation-filename-kv "," space append-file-limitation-content-kv "}" space char ::= [^"\\\x7F\x00-\x1F] | [\\] (["\\bfnrt] | "u" [0-9a-fA-F]{4}) append-file-limitation-content-kv ::= "\"content\"" space ":" space string command-list-item-7 ::= hover command-list-item-11 ::= type type-args ::= type-limitation write-command-name ::= "\"Editor.write\"" space boolean ::= ("true" | "false") space command-list-item-22 ::= search-dir type-limitation-press-enter-after-kv ::= "\"press_enter_after\"" space ":" space boolean go-back-args ::= go-back-limitation type-limitation-content-kv ::= "\"content\"" space ":" space string read-args-kv ::= "\"args\"" space ":" space read-args command-list-item-10 ::= tab-focus replace-task-command-name ::= "\"Plan.replace_task\"" space tab-focus-args ::= tab-focus-limitation tab-focus-limitation ::= "{" space tab-focus-limitation-page-number-kv "}" space scroll ::= "{" space scroll-command-name-kv "," space scroll-args-kv "}" space scroll-limitation-direction-kv ::= "\"direction\"" space ":" space scroll-limitation-direction scroll-command-name ::= "\"Browser.scroll\"" space write-args ::= write-limitation append-file-command-name ::= "\"Editor.append_file\"" space press-args-kv ::= "\"args\"" space ":" space press-args append-file-command-name-kv ::= "\"command_name\"" space ":" space append-file-command-name press-args ::= press-limitation replace-task-args-kv ::= "\"args\"" space ":" space replace-task-args press-limitation-key-comb-kv ::= "\"key_comb\"" space ":" space string press-command-name ::= "\"Browser.press\"" space edit-file-by-replace-command-name ::= "\"Editor.edit_file_by_replace\"" space tab-focus-command-name ::= "\"Browser.tab_focus\"" space hover ::= "{" space hover-command-name-kv "," space hover-args-kv "}" space append-task-limitation-task-type-kv ::= "\"task_type\"" space ":" space string scroll-down-args-kv ::= "\"args\"" space ":" space scroll-down-args scroll-down-args ::= scroll-down-limitation hover-args-kv ::= "\"args\"" space ":" space hover-args read-limitation ::= "{" space read-limitation-path-kv "}" space hover-args ::= hover-limitation reset-task-limitation ::= "{" space reset-task-limitation-content-kv "," space reset-task-limitation-send-to-kv "}" space hover-limitation ::= "{" space hover-limitation-element-id-kv "}" space tab-focus ::= "{" space tab-focus-command-name-kv "," space tab-focus-args-kv "}" space command-list-item-12 ::= append-file goto-line-limitation-line-number-kv ::= "\"line_number\"" space ":" space integer goto-command-name ::= "\"Browser.goto\"" space goto-command-name-kv ::= "\"command_name\"" space ":" space goto-command-name hover-command-name ::= "\"Browser.hover\"" space command-list-item-13 ::= create-file type ::= "{" space type-command-name-kv "," space type-args-kv "}" space find-file-command-name ::= "\"Editor.find_file\"" space goto-args-kv ::= "\"args\"" space ":" space goto-args goto-args ::= goto-limitation reset-task-limitation-send-to-1-item-5 ::= "\"Alex\"" space scroll-down-limitation ::= "{" space "}" space press-limitation ::= "{" space press-limitation-key-comb-kv "}" space command-list-item-1 ::= replace-task tab-focus-limitation-page-number-kv ::= "\"page_number\"" space ":" space integer decimal-part ::= [0-9]{1,16} goto-line-limitation ::= "{" space goto-line-limitation-line-number-kv "}" space hover-command-name-kv ::= "\"command_name\"" space ":" space hover-command-name goto-limitation-timeout-kv ::= "\"timeout\"" space ":" space number number ::= ("-"? integral-part) ("." decimal-part)? ([eE] [-+]? integral-part)? space insert-content-at-line ::= "{" space insert-content-at-line-command-name-kv "," space insert-content-at-line-args-kv "}" space goto-limitation-url-kv ::= "\"url\"" space ":" space string type-limitation ::= "{" space type-limitation-element-id-kv "," space type-limitation-content-kv ( "," space ( type-limitation-press-enter-after-kv ) )? "}" space append-file-limitation-filename-kv ::= "\"filename\"" space ":" space string scroll-limitation-direction ::= ("\"down\"" | "\"up\"") space scroll-limitation ::= "{" space scroll-limitation-direction-kv "}" space command-list-item-5 ::= go-forward open-file-limitation-line-number-kv ::= "\"line_number\"" space ":" space open-file-limitation-line-number scroll-args ::= scroll-limitation similarity-search-limitation-path-kv ::= "\"path\"" space ":" space similarity-search-limitation-path command-list-item-6 ::= goto go-forward-args-kv ::= "\"args\"" space ":" space go-forward-args replace-task-limitation-new-assignee-kv ::= "\"new_assignee\"" space ":" space string tab-focus-command-name-kv ::= "\"command_name\"" space ":" space tab-focus-command-name go-forward-command-name ::= "\"Browser.go_forward\"" space go-forward-args ::= go-forward-limitation append-file-args ::= append-file-limitation reset-task-limitation-send-to-1-item ::= reset-task-limitation-send-to-1-item-0 | reset-task-limitation-send-to-1-item-1 | reset-task-limitation-send-to-1-item-2 | reset-task-limitation-send-to-1-item-3 | reset-task-limitation-send-to-1-item-4 | reset-task-limitation-send-to-1-item-5 | reset-task-limitation-send-to-1-item-6 | reset-task-limitation-send-to-1-item-7 close-tab ::= "{" space close-tab-command-name-kv "," space close-tab-args-kv "}" space command-list-item-4 ::= go-back scroll-up-args-kv ::= "\"args\"" space ":" space scroll-up-args append-task-limitation-task-id-kv ::= "\"task_id\"" space ":" space string command-list-item-19 ::= read append-file ::= "{" space append-file-command-name-kv "," space append-file-args-kv "}" space append-task-args-kv ::= "\"args\"" space ":" space append-task-args press-command-name-kv ::= "\"command_name\"" space ":" space press-command-name insert-content-at-line-command-name-kv ::= "\"command_name\"" space ":" space insert-content-at-line-command-name command-list-item-9 ::= scroll goto-line ::= "{" space goto-line-command-name-kv "," space goto-line-args-kv "}" space search-file-limitation-file-path-kv ::= "\"file_path\"" space ":" space search-file-limitation-file-path command-list-item-3 ::= close-tab hover-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer go-forward-limitation ::= "{" space "}" space click-args ::= click-limitation edit-file-by-replace ::= "{" space edit-file-by-replace-command-name-kv "," space edit-file-by-replace-args-kv "}" space command-list-item-2 ::= click command-list-item-0 ::= append-task close-tab-args-kv ::= "\"args\"" space ":" space close-tab-args replace-task-limitation-task-id-kv ::= "\"task_id\"" space ":" space string close-tab-limitation ::= "{" space "}" space scroll-args-kv ::= "\"args\"" space ":" space scroll-args create-file-command-name ::= "\"Editor.create_file\"" space read ::= "{" space read-command-name-kv "," space read-args-kv "}" space open-file-command-name-kv ::= "\"command_name\"" space ":" space open-file-command-name append-file-args-kv ::= "\"args\"" space ":" space append-file-args click-limitation ::= "{" space click-limitation-element-id-kv "}" space click-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer space ::= | " " | "\n"{1,2} [ \t]{0,20} command-list-item-23 ::= search-file append-task-limitation-dependent-task-ids-kv ::= "\"dependent_task_ids\"" space ":" space append-task-limitation-dependent-task-ids click ::= "{" space click-command-name-kv "," space click-args-kv "}" space read-command-name ::= "\"Editor.read\"" space integer ::= ("-"? integral-part) space scroll-command-name-kv ::= "\"command_name\"" space ":" space scroll-command-name integral-part ::= [0] | [1-9] [0-9]{0,15} replace-task ::= "{" space replace-task-command-name-kv "," space replace-task-args-kv "}" space type-command-name ::= "\"Browser.type\"" space replace-task-limitation-new-instruction-kv ::= "\"new_instruction\"" space ":" space string command-list-item-8 ::= press append-task-command-name ::= "\"Plan.append_task\"" space click-command-name ::= "\"Browser.click\"" space open-file-limitation-path-kv ::= "\"path\"" space ":" space open-file-limitation-path replace-task-command-name-kv ::= "\"command_name\"" space ":" space replace-task-command-name close-tab-command-name ::= "\"Browser.close_tab\"" space replace-task-limitation-new-dependent-task-ids-kv ::= "\"new_dependent_task_ids\"" space ":" space replace-task-limitation-new-dependent-task-ids scroll-down-command-name-kv ::= "\"command_name\"" space ":" space scroll-down-command-name append-task ::= "{" space append-task-command-name-kv "," space append-task-args-kv "}" space goto-limitation ::= "{" space goto-limitation-url-kv ( "," space ( goto-limitation-timeout-kv ) )? "}" space replace-task-args ::= replace-task-limitation publish-message-args ::= reset-task-limitation create-file-args-kv ::= "\"args\"" space ":" space create-file-args go-back-command-name ::= "\"Browser.go_back\"" space go-forward-command-name-kv ::= "\"command_name\"" space ":" space go-forward-command-name append-task-args ::= append-task-limitation append-task-command-name-kv ::= "\"command_name\"" space ":" space append-task-command-name append-task-limitation-dependent-task-ids ::= "[" space (string ("," space string){0,-1})? "]" space go-back ::= "{" space go-back-command-name-kv "," space go-back-args-kv "}" space click-command-name-kv ::= "\"command_name\"" space ":" space click-command-name open-file-args-kv ::= "\"args\"" space ":" space open-file-args append-task-limitation-instruction-kv ::= "\"instruction\"" space ":" space string type-limitation-element-id-kv ::= "\"element_id\"" space ":" space integer click-args-kv ::= "\"args\"" space ":" space click-args edit-file-by-replace-limitation-last-replaced-line-content-kv ::= "\"last_replaced_line_content\"" space ":" space string type-args-kv ::= "\"args\"" space ":" space type-args close-tab-command-name-kv ::= "\"command_name\"" space ":" space close-tab-command-name write-limitation-path-kv ::= "\"path\"" space ":" space string string ::= "\"" char* "\"" space go-forward ::= "{" space go-forward-command-name-kv "," space go-forward-args-kv "}" space open-file-limitation-context-lines ::= integer | null go-back-args-kv ::= "\"args\"" space ":" space go-back-args mental-activity-kv ::= "\"mental_activity\"" space ":" space string llama_grammar_init_impl: failed to parse grammar time=2025-04-25T13:21:36.702+08:00 level=INFO source=server.go:789 msg="llm predict error: Failed to create new sequence: unable to create sampling context" [GIN] 2025/04/25 - 13:21:36 | 200 | 6.4494062s | 127.0.0.1 | POST "/api/chat" ``` ### OS Windows ### GPU Nvidia ### CPU Intel ### Ollama version 0.6.6

GiteaMirror added the bug label 2026-05-04 15:35:12 -05:00

GiteaMirror closed this issue

2026-05-04 15:35:17 -05:00

GiteaMirror commented

2026-05-04 15:35:18 -05:00

@rick-github commented on GitHub (Apr 25, 2025):

This might be a bug in llama.cpp triggered by your schema. You have something like this:

class append_task_limitation(BaseModel):
  task_id: str
  dependent_task_ids: list[str] = Field(max_length=0)
  instruction: str
  assignee: str
  task_type: str

class DynamicCommandFormat(BaseModel):
  append_task_limitation: append_task_limitation

From this, pydantic creates a schema that includes this:

        "append_task_limitation": {
            "properties": {
                "task_id": {
                    "title": "Task Id",
                    "type": "string"
                },
                "dependent_task_ids": {
                    "items": {
                        "type": "string"
                    },
                    "maxItems": 0,
                    "title": "Dependent Task Ids",
                    "type": "array"
                },
                "instruction": {
                    "title": "Instruction",
                    "type": "string"
                },
                "assignee": {
                    "title": "Assignee",
                    "type": "string"
                },
                "task_type": {
                    "title": "Task Type",
                    "type": "string"
                }
            },

Specifically, this line:

                    "maxItems": 0,

The JSON schema to GBNF transformation converts this to:

append-task-limitation-dependent-task-ids ::= "[" space (string ("," space string){0,-1})? "]" space

Where -1 comes from this line in json-schema-to-grammar.cpp

    auto result = item_rule + " " + build_repetition("(" + separator_rule + " " + item_rule + ")", min_items == 0 ? 0 : min_items - 1, has_max ? max_items - 1 : max_items);

That is, the transformation is trying to create a rule about how many items append-task-limitation-dependent-task-ids can have, and the repetition limit is evaluated as {0..maxItems-1} or {0,-1}. -1 is obviously an invalid value in a repetition count and so the GBNF parser throws an error.

The {min,max} code was the result of https://github.com/ggml-org/llama.cpp/pull/6640, and a comment in the PR indicates somebody noticed a problem with {0,N} but it doesn't look like it was followed up.

@rick-github commented on GitHub (Apr 25, 2025): This might be a bug in llama.cpp triggered by your schema. You have something like this: ```python class append_task_limitation(BaseModel): task_id: str dependent_task_ids: list[str] = Field(max_length=0) instruction: str assignee: str task_type: str class DynamicCommandFormat(BaseModel): append_task_limitation: append_task_limitation ``` From this, pydantic creates a schema that includes this: ```json "append_task_limitation": { "properties": { "task_id": { "title": "Task Id", "type": "string" }, "dependent_task_ids": { "items": { "type": "string" }, "maxItems": 0, "title": "Dependent Task Ids", "type": "array" }, "instruction": { "title": "Instruction", "type": "string" }, "assignee": { "title": "Assignee", "type": "string" }, "task_type": { "title": "Task Type", "type": "string" } }, ``` Specifically, this line: ```json "maxItems": 0, ``` The JSON schema to GBNF transformation converts this to: ``` append-task-limitation-dependent-task-ids ::= "[" space (string ("," space string){0,-1})? "]" space ``` Where `-1` comes from this line in [json-schema-to-grammar.cpp](https://github.com/ollama/ollama/blob/e9e5f61c45e13f9b87be985ae735de8c217e9915/llama/llama.cpp/common/json-schema-to-grammar.cpp#L33C1-L34C1) ``` auto result = item_rule + " " + build_repetition("(" + separator_rule + " " + item_rule + ")", min_items == 0 ? 0 : min_items - 1, has_max ? max_items - 1 : max_items); ``` That is, the transformation is trying to create a rule about how many items `append-task-limitation-dependent-task-ids` can have, and the repetition limit is evaluated as `{0..maxItems-1}` or `{0,-1}`. -1 is obviously an invalid value in a repetition count and so the GBNF parser throws an error. The {min,max} code was the result of https://github.com/ggml-org/llama.cpp/pull/6640, and a [comment](https://github.com/ggml-org/llama.cpp/pull/6640#issuecomment-2153544476) in the PR indicates somebody noticed a problem with `{0,N}` but it doesn't look like it was followed up.

GiteaMirror commented

2026-05-04 15:35:18 -05:00

@rick-github commented on GitHub (Apr 25, 2025):

https://github.com/ggml-org/llama.cpp/issues/13116

@rick-github commented on GitHub (Apr 25, 2025): https://github.com/ggml-org/llama.cpp/issues/13116

GiteaMirror commented

2026-05-04 15:35:19 -05:00

@Ritanlisa commented on GitHub (Apr 26, 2025):

Thanks! I suppost that could be caused by length limit

@Ritanlisa commented on GitHub (Apr 26, 2025): Thanks! I suppost that could be caused by length limit

Sign in to join this conversation.

Branches Tags

main

parth-mlx-decode-checkpoints

dhiltgen/ci

hoyyeva/editor-config-repair

parth-launch-codex-app

hoyyeva/fix-codex-model-metadata-warning

hoyyeva/qwen

hoyyeva/launch-backup-ux

parth/hide-claude-desktop-till-release

hoyyeva/opencode-image-modality

parth-add-claude-code-autoinstall

release_v0.22.0

pdevine/manifest-list

codex/fix-codex-model-metadata-warning

pdevine/addressable-manifest

brucemacd/launch-fetch-reccomended

jmorganca/llama-compat

launch-copilot-cli

hoyyeva/opencode-thinking

release_v0.20.7

parth-auto-save-backup

parth-test

jmorganca/gemma4-audio-replacements

fix-manifest-digest-on-pull

hoyyeva/vscode-improve

brucemacd/install-server-wait

brucemacd/download-before-remove

parth/update-claude-docs

parth-anthropic-reference-images-path

brucemac/start-ap-install

pdevine/mlx-update

pdevine/qwen35_vision

drifkin/api-show-fallback

mintlify/image-generation-1773352582

hoyyeva/server-context-length-local-config

jmorganca/faster-reptition-penalties

jmorganca/convert-nemotron

parth-pi-thinking

pdevine/sampling-penalties

jmorganca/fix-create-quantization-memory

dongchen/resumable_transfer_fix

pdevine/sampling-cache-error

jessegross/mlx-usage

hoyyeva/openclaw-config

hoyyeva/app-html

pdevine/qwen3next

brucemacd/sign-sh-install

brucemacd/tui-update

brucemacd/usage-api

jmorganca/launch-empty

fix-app-dist-embed

mxyng/mlx-compile

mxyng/mlx-quant

mxyng/mlx-glm4.7

mxyng/mlx

brucemacd/simplify-model-picker

jmorganca/qwen3-concurrent

fix-glm-4.7-flash-mla-config

drifkin/qwen3-coder-opening-tag

brucemacd/usage-cli

fix-cuda12-fattn-shmem

ollama-imagegen-docs

parth/fix-multiline-inputs

brucemacd/config-docs

mxyng/model-files

mxyng/simple-execute

fix-imagegen-ollama-models

mxyng/async-upload

jmorganca/lazy-no-dtype-changes

imagegen-auto-detect-create

parth/decrease-concurrent-download-hf

fix-mlx-quantize-init

jmorganca/x-cleanup

usage

imagegen-readme

jmorganca/glm-image

mlx-gpu-cd

jmorganca/imagegen-modelfile

parth/agent-skills

parth/agent-allowlist

parth/signed-in-offline

parth/agents

parth/fix-context-chopping

improve-cloud-flow

parth/add-models-websearch

parth/prompt-renderer-mcp

jmorganca/native-settings

jmorganca/download-stream-hash

jmorganca/client2-rebased

brucemacd/oai-chat-req-multipart

jessegross/multi_chunk_reserve

grace/additional-omit-empty

grace/mistral-3-large

mxyng/tokenizer2

mxyng/tokenizer

jessegross/flash

hoyyeva/windows-nacked-app

mxyng/cleanup-attention

grace/deepseek-parser

hoyyeva/remember-unsent-prompt

parth/add-lfs-pointer-error-conversion

parth/olmo2-test2

hoyyeva/ollama-launchagent-plist

nicole/olmo-model

parth/olmo-test

mxyng/remove-embedded

parth/render-template

jmorganca/intellect-3

parth/remove-prealloc-linter

jmorganca/cmd-eval

nicole/nomic-embed-text-fix

mxyng/lint-2

hoyyeva/add-gemini-3-pro-preview

hoyyeva/load-model-list

mxyng/expand-path

mxyng/environ-2

hoyyeva/deeplink-json-encoding

parth/improve-tool-calling-tests

hoyyeva/conversation

hoyyeva/assistant-edit-response

hoyyeva/thinking

origin/brucemacd/invalid-char-i-err

parth/improve-tool-calling

jmorganca/required-omitempty

grace/qwen3-vl-tests

mxyng/iter-client

parth/docs-readme

nicole/embed-test

pdevine/integration-benchstat

parth/remove-generate-cmd

parth/add-toolcall-id

mxyng/server-tests

jmorganca/glm-4.6

jmorganca/gin-h-compat

drifkin/stable-tool-args

pdevine/qwen3-more-thinking

parth/add-websearch-client

nicole/websearch_local

jmorganca/qwen3-coder-updates

grace/deepseek-v3-migration-tests

mxyng/fix-create

jmorganca/cloud-errors

pdevine/parser-tidy

revert-12233-parth/simplify-entrypoints-runner

parth/enable-so-gpt-oss

brucemacd/qwen3vl

jmorganca/readme-simplify

parth/gpt-oss-structured-outputs

revert-12039-jmorganca/tools-braces

mxyng/embeddings

mxyng/gguf

mxyng/benchmark

mxyng/types-null

parth/move-parsing

mxyng/gemma2

jmorganca/docs

mxyng/16-bit

mxyng/create-stdin

pdevine/authorizedkeys

mxyng/quant

parth/opt-in-error-context-window

brucemacd/cache-models

brucemacd/runner-completion

jmorganca/llama-update-6

brucemacd/benchmark-list

brucemacd/partial-read-caps

parth/deepseek-r1-tools

mxyng/omit-array

parth/tool-prefix-temp

brucemacd/runner-test

jmorganca/qwen25vl

brucemacd/model-forward-test-ext

parth/python-function-parsing

jmorganca/cuda-compression-none

drifkin/num-parallel

drifkin/chat-truncation-fix

jmorganca/sync

parth/python-tools-calling

drifkin/array-head-count

brucemacd/create-no-loop

parth/server-enable-content-stream-with-tools

qwen25omni

mxyng/v3

brucemacd/ropeconfig

jmorganca/silence-tokenizer

parth/sample-so-test

parth/sampling-structured-outputs

brucemacd/doc-go-engine

parth/constrained-sampling-json

jmorganca/mistral-wip

brucemacd/mistral-small-convert

parth/sample-unmarshal-json-for-params

brucemacd/jomorganca/mistral

pdevine/bfloat16

jmorganca/mistral

brucemacd/mistral

pdevine/logging

parth/sample-correctness-fix

parth/sample-fix-sorting

jmorgan/sample-fix-sorting-extras

jmorganca/temp-0-images

brucemacd/parallel-embed-models

brucemacd/shim-grammar

jmorganca/fix-gguf-error

bmizerany/nameswork

jmorganca/faster-releases

bmizerany/validatenames

brucemacd/err-no-vocab

brucemacd/rope-config

brucemacd/err-hint

brucemacd/qwen2_5

brucemacd/logprobs

brucemacd/new_runner_graph_bench

progress-flicker

brucemacd/forward-test

brucemacd/go_qwen2

pdevine/gemma2

jmorganca/add-missing-symlink-eval

mxyng/next-debug

parth/set-context-size-openai

brucemacd/next-bpe-bench

brucemacd/next-bpe-test

brucemacd/new_runner_e2e

brucemacd/new_runner_qwen2

pdevine/convert-cohere2

brucemacd/convert-cli

parth/log-probs

mxyng/next-mlx

mxyng/cmd-history

parth/templating

parth/tokenize-detokenize

brucemacd/check-key-register

bmizerany/grammar

jmorganca/vendor-081b29bd

mxyng/func-checks

jmorganca/fix-null-format

parth/fix-default-to-warn-json

jmorganca/qwen2vl

jmorganca/no-concat

parth/cmd-cleanup-SO

brucemacd/check-key-register-structured-err

parth/openai-stream-usage

parth/fix-referencing-so

stream-tools-stop

jmorganca/degin-1

brucemacd/install-path-clean

brucemacd/push-name-validation

brucemacd/browser-key-register

jmorganca/openai-fix-first-message

jmorganca/fix-proxy

jessegross/sample

parth/disallow-streaming-tools

dhiltgen/remove_submodule

jmorganca/ga

jmorganca/mllama

pdevine/newlines

pdevine/geems-2b

jmorganca/llama-bump

mxyng/modelname-7

mxyng/gin-slog

mxyng/modelname-6

jyan/convert-prog

jyan/quant5

paligemma-support

pdevine/import-docs

jmorganca/openai-context

jyan/paligemma

jyan/p2

jyan/palitest

bmizerany/embedspeedup

jmorganca/llama-vit

brucemacd/allow-ollama

royh/ep-methods

royh/whisper

mxyng/api-models

mxyng/fix-memory

jyan/q4_4/8

jyan/ollama-v

royh/stream-tools

roy-embed-parallel

bmizerany/hrm

revert-5963-revert-5924-mxyng/llama3.1-rope

royh/embed-viz

jyan/local2

jyan/auth

jyan/local

jyan/parse-temp

jmorganca/template-mistral

jyan/reord-g

royh-openai-suffixdocs

royh-imgembed

royh-embed-parallel

jyan/quant4

royh-precision

jyan/progress

pdevine/fix-template

jyan/quant3

pdevine/ggla

mxyng/update-registry-domain

jmorganca/ggml-static

mxyng/create-context

jyan/v0.146

mxyng/layers-from-files

build_dist

bmizerany/noseek

royh-ls

royh-name

timeout

mxyng/server-timestamp

bmizerany/nosillyggufslurps

royh-params

jmorganca/llama-cpp-7c26775

royh-openai-delete

royh-show-rigid

jmorganca/enable-fa

jmorganca/no-error-template

jyan/format

royh-testdelete

bmizerany/fastverify

language_support

pdevine/ps-glitches

brucemacd/tokenize

bruce/iq-quants

bmizerany/filepathwithcoloninhost

mxyng/split-bin

bmizerany/client-registry

jmorganca/if-none-match

native

jmorganca/native

jmorganca/batch-embeddings

jmorganca/initcmake

jmorganca/mm

pdevine/showggmlinfo

modenameenforcealphanum

bmizerany/modenameenforcealphanum

jmorganca/done-reason

jmorganca/llama-cpp-8960fe8

ollama.com

bmizerany/filepathnobuild

bmizerany/types/model/defaultfix

rmdisplaylong

nogogen

bmizerany/x

modelfile-readme

bmizerany/replacecolon

jmorganca/limit

jmorganca/execstack

jmorganca/replace-assets

mxyng/tune-concurrency

jmorganca/testing

whitespace-detection

jmorganca/options

upgrade-all

scratch

cuda-search

mattw/airenamer

mattw/allmodelsonhuggingface

mattw/quantcontext

mattw/whatneedstorun

brucemacd/llama-mem-calc

mattw/faq-context

mattw/communitylinks

mattw/noprune

mattw/python-functioncalling

rename

mxyng/install

pulse

remove-first

editor

mattw/selfqueryingretrieval

cgo

mattw/howtoquant

api

matt/streamingapi

format-config

mxyng/extra-args

shell

update-nous-hermes

cp-model

upload-progress

fix-unknown-model

fix-model-names

delete-fix

insecure-registry

ls

deletemodels

progressbar

readme-updates

license-layers

skip-list

list-models

modelpath

matt/examplemodelfiles

distribution

go-opts

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/ollama#68890