[GH-ISSUE #12466] Facing Model Runner Has Unexpectedly Stopped With The Flan-T5 #34042

Open
opened 2026-04-22 17:16:12 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @alexandertsukanov on GitHub (Oct 1, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/12466

What is the issue?

Hey, Ollama team!
It seems I am can't run the GGUF version of flan-t5-large-grammar-synthesis

I constantly can observe next error

Error
model runner has unexpectedly stopped, this may be due to resource limitations or an internal error, check ollama server logs for details

What could be the reason behind that?
Thanks.

Relevant log output

print_info: file format = GGUF V3 (latest)
print_info: file type   = Q8_0
print_info: file size   = 793.90 MiB (8.50 BPW) 
load: model vocab missing newline token, using special_pad_id instead
load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
load: printing all EOG tokens:
load:   - 1 ('</s>')
load: special tokens cache size = 3
load: token to piece cache size = 0.2111 MB
print_info: arch             = t5
print_info: vocab_only       = 0
print_info: n_ctx_train      = 512
print_info: n_embd           = 1024
print_info: n_layer          = 24
print_info: n_head           = 16
print_info: n_head_kv        = 16
print_info: n_rot            = 64
print_info: n_swa            = 0
print_info: is_swa_any       = 0
print_info: n_embd_head_k    = 64
print_info: n_embd_head_v    = 64
print_info: n_gqa            = 1
print_info: n_embd_k_gqa     = 1024
print_info: n_embd_v_gqa     = 1024
print_info: f_norm_eps       = 0.0e+00
print_info: f_norm_rms_eps   = 1.0e-06
print_info: f_clamp_kqv      = 0.0e+00
print_info: f_max_alibi_bias = 0.0e+00
print_info: f_logit_scale    = 0.0e+00
print_info: f_attn_scale     = 0.0e+00
print_info: n_ff             = 2816
print_info: n_expert         = 0
print_info: n_expert_used    = 0
print_info: causal attn      = 1
print_info: pooling type     = 0
print_info: rope type        = -1
print_info: rope scaling     = linear
print_info: freq_base_train  = 10000.0
print_info: freq_scale_train = 1
print_info: n_ctx_orig_yarn  = 512
print_info: rope_finetuned   = unknown
print_info: model type       = 780M
print_info: model params     = 783.15 M
print_info: general.name     = Flan T5 Large Grammar Synthesis
print_info: vocab type       = UGM
print_info: n_vocab          = 32128
print_info: n_merges         = 0
print_info: EOS token        = 1 '</s>'
print_info: UNK token        = 2 '<unk>'
print_info: PAD token        = 0 '<pad>'
print_info: LF token         = 0 '<pad>'
print_info: EOG token        = 1 '</s>'
print_info: max token length = 20
load_tensors: loading model tensors, this can take a while... (mmap = true)
load_tensors: offloading 24 repeating layers to GPU
load_tensors: offloading output layer to GPU
load_tensors: offloaded 25/25 layers to GPU
load_tensors:   CPU_Mapped model buffer size =    33.34 MiB
load_tensors: Metal_Mapped model buffer size =   760.57 MiB
llama_context: constructing llama_context
llama_context: n_seq_max     = 1
llama_context: n_ctx         = 512
llama_context: n_ctx_per_seq = 512
llama_context: n_batch       = 512
llama_context: n_ubatch      = 512
llama_context: causal_attn   = 1
llama_context: flash_attn    = 0
llama_context: kv_unified    = false
llama_context: freq_base     = 10000.0
llama_context: freq_scale    = 1
ggml_metal_init: allocating
ggml_metal_init: picking default device: Apple M1 Max
ggml_metal_load_library: using embedded metal library
ggml_metal_init: GPU name:   Apple M1 Max
ggml_metal_init: GPU family: MTLGPUFamilyApple7  (1007)
ggml_metal_init: GPU family: MTLGPUFamilyCommon3 (3003)
ggml_metal_init: GPU family: MTLGPUFamilyMetal3  (5001)
ggml_metal_init: simdgroup reduction   = true
ggml_metal_init: simdgroup matrix mul. = true
ggml_metal_init: has residency sets    = false
ggml_metal_init: has bfloat            = true
ggml_metal_init: use bfloat            = true
ggml_metal_init: hasUnifiedMemory      = true
ggml_metal_init: recommendedMaxWorkingSetSize  = 51539.61 MB
llama_context:        CPU  output buffer size =     0.13 MiB
llama_kv_cache_unified:      Metal KV buffer size =    48.00 MiB
llama_kv_cache_unified: size =   48.00 MiB (   512 cells,  24 layers,  1/1 seqs), K (f16):   24.00 MiB, V (f16):   24.00 MiB
llama_context:      Metal compute buffer size =    84.00 MiB
llama_context:        CPU compute buffer size =    11.01 MiB
llama_context: graph nodes  = 1446
llama_context: graph splits = 5
time=2025-10-01T12:55:52.559+03:00 level=INFO source=server.go:1289 msg="llama runner started in 0.30 seconds"
time=2025-10-01T12:55:52.559+03:00 level=INFO source=sched.go:470 msg="loaded runners" count=1
time=2025-10-01T12:55:52.559+03:00 level=INFO source=server.go:1251 msg="waiting for llama runner to start responding"
time=2025-10-01T12:55:52.560+03:00 level=INFO source=server.go:1289 msg="llama runner started in 0.30 seconds"
[GIN] 2025/10/01 - 12:55:52 | 200 |    375.6755ms |       127.0.0.1 | POST     "/api/generate"
[GIN] 2025/10/01 - 12:55:59 | 200 |    1.105459ms |       127.0.0.1 | GET      "/api/tags"
SIGSEGV: segmentation violation
PC=0x100d0a6c8 m=8 sigcode=2 addr=0x8
signal arrived during cgo execution

goroutine 9 gp=0x14000504a80 m=8 mp=0x14000600008 [syscall]:
runtime.cgocall(0x100c222b8, 0x14000080bb8)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/cgocall.go:167 +0x44 fp=0x14000080b80 sp=0x14000080b40 pc=0x1000ecf24
github.com/ollama/ollama/llama._Cfunc_llama_decode(0x13fe066a0, {0x2, 0x1409dc000, 0x0, 0x1409d8e00, 0x1409d5c00, 0x140c73e00, 0x13ffb1b10})
	_cgo_gotypes.go:662 +0x34 fp=0x14000080bb0 sp=0x14000080b80 pc=0x10044a0b4
github.com/ollama/ollama/llama.(*Context).Decode.func1(...)
	/Users/runner/work/ollama/ollama/llama/llama.go:150
github.com/ollama/ollama/llama.(*Context).Decode(0x14000481f00?, 0x200000003?)
	/Users/runner/work/ollama/ollama/llama/llama.go:150 +0xc8 fp=0x14000080ca0 sp=0x14000080bb0 pc=0x10044c228
github.com/ollama/ollama/runner/llamarunner.(*Server).processBatch(0x1400048ca00, 0x1400004ebe0, 0x1400011d718)
	/Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:441 +0x1c8 fp=0x14000080ed0 sp=0x14000080ca0 pc=0x1004f2268
github.com/ollama/ollama/runner/llamarunner.(*Server).run(0x1400048ca00, {0x1013791c0, 0x14000615c20})
	/Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:346 +0x164 fp=0x14000080fa0 sp=0x14000080ed0 pc=0x1004f1f34
github.com/ollama/ollama/runner/llamarunner.Execute.gowrap1()
	/Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:880 +0x30 fp=0x14000080fd0 sp=0x14000080fa0 pc=0x1004f5f10
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x14000080fd0 sp=0x14000080fd0 pc=0x1000f81a4
created by github.com/ollama/ollama/runner/llamarunner.Execute in goroutine 1
	/Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:880 +0x44c

goroutine 1 gp=0x140000021c0 m=nil [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400050f720 sp=0x1400050f700 pc=0x1000f0448
runtime.netpollblock(0x1400050f7b8?, 0x174060?, 0x1?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/netpoll.go:575 +0x158 fp=0x1400050f760 sp=0x1400050f720 pc=0x1000b5a08
internal/poll.runtime_pollWait(0x128b05330, 0x72)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/netpoll.go:351 +0xa0 fp=0x1400050f790 sp=0x1400050f760 pc=0x1000ef600
internal/poll.(*pollDesc).wait(0x140004cf300?, 0x100097ddc?, 0x0)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_poll_runtime.go:84 +0x28 fp=0x1400050f7c0 sp=0x1400050f790 pc=0x10016f878
internal/poll.(*pollDesc).waitRead(...)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0x140004cf300)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_unix.go:620 +0x24c fp=0x1400050f870 sp=0x1400050f7c0 pc=0x10017414c
net.(*netFD).accept(0x140004cf300)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/fd_unix.go:172 +0x28 fp=0x1400050f930 sp=0x1400050f870 pc=0x1001e3fa8
net.(*TCPListener).accept(0x140002d21c0)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/tcpsock_posix.go:159 +0x24 fp=0x1400050f980 sp=0x1400050f930 pc=0x1001f8204
net.(*TCPListener).Accept(0x140002d21c0)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/tcpsock.go:380 +0x2c fp=0x1400050f9c0 sp=0x1400050f980 pc=0x1001f71ec
net/http.(*onceCloseListener).Accept(0x140000ee000?)
	<autogenerated>:1 +0x30 fp=0x1400050f9e0 sp=0x1400050f9c0 pc=0x1003d2500
net/http.(*Server).Serve(0x1400011f200, {0x101376c48, 0x140002d21c0})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:3424 +0x290 fp=0x1400050fb10 sp=0x1400050f9e0 pc=0x1003abc40
github.com/ollama/ollama/runner/llamarunner.Execute({0x14000032260, 0x4, 0x4})
	/Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:901 +0x7ac fp=0x1400050fce0 sp=0x1400050fb10 pc=0x1004f5cec
github.com/ollama/ollama/runner.Execute({0x14000032250?, 0x0?, 0x0?})
	/Users/runner/work/ollama/ollama/runner/runner.go:22 +0x130 fp=0x1400050fd10 sp=0x1400050fce0 pc=0x100567dd0
github.com/ollama/ollama/cmd.NewCLI.func2(0x1400011ef00?, {0x100ece268?, 0x4?, 0x100ece26c?})
	/Users/runner/work/ollama/ollama/cmd/cmd.go:1769 +0x54 fp=0x1400050fd40 sp=0x1400050fd10 pc=0x100bd1774
github.com/spf13/cobra.(*Command).execute(0x140004e5508, {0x1400009ff40, 0x4, 0x4})
	/Users/runner/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x648 fp=0x1400050fe60 sp=0x1400050fd40 pc=0x100252548
github.com/spf13/cobra.(*Command).ExecuteC(0x140004d2908)
	/Users/runner/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x320 fp=0x1400050ff20 sp=0x1400050fe60 pc=0x100252c90
github.com/spf13/cobra.(*Command).Execute(...)
	/Users/runner/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
	/Users/runner/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
	/Users/runner/work/ollama/ollama/main.go:12 +0x54 fp=0x1400050ff40 sp=0x1400050ff20 pc=0x100bd22b4
runtime.main()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:283 +0x284 fp=0x1400050ffd0 sp=0x1400050ff40 pc=0x1000bc574
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400050ffd0 sp=0x1400050ffd0 pc=0x1000f81a4

goroutine 2 gp=0x14000002c40 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000070f90 sp=0x14000070f70 pc=0x1000f0448
runtime.goparkunlock(...)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:441
runtime.forcegchelper()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:348 +0xb8 fp=0x14000070fd0 sp=0x14000070f90 pc=0x1000bc8c8
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x14000070fd0 sp=0x14000070fd0 pc=0x1000f81a4
created by runtime.init.7 in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:336 +0x24

goroutine 3 gp=0x14000003180 m=nil [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000071760 sp=0x14000071740 pc=0x1000f0448
runtime.goparkunlock(...)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:441
runtime.bgsweep(0x1400009c000)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgcsweep.go:316 +0x108 fp=0x140000717b0 sp=0x14000071760 pc=0x1000a79a8
runtime.gcenable.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:204 +0x28 fp=0x140000717d0 sp=0x140000717b0 pc=0x10009b7a8
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x140000717d0 sp=0x140000717d0 pc=0x1000f81a4
created by runtime.gcenable in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:204 +0x6c

goroutine 4 gp=0x14000003340 m=nil [GC scavenge wait]:
runtime.gopark(0x10000?, 0x10108b5a0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000071f60 sp=0x14000071f40 pc=0x1000f0448
runtime.goparkunlock(...)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:441
runtime.(*scavengerState).park(0x101c531a0)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgcscavenge.go:425 +0x5c fp=0x14000071f90 sp=0x14000071f60 pc=0x1000a543c
runtime.bgscavenge(0x1400009c000)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgcscavenge.go:658 +0xac fp=0x14000071fb0 sp=0x14000071f90 pc=0x1000a59dc
runtime.gcenable.gowrap2()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:205 +0x28 fp=0x14000071fd0 sp=0x14000071fb0 pc=0x10009b748
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x14000071fd0 sp=0x14000071fd0 pc=0x1000f81a4
created by runtime.gcenable in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:205 +0xac

goroutine 5 gp=0x14000003c00 m=nil [finalizer wait]:
runtime.gopark(0x18000705c8?, 0x1000000000000?, 0xf8?, 0x5?, 0x1003d4e6c?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000070590 sp=0x14000070570 pc=0x1000f0448
runtime.runfinq()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mfinal.go:196 +0x108 fp=0x140000707d0 sp=0x14000070590 pc=0x10009a7a8
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x140000707d0 sp=0x140000707d0 pc=0x1000f81a4
created by runtime.createfing in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mfinal.go:166 +0x80

goroutine 6 gp=0x140001da700 m=nil [chan receive]:
runtime.gopark(0x140002215e0?, 0x14000120018?, 0x48?, 0x27?, 0x1001b8178?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x140000726f0 sp=0x140000726d0 pc=0x1000f0448
runtime.chanrecv(0x14000040380, 0x0, 0x1)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/chan.go:664 +0x42c fp=0x14000072770 sp=0x140000726f0 pc=0x10008ca4c
runtime.chanrecv1(0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/chan.go:506 +0x14 fp=0x140000727a0 sp=0x14000072770 pc=0x10008c5e4
runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1796
runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1799 +0x3c fp=0x140000727d0 sp=0x140000727a0 pc=0x10009e9cc
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x140000727d0 sp=0x140000727d0 pc=0x1000f81a4
created by unique.runtime_registerUniqueMapCleanup in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1794 +0x78

goroutine 7 gp=0x140001db180 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000072f10 sp=0x14000072ef0 pc=0x1000f0448
runtime.gcBgMarkWorker(0x14000041960)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x14000072fb0 sp=0x14000072f10 pc=0x10009dc3c
runtime.gcBgMarkStartWorkers.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x14000072fd0 sp=0x14000072fb0 pc=0x10009db28
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x14000072fd0 sp=0x14000072fd0 pc=0x1000f81a4
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140

goroutine 18 gp=0x14000504000 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400006c710 sp=0x1400006c6f0 pc=0x1000f0448
runtime.gcBgMarkWorker(0x14000041960)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400006c7b0 sp=0x1400006c710 pc=0x10009dc3c
runtime.gcBgMarkStartWorkers.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400006c7d0 sp=0x1400006c7b0 pc=0x10009db28
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400006c7d0 sp=0x1400006c7d0 pc=0x1000f81a4
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140

goroutine 34 gp=0x14000102380 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400011a710 sp=0x1400011a6f0 pc=0x1000f0448
runtime.gcBgMarkWorker(0x14000041960)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400011a7b0 sp=0x1400011a710 pc=0x10009dc3c
runtime.gcBgMarkStartWorkers.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400011a7d0 sp=0x1400011a7b0 pc=0x10009db28
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400011a7d0 sp=0x1400011a7d0 pc=0x1000f81a4
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140

goroutine 19 gp=0x140005041c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400006cf10 sp=0x1400006cef0 pc=0x1000f0448
runtime.gcBgMarkWorker(0x14000041960)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400006cfb0 sp=0x1400006cf10 pc=0x10009dc3c
runtime.gcBgMarkStartWorkers.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400006cfd0 sp=0x1400006cfb0 pc=0x10009db28
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400006cfd0 sp=0x1400006cfd0 pc=0x1000f81a4
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140

goroutine 20 gp=0x14000504380 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400006d710 sp=0x1400006d6f0 pc=0x1000f0448
runtime.gcBgMarkWorker(0x14000041960)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400006d7b0 sp=0x1400006d710 pc=0x10009dc3c
runtime.gcBgMarkStartWorkers.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400006d7d0 sp=0x1400006d7b0 pc=0x10009db28
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400006d7d0 sp=0x1400006d7d0 pc=0x1000f81a4
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140

goroutine 8 gp=0x140001db340 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000073710 sp=0x140000736f0 pc=0x1000f0448
runtime.gcBgMarkWorker(0x14000041960)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x140000737b0 sp=0x14000073710 pc=0x10009dc3c
runtime.gcBgMarkStartWorkers.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x140000737d0 sp=0x140000737b0 pc=0x10009db28
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x140000737d0 sp=0x140000737d0 pc=0x1000f81a4
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140

goroutine 35 gp=0x14000102540 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400011af10 sp=0x1400011aef0 pc=0x1000f0448
runtime.gcBgMarkWorker(0x14000041960)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400011afb0 sp=0x1400011af10 pc=0x10009dc3c
runtime.gcBgMarkStartWorkers.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400011afd0 sp=0x1400011afb0 pc=0x10009db28
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400011afd0 sp=0x1400011afd0 pc=0x1000f81a4
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140

goroutine 36 gp=0x14000102700 m=nil [GC worker (idle)]:
runtime.gopark(0xd069b8784a?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400011b710 sp=0x1400011b6f0 pc=0x1000f0448
runtime.gcBgMarkWorker(0x14000041960)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400011b7b0 sp=0x1400011b710 pc=0x10009dc3c
runtime.gcBgMarkStartWorkers.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400011b7d0 sp=0x1400011b7b0 pc=0x10009db28
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400011b7d0 sp=0x1400011b7d0 pc=0x1000f81a4
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140

goroutine 37 gp=0x140001028c0 m=nil [GC worker (idle)]:
runtime.gopark(0xd069b7ae78?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400011bf10 sp=0x1400011bef0 pc=0x1000f0448
runtime.gcBgMarkWorker(0x14000041960)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400011bfb0 sp=0x1400011bf10 pc=0x10009dc3c
runtime.gcBgMarkStartWorkers.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400011bfd0 sp=0x1400011bfb0 pc=0x10009db28
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400011bfd0 sp=0x1400011bfd0 pc=0x1000f81a4
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140

goroutine 38 gp=0x14000102a80 m=nil [GC worker (idle)]:
runtime.gopark(0xd069b81da2?, 0x0?, 0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400011c710 sp=0x1400011c6f0 pc=0x1000f0448
runtime.gcBgMarkWorker(0x14000041960)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400011c7b0 sp=0x1400011c710 pc=0x10009dc3c
runtime.gcBgMarkStartWorkers.gowrap1()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400011c7d0 sp=0x1400011c7b0 pc=0x10009db28
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400011c7d0 sp=0x1400011c7d0 pc=0x1000f81a4
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140

goroutine 50 gp=0x14000102c40 m=nil [select]:
runtime.gopark(0x14000047a60?, 0x2?, 0xa?, 0x0?, 0x1400004785c?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x140000476b0 sp=0x14000047690 pc=0x1000f0448
runtime.selectgo(0x14000047a60, 0x14000047858, 0x2?, 0x0, 0x1?, 0x1)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/select.go:351 +0x6c4 fp=0x140000477e0 sp=0x140000476b0 pc=0x1000cfbe4
github.com/ollama/ollama/runner/llamarunner.(*Server).completion(0x1400048ca00, {0x101376e28, 0x14000621880}, 0x14000446500)
	/Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:629 +0x98c fp=0x14000047aa0 sp=0x140000477e0 pc=0x1004f392c
github.com/ollama/ollama/runner/llamarunner.(*Server).completion-fm({0x101376e28?, 0x14000621880?}, 0x14000047b28?)
	<autogenerated>:1 +0x40 fp=0x14000047ad0 sp=0x14000047aa0 pc=0x1004f6300
net/http.HandlerFunc.ServeHTTP(0x14000497140?, {0x101376e28?, 0x14000621880?}, 0x14000047b10?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:2294 +0x38 fp=0x14000047b00 sp=0x14000047ad0 pc=0x1003a8668
net/http.(*ServeMux).ServeHTTP(0x10?, {0x101376e28, 0x14000621880}, 0x14000446500)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:2822 +0x1b4 fp=0x14000047b50 sp=0x14000047b00 pc=0x1003aa1f4
net/http.serverHandler.ServeHTTP({0x101373450?}, {0x101376e28?, 0x14000621880?}, 0x1?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:3301 +0xbc fp=0x14000047b80 sp=0x14000047b50 pc=0x1003c5edc
net/http.(*conn).serve(0x140000ee000, {0x101379188, 0x140004c2f90})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:2102 +0x52c fp=0x14000047fa0 sp=0x14000047b80 pc=0x1003a6e0c
net/http.(*Server).Serve.gowrap3()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:3454 +0x30 fp=0x14000047fd0 sp=0x14000047fa0 pc=0x1003abfd0
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x14000047fd0 sp=0x14000047fd0 pc=0x1000f81a4
created by net/http.(*Server).Serve in goroutine 1
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:3454 +0x3d8

goroutine 10 gp=0x14000504c40 m=nil [IO wait]:
runtime.gopark(0xffffffffffffffff?, 0xffffffffffffffff?, 0x23?, 0x0?, 0x100113c80?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000117580 sp=0x14000117560 pc=0x1000f0448
runtime.netpollblock(0x0?, 0x0?, 0x0?)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/netpoll.go:575 +0x158 fp=0x140001175c0 sp=0x14000117580 pc=0x1000b5a08
internal/poll.runtime_pollWait(0x128b05218, 0x72)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/netpoll.go:351 +0xa0 fp=0x140001175f0 sp=0x140001175c0 pc=0x1000ef600
internal/poll.(*pollDesc).wait(0x140001ca000?, 0x140000b2a01?, 0x0)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_poll_runtime.go:84 +0x28 fp=0x14000117620 sp=0x140001175f0 pc=0x10016f878
internal/poll.(*pollDesc).waitRead(...)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x140001ca000, {0x140000b2a01, 0x1, 0x1})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_unix.go:165 +0x1fc fp=0x140001176c0 sp=0x14000117620 pc=0x100170b2c
net.(*netFD).Read(0x140001ca000, {0x140000b2a01?, 0x0?, 0x0?})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/fd_posix.go:55 +0x28 fp=0x14000117710 sp=0x140001176c0 pc=0x1001e2578
net.(*conn).Read(0x14000074000, {0x140000b2a01?, 0x1?, 0x140000426c0?})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/net.go:194 +0x34 fp=0x14000117760 sp=0x14000117710 pc=0x1001ef444
net/http.(*connReader).backgroundRead(0x140000b29f0)
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:690 +0x40 fp=0x140001177b0 sp=0x14000117760 pc=0x1003a1780
net/http.(*connReader).startBackgroundRead.gowrap2()
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:686 +0x28 fp=0x140001177d0 sp=0x140001177b0 pc=0x1003a1668
runtime.goexit({})
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x140001177d0 sp=0x140001177d0 pc=0x1000f81a4
created by net/http.(*connReader).startBackgroundRead in goroutine 50
	/Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:686 +0xc4

r0      0x1
r1      0x100c85ce8
r2      0x14093e200
r3      0x200
r4      0x140abe600
r5      0x20
r6      0x1
r7      0x20
r8      0x1
r9      0x0
r10     0x0
r11     0x600001d6c000
r12     0x8
r13     0x8
r14     0x668
r15     0x1
r16     0x3d15
r17     0x2
r18     0x0
r19     0x60000346b8e0
r20     0x600001f61380
r21     0x800
r22     0x18
r23     0x2
r24     0x200
r25     0x2
r26     0x1380e5800
r27     0x0
r28     0x600001d70340
r29     0x1735c6d20
lr      0x100d0a61c
sp      0x1735c6cb0
pc      0x100d0a6c8
fault   0x8
time=2025-10-01T12:56:03.034+03:00 level=ERROR source=server.go:1459 msg="post predict" error="Post \"http://127.0.0.1:49873/completion\": EOF"

OS

macOS

GPU

Apple

CPU

Apple

Ollama version

0.12.3

Originally created by @alexandertsukanov on GitHub (Oct 1, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/12466 ### What is the issue? Hey, Ollama team! It seems I am can't run the GGUF version of [flan-t5-large-grammar-synthesis](https://huggingface.co/pszemraj/flan-t5-large-grammar-synthesis-gguf) I constantly can observe next error ``` Error model runner has unexpectedly stopped, this may be due to resource limitations or an internal error, check ollama server logs for details ``` What could be the reason behind that? Thanks. ### Relevant log output ```shell print_info: file format = GGUF V3 (latest) print_info: file type = Q8_0 print_info: file size = 793.90 MiB (8.50 BPW) load: model vocab missing newline token, using special_pad_id instead load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect load: printing all EOG tokens: load: - 1 ('</s>') load: special tokens cache size = 3 load: token to piece cache size = 0.2111 MB print_info: arch = t5 print_info: vocab_only = 0 print_info: n_ctx_train = 512 print_info: n_embd = 1024 print_info: n_layer = 24 print_info: n_head = 16 print_info: n_head_kv = 16 print_info: n_rot = 64 print_info: n_swa = 0 print_info: is_swa_any = 0 print_info: n_embd_head_k = 64 print_info: n_embd_head_v = 64 print_info: n_gqa = 1 print_info: n_embd_k_gqa = 1024 print_info: n_embd_v_gqa = 1024 print_info: f_norm_eps = 0.0e+00 print_info: f_norm_rms_eps = 1.0e-06 print_info: f_clamp_kqv = 0.0e+00 print_info: f_max_alibi_bias = 0.0e+00 print_info: f_logit_scale = 0.0e+00 print_info: f_attn_scale = 0.0e+00 print_info: n_ff = 2816 print_info: n_expert = 0 print_info: n_expert_used = 0 print_info: causal attn = 1 print_info: pooling type = 0 print_info: rope type = -1 print_info: rope scaling = linear print_info: freq_base_train = 10000.0 print_info: freq_scale_train = 1 print_info: n_ctx_orig_yarn = 512 print_info: rope_finetuned = unknown print_info: model type = 780M print_info: model params = 783.15 M print_info: general.name = Flan T5 Large Grammar Synthesis print_info: vocab type = UGM print_info: n_vocab = 32128 print_info: n_merges = 0 print_info: EOS token = 1 '</s>' print_info: UNK token = 2 '<unk>' print_info: PAD token = 0 '<pad>' print_info: LF token = 0 '<pad>' print_info: EOG token = 1 '</s>' print_info: max token length = 20 load_tensors: loading model tensors, this can take a while... (mmap = true) load_tensors: offloading 24 repeating layers to GPU load_tensors: offloading output layer to GPU load_tensors: offloaded 25/25 layers to GPU load_tensors: CPU_Mapped model buffer size = 33.34 MiB load_tensors: Metal_Mapped model buffer size = 760.57 MiB llama_context: constructing llama_context llama_context: n_seq_max = 1 llama_context: n_ctx = 512 llama_context: n_ctx_per_seq = 512 llama_context: n_batch = 512 llama_context: n_ubatch = 512 llama_context: causal_attn = 1 llama_context: flash_attn = 0 llama_context: kv_unified = false llama_context: freq_base = 10000.0 llama_context: freq_scale = 1 ggml_metal_init: allocating ggml_metal_init: picking default device: Apple M1 Max ggml_metal_load_library: using embedded metal library ggml_metal_init: GPU name: Apple M1 Max ggml_metal_init: GPU family: MTLGPUFamilyApple7 (1007) ggml_metal_init: GPU family: MTLGPUFamilyCommon3 (3003) ggml_metal_init: GPU family: MTLGPUFamilyMetal3 (5001) ggml_metal_init: simdgroup reduction = true ggml_metal_init: simdgroup matrix mul. = true ggml_metal_init: has residency sets = false ggml_metal_init: has bfloat = true ggml_metal_init: use bfloat = true ggml_metal_init: hasUnifiedMemory = true ggml_metal_init: recommendedMaxWorkingSetSize = 51539.61 MB llama_context: CPU output buffer size = 0.13 MiB llama_kv_cache_unified: Metal KV buffer size = 48.00 MiB llama_kv_cache_unified: size = 48.00 MiB ( 512 cells, 24 layers, 1/1 seqs), K (f16): 24.00 MiB, V (f16): 24.00 MiB llama_context: Metal compute buffer size = 84.00 MiB llama_context: CPU compute buffer size = 11.01 MiB llama_context: graph nodes = 1446 llama_context: graph splits = 5 time=2025-10-01T12:55:52.559+03:00 level=INFO source=server.go:1289 msg="llama runner started in 0.30 seconds" time=2025-10-01T12:55:52.559+03:00 level=INFO source=sched.go:470 msg="loaded runners" count=1 time=2025-10-01T12:55:52.559+03:00 level=INFO source=server.go:1251 msg="waiting for llama runner to start responding" time=2025-10-01T12:55:52.560+03:00 level=INFO source=server.go:1289 msg="llama runner started in 0.30 seconds" [GIN] 2025/10/01 - 12:55:52 | 200 | 375.6755ms | 127.0.0.1 | POST "/api/generate" [GIN] 2025/10/01 - 12:55:59 | 200 | 1.105459ms | 127.0.0.1 | GET "/api/tags" SIGSEGV: segmentation violation PC=0x100d0a6c8 m=8 sigcode=2 addr=0x8 signal arrived during cgo execution goroutine 9 gp=0x14000504a80 m=8 mp=0x14000600008 [syscall]: runtime.cgocall(0x100c222b8, 0x14000080bb8) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/cgocall.go:167 +0x44 fp=0x14000080b80 sp=0x14000080b40 pc=0x1000ecf24 github.com/ollama/ollama/llama._Cfunc_llama_decode(0x13fe066a0, {0x2, 0x1409dc000, 0x0, 0x1409d8e00, 0x1409d5c00, 0x140c73e00, 0x13ffb1b10}) _cgo_gotypes.go:662 +0x34 fp=0x14000080bb0 sp=0x14000080b80 pc=0x10044a0b4 github.com/ollama/ollama/llama.(*Context).Decode.func1(...) /Users/runner/work/ollama/ollama/llama/llama.go:150 github.com/ollama/ollama/llama.(*Context).Decode(0x14000481f00?, 0x200000003?) /Users/runner/work/ollama/ollama/llama/llama.go:150 +0xc8 fp=0x14000080ca0 sp=0x14000080bb0 pc=0x10044c228 github.com/ollama/ollama/runner/llamarunner.(*Server).processBatch(0x1400048ca00, 0x1400004ebe0, 0x1400011d718) /Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:441 +0x1c8 fp=0x14000080ed0 sp=0x14000080ca0 pc=0x1004f2268 github.com/ollama/ollama/runner/llamarunner.(*Server).run(0x1400048ca00, {0x1013791c0, 0x14000615c20}) /Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:346 +0x164 fp=0x14000080fa0 sp=0x14000080ed0 pc=0x1004f1f34 github.com/ollama/ollama/runner/llamarunner.Execute.gowrap1() /Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:880 +0x30 fp=0x14000080fd0 sp=0x14000080fa0 pc=0x1004f5f10 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x14000080fd0 sp=0x14000080fd0 pc=0x1000f81a4 created by github.com/ollama/ollama/runner/llamarunner.Execute in goroutine 1 /Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:880 +0x44c goroutine 1 gp=0x140000021c0 m=nil [IO wait]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400050f720 sp=0x1400050f700 pc=0x1000f0448 runtime.netpollblock(0x1400050f7b8?, 0x174060?, 0x1?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/netpoll.go:575 +0x158 fp=0x1400050f760 sp=0x1400050f720 pc=0x1000b5a08 internal/poll.runtime_pollWait(0x128b05330, 0x72) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/netpoll.go:351 +0xa0 fp=0x1400050f790 sp=0x1400050f760 pc=0x1000ef600 internal/poll.(*pollDesc).wait(0x140004cf300?, 0x100097ddc?, 0x0) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_poll_runtime.go:84 +0x28 fp=0x1400050f7c0 sp=0x1400050f790 pc=0x10016f878 internal/poll.(*pollDesc).waitRead(...) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Accept(0x140004cf300) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_unix.go:620 +0x24c fp=0x1400050f870 sp=0x1400050f7c0 pc=0x10017414c net.(*netFD).accept(0x140004cf300) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/fd_unix.go:172 +0x28 fp=0x1400050f930 sp=0x1400050f870 pc=0x1001e3fa8 net.(*TCPListener).accept(0x140002d21c0) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/tcpsock_posix.go:159 +0x24 fp=0x1400050f980 sp=0x1400050f930 pc=0x1001f8204 net.(*TCPListener).Accept(0x140002d21c0) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/tcpsock.go:380 +0x2c fp=0x1400050f9c0 sp=0x1400050f980 pc=0x1001f71ec net/http.(*onceCloseListener).Accept(0x140000ee000?) <autogenerated>:1 +0x30 fp=0x1400050f9e0 sp=0x1400050f9c0 pc=0x1003d2500 net/http.(*Server).Serve(0x1400011f200, {0x101376c48, 0x140002d21c0}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:3424 +0x290 fp=0x1400050fb10 sp=0x1400050f9e0 pc=0x1003abc40 github.com/ollama/ollama/runner/llamarunner.Execute({0x14000032260, 0x4, 0x4}) /Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:901 +0x7ac fp=0x1400050fce0 sp=0x1400050fb10 pc=0x1004f5cec github.com/ollama/ollama/runner.Execute({0x14000032250?, 0x0?, 0x0?}) /Users/runner/work/ollama/ollama/runner/runner.go:22 +0x130 fp=0x1400050fd10 sp=0x1400050fce0 pc=0x100567dd0 github.com/ollama/ollama/cmd.NewCLI.func2(0x1400011ef00?, {0x100ece268?, 0x4?, 0x100ece26c?}) /Users/runner/work/ollama/ollama/cmd/cmd.go:1769 +0x54 fp=0x1400050fd40 sp=0x1400050fd10 pc=0x100bd1774 github.com/spf13/cobra.(*Command).execute(0x140004e5508, {0x1400009ff40, 0x4, 0x4}) /Users/runner/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x648 fp=0x1400050fe60 sp=0x1400050fd40 pc=0x100252548 github.com/spf13/cobra.(*Command).ExecuteC(0x140004d2908) /Users/runner/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x320 fp=0x1400050ff20 sp=0x1400050fe60 pc=0x100252c90 github.com/spf13/cobra.(*Command).Execute(...) /Users/runner/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) /Users/runner/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() /Users/runner/work/ollama/ollama/main.go:12 +0x54 fp=0x1400050ff40 sp=0x1400050ff20 pc=0x100bd22b4 runtime.main() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:283 +0x284 fp=0x1400050ffd0 sp=0x1400050ff40 pc=0x1000bc574 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400050ffd0 sp=0x1400050ffd0 pc=0x1000f81a4 goroutine 2 gp=0x14000002c40 m=nil [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000070f90 sp=0x14000070f70 pc=0x1000f0448 runtime.goparkunlock(...) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:441 runtime.forcegchelper() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:348 +0xb8 fp=0x14000070fd0 sp=0x14000070f90 pc=0x1000bc8c8 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x14000070fd0 sp=0x14000070fd0 pc=0x1000f81a4 created by runtime.init.7 in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:336 +0x24 goroutine 3 gp=0x14000003180 m=nil [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000071760 sp=0x14000071740 pc=0x1000f0448 runtime.goparkunlock(...) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:441 runtime.bgsweep(0x1400009c000) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgcsweep.go:316 +0x108 fp=0x140000717b0 sp=0x14000071760 pc=0x1000a79a8 runtime.gcenable.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:204 +0x28 fp=0x140000717d0 sp=0x140000717b0 pc=0x10009b7a8 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x140000717d0 sp=0x140000717d0 pc=0x1000f81a4 created by runtime.gcenable in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:204 +0x6c goroutine 4 gp=0x14000003340 m=nil [GC scavenge wait]: runtime.gopark(0x10000?, 0x10108b5a0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000071f60 sp=0x14000071f40 pc=0x1000f0448 runtime.goparkunlock(...) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:441 runtime.(*scavengerState).park(0x101c531a0) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgcscavenge.go:425 +0x5c fp=0x14000071f90 sp=0x14000071f60 pc=0x1000a543c runtime.bgscavenge(0x1400009c000) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgcscavenge.go:658 +0xac fp=0x14000071fb0 sp=0x14000071f90 pc=0x1000a59dc runtime.gcenable.gowrap2() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:205 +0x28 fp=0x14000071fd0 sp=0x14000071fb0 pc=0x10009b748 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x14000071fd0 sp=0x14000071fd0 pc=0x1000f81a4 created by runtime.gcenable in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:205 +0xac goroutine 5 gp=0x14000003c00 m=nil [finalizer wait]: runtime.gopark(0x18000705c8?, 0x1000000000000?, 0xf8?, 0x5?, 0x1003d4e6c?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000070590 sp=0x14000070570 pc=0x1000f0448 runtime.runfinq() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mfinal.go:196 +0x108 fp=0x140000707d0 sp=0x14000070590 pc=0x10009a7a8 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x140000707d0 sp=0x140000707d0 pc=0x1000f81a4 created by runtime.createfing in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mfinal.go:166 +0x80 goroutine 6 gp=0x140001da700 m=nil [chan receive]: runtime.gopark(0x140002215e0?, 0x14000120018?, 0x48?, 0x27?, 0x1001b8178?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x140000726f0 sp=0x140000726d0 pc=0x1000f0448 runtime.chanrecv(0x14000040380, 0x0, 0x1) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/chan.go:664 +0x42c fp=0x14000072770 sp=0x140000726f0 pc=0x10008ca4c runtime.chanrecv1(0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/chan.go:506 +0x14 fp=0x140000727a0 sp=0x14000072770 pc=0x10008c5e4 runtime.unique_runtime_registerUniqueMapCleanup.func2(...) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1796 runtime.unique_runtime_registerUniqueMapCleanup.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1799 +0x3c fp=0x140000727d0 sp=0x140000727a0 pc=0x10009e9cc runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x140000727d0 sp=0x140000727d0 pc=0x1000f81a4 created by unique.runtime_registerUniqueMapCleanup in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1794 +0x78 goroutine 7 gp=0x140001db180 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000072f10 sp=0x14000072ef0 pc=0x1000f0448 runtime.gcBgMarkWorker(0x14000041960) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x14000072fb0 sp=0x14000072f10 pc=0x10009dc3c runtime.gcBgMarkStartWorkers.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x14000072fd0 sp=0x14000072fb0 pc=0x10009db28 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x14000072fd0 sp=0x14000072fd0 pc=0x1000f81a4 created by runtime.gcBgMarkStartWorkers in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140 goroutine 18 gp=0x14000504000 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400006c710 sp=0x1400006c6f0 pc=0x1000f0448 runtime.gcBgMarkWorker(0x14000041960) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400006c7b0 sp=0x1400006c710 pc=0x10009dc3c runtime.gcBgMarkStartWorkers.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400006c7d0 sp=0x1400006c7b0 pc=0x10009db28 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400006c7d0 sp=0x1400006c7d0 pc=0x1000f81a4 created by runtime.gcBgMarkStartWorkers in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140 goroutine 34 gp=0x14000102380 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400011a710 sp=0x1400011a6f0 pc=0x1000f0448 runtime.gcBgMarkWorker(0x14000041960) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400011a7b0 sp=0x1400011a710 pc=0x10009dc3c runtime.gcBgMarkStartWorkers.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400011a7d0 sp=0x1400011a7b0 pc=0x10009db28 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400011a7d0 sp=0x1400011a7d0 pc=0x1000f81a4 created by runtime.gcBgMarkStartWorkers in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140 goroutine 19 gp=0x140005041c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400006cf10 sp=0x1400006cef0 pc=0x1000f0448 runtime.gcBgMarkWorker(0x14000041960) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400006cfb0 sp=0x1400006cf10 pc=0x10009dc3c runtime.gcBgMarkStartWorkers.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400006cfd0 sp=0x1400006cfb0 pc=0x10009db28 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400006cfd0 sp=0x1400006cfd0 pc=0x1000f81a4 created by runtime.gcBgMarkStartWorkers in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140 goroutine 20 gp=0x14000504380 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400006d710 sp=0x1400006d6f0 pc=0x1000f0448 runtime.gcBgMarkWorker(0x14000041960) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400006d7b0 sp=0x1400006d710 pc=0x10009dc3c runtime.gcBgMarkStartWorkers.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400006d7d0 sp=0x1400006d7b0 pc=0x10009db28 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400006d7d0 sp=0x1400006d7d0 pc=0x1000f81a4 created by runtime.gcBgMarkStartWorkers in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140 goroutine 8 gp=0x140001db340 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000073710 sp=0x140000736f0 pc=0x1000f0448 runtime.gcBgMarkWorker(0x14000041960) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x140000737b0 sp=0x14000073710 pc=0x10009dc3c runtime.gcBgMarkStartWorkers.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x140000737d0 sp=0x140000737b0 pc=0x10009db28 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x140000737d0 sp=0x140000737d0 pc=0x1000f81a4 created by runtime.gcBgMarkStartWorkers in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140 goroutine 35 gp=0x14000102540 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400011af10 sp=0x1400011aef0 pc=0x1000f0448 runtime.gcBgMarkWorker(0x14000041960) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400011afb0 sp=0x1400011af10 pc=0x10009dc3c runtime.gcBgMarkStartWorkers.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400011afd0 sp=0x1400011afb0 pc=0x10009db28 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400011afd0 sp=0x1400011afd0 pc=0x1000f81a4 created by runtime.gcBgMarkStartWorkers in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140 goroutine 36 gp=0x14000102700 m=nil [GC worker (idle)]: runtime.gopark(0xd069b8784a?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400011b710 sp=0x1400011b6f0 pc=0x1000f0448 runtime.gcBgMarkWorker(0x14000041960) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400011b7b0 sp=0x1400011b710 pc=0x10009dc3c runtime.gcBgMarkStartWorkers.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400011b7d0 sp=0x1400011b7b0 pc=0x10009db28 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400011b7d0 sp=0x1400011b7d0 pc=0x1000f81a4 created by runtime.gcBgMarkStartWorkers in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140 goroutine 37 gp=0x140001028c0 m=nil [GC worker (idle)]: runtime.gopark(0xd069b7ae78?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400011bf10 sp=0x1400011bef0 pc=0x1000f0448 runtime.gcBgMarkWorker(0x14000041960) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400011bfb0 sp=0x1400011bf10 pc=0x10009dc3c runtime.gcBgMarkStartWorkers.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400011bfd0 sp=0x1400011bfb0 pc=0x10009db28 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400011bfd0 sp=0x1400011bfd0 pc=0x1000f81a4 created by runtime.gcBgMarkStartWorkers in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140 goroutine 38 gp=0x14000102a80 m=nil [GC worker (idle)]: runtime.gopark(0xd069b81da2?, 0x0?, 0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x1400011c710 sp=0x1400011c6f0 pc=0x1000f0448 runtime.gcBgMarkWorker(0x14000041960) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1423 +0xdc fp=0x1400011c7b0 sp=0x1400011c710 pc=0x10009dc3c runtime.gcBgMarkStartWorkers.gowrap1() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x28 fp=0x1400011c7d0 sp=0x1400011c7b0 pc=0x10009db28 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x1400011c7d0 sp=0x1400011c7d0 pc=0x1000f81a4 created by runtime.gcBgMarkStartWorkers in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/mgc.go:1339 +0x140 goroutine 50 gp=0x14000102c40 m=nil [select]: runtime.gopark(0x14000047a60?, 0x2?, 0xa?, 0x0?, 0x1400004785c?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x140000476b0 sp=0x14000047690 pc=0x1000f0448 runtime.selectgo(0x14000047a60, 0x14000047858, 0x2?, 0x0, 0x1?, 0x1) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/select.go:351 +0x6c4 fp=0x140000477e0 sp=0x140000476b0 pc=0x1000cfbe4 github.com/ollama/ollama/runner/llamarunner.(*Server).completion(0x1400048ca00, {0x101376e28, 0x14000621880}, 0x14000446500) /Users/runner/work/ollama/ollama/runner/llamarunner/runner.go:629 +0x98c fp=0x14000047aa0 sp=0x140000477e0 pc=0x1004f392c github.com/ollama/ollama/runner/llamarunner.(*Server).completion-fm({0x101376e28?, 0x14000621880?}, 0x14000047b28?) <autogenerated>:1 +0x40 fp=0x14000047ad0 sp=0x14000047aa0 pc=0x1004f6300 net/http.HandlerFunc.ServeHTTP(0x14000497140?, {0x101376e28?, 0x14000621880?}, 0x14000047b10?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:2294 +0x38 fp=0x14000047b00 sp=0x14000047ad0 pc=0x1003a8668 net/http.(*ServeMux).ServeHTTP(0x10?, {0x101376e28, 0x14000621880}, 0x14000446500) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:2822 +0x1b4 fp=0x14000047b50 sp=0x14000047b00 pc=0x1003aa1f4 net/http.serverHandler.ServeHTTP({0x101373450?}, {0x101376e28?, 0x14000621880?}, 0x1?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:3301 +0xbc fp=0x14000047b80 sp=0x14000047b50 pc=0x1003c5edc net/http.(*conn).serve(0x140000ee000, {0x101379188, 0x140004c2f90}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:2102 +0x52c fp=0x14000047fa0 sp=0x14000047b80 pc=0x1003a6e0c net/http.(*Server).Serve.gowrap3() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:3454 +0x30 fp=0x14000047fd0 sp=0x14000047fa0 pc=0x1003abfd0 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x14000047fd0 sp=0x14000047fd0 pc=0x1000f81a4 created by net/http.(*Server).Serve in goroutine 1 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:3454 +0x3d8 goroutine 10 gp=0x14000504c40 m=nil [IO wait]: runtime.gopark(0xffffffffffffffff?, 0xffffffffffffffff?, 0x23?, 0x0?, 0x100113c80?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/proc.go:435 +0xc8 fp=0x14000117580 sp=0x14000117560 pc=0x1000f0448 runtime.netpollblock(0x0?, 0x0?, 0x0?) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/netpoll.go:575 +0x158 fp=0x140001175c0 sp=0x14000117580 pc=0x1000b5a08 internal/poll.runtime_pollWait(0x128b05218, 0x72) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/netpoll.go:351 +0xa0 fp=0x140001175f0 sp=0x140001175c0 pc=0x1000ef600 internal/poll.(*pollDesc).wait(0x140001ca000?, 0x140000b2a01?, 0x0) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_poll_runtime.go:84 +0x28 fp=0x14000117620 sp=0x140001175f0 pc=0x10016f878 internal/poll.(*pollDesc).waitRead(...) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0x140001ca000, {0x140000b2a01, 0x1, 0x1}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/internal/poll/fd_unix.go:165 +0x1fc fp=0x140001176c0 sp=0x14000117620 pc=0x100170b2c net.(*netFD).Read(0x140001ca000, {0x140000b2a01?, 0x0?, 0x0?}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/fd_posix.go:55 +0x28 fp=0x14000117710 sp=0x140001176c0 pc=0x1001e2578 net.(*conn).Read(0x14000074000, {0x140000b2a01?, 0x1?, 0x140000426c0?}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/net.go:194 +0x34 fp=0x14000117760 sp=0x14000117710 pc=0x1001ef444 net/http.(*connReader).backgroundRead(0x140000b29f0) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:690 +0x40 fp=0x140001177b0 sp=0x14000117760 pc=0x1003a1780 net/http.(*connReader).startBackgroundRead.gowrap2() /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:686 +0x28 fp=0x140001177d0 sp=0x140001177b0 pc=0x1003a1668 runtime.goexit({}) /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/runtime/asm_arm64.s:1223 +0x4 fp=0x140001177d0 sp=0x140001177d0 pc=0x1000f81a4 created by net/http.(*connReader).startBackgroundRead in goroutine 50 /Users/runner/hostedtoolcache/go/1.24.0/arm64/src/net/http/server.go:686 +0xc4 r0 0x1 r1 0x100c85ce8 r2 0x14093e200 r3 0x200 r4 0x140abe600 r5 0x20 r6 0x1 r7 0x20 r8 0x1 r9 0x0 r10 0x0 r11 0x600001d6c000 r12 0x8 r13 0x8 r14 0x668 r15 0x1 r16 0x3d15 r17 0x2 r18 0x0 r19 0x60000346b8e0 r20 0x600001f61380 r21 0x800 r22 0x18 r23 0x2 r24 0x200 r25 0x2 r26 0x1380e5800 r27 0x0 r28 0x600001d70340 r29 0x1735c6d20 lr 0x100d0a61c sp 0x1735c6cb0 pc 0x100d0a6c8 fault 0x8 time=2025-10-01T12:56:03.034+03:00 level=ERROR source=server.go:1459 msg="post predict" error="Post \"http://127.0.0.1:49873/completion\": EOF" ``` ### OS macOS ### GPU Apple ### CPU Apple ### Ollama version 0.12.3
GiteaMirror added the bug label 2026-04-22 17:16:12 -05:00
Author
Owner

@GamalZilo commented on GitHub (Oct 24, 2025):

@alexandertsukanov Have you found any solution to this? I am having similar error message running model 'MichelRosselli/GLM-4.5-Air:BF16'.

OS
macOS

GPU
Apple Silicon

CPU
Apple

Ollama version
0.11.10

<!-- gh-comment-id:3441719356 --> @GamalZilo commented on GitHub (Oct 24, 2025): @alexandertsukanov Have you found any solution to this? I am having similar error message running model 'MichelRosselli/GLM-4.5-Air:BF16'. **OS** macOS **GPU** Apple Silicon **CPU** Apple **Ollama version** 0.11.10
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#34042